2024-09-17T01:40:39.761 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T01:40:39.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:40:39.862 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7908069' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 4845 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVzX1wRa0KcNN8tpej7whpwidjX2bO4hXQkbwwZK1up2JqY9/uNDrBAK8cujxRC6eWwb2d6wd6qXPtGchJsVsY= smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOVvnEWvJTFHkTdDXxlA0+UKTHfPuaoxSBKgDOb//dhyPnyLK9wtDGZjUkOof6T7YM9VLM9neRsPzAX0dVSU08= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBBUsHi0pqz/Ngr+RW7KYg1YMeyTWYxjPru326sFBG2hU7PiZn7tmfxh9JdZOTdZLmJVx62JnZ0X6peN3yPVQ6c= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUkIiakwwsU/0sA5XovXUbzcUzAghsdqjHgYGfev+TEQ2OVzVtSFD5PQv9jIl+QLQGtiM5beeGVoqEAF0bzA30= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T01:40:39.863 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa; will attempt to use it 2024-09-17T01:40:39.863 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks 2024-09-17T01:40:39.863 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T01:40:39.865 INFO:teuthology.task.internal:Checking packages... 2024-09-17T01:40:39.886 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T01:40:39.886 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:40:39.887 INFO:teuthology.packaging:ref: None 2024-09-17T01:40:39.887 INFO:teuthology.packaging:tag: None 2024-09-17T01:40:39.887 INFO:teuthology.packaging:branch: squid 2024-09-17T01:40:39.887 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:40:39.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-17T01:40:40.100 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-336-ge20bff7d-1jammy 2024-09-17T01:40:40.102 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T01:40:40.108 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T01:40:40.109 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T01:40:40.121 INFO:teuthology.task.internal:Saving configuration 2024-09-17T01:40:40.134 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T01:40:40.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T01:40:40.166 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:34:48.863464', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPlvtclTsubLrnzbQ19l20v5c27/fMFokp3R1rYJOit9'} 2024-09-17T01:40:40.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:34:48.859839', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILyA0xwcZ6wqy3yuPn4qP8HucOmXUuO5WfC4nXHOxWkH'} 2024-09-17T01:40:40.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:34:48.861348', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILvSOoIseXEedmXh6Im3UVqeL2o3LWyCZCXpdsM/4A+8'} 2024-09-17T01:40:40.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:34:48.862405', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDkZ/kDly4J51xeSS1GrzxA7Uhr7t1gg9etLwt5pU6ix'} 2024-09-17T01:40:40.235 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T01:40:40.242 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-17T01:40:40.242 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['osd.0'] 2024-09-17T01:40:40.242 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['osd.1'] 2024-09-17T01:40:40.243 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['osd.2'] 2024-09-17T01:40:40.243 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T01:40:40.361 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ad4d96e60>, signals=[15]) 2024-09-17T01:40:40.361 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T01:40:40.368 INFO:teuthology.task.internal:Opening connections... 2024-09-17T01:40:40.368 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T01:40:40.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:40:40.452 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-09-17T01:40:40.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:40:40.531 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T01:40:40.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:40:40.609 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:40:40.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:40:40.689 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T01:40:40.697 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-17T01:40:40.702 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-17T01:40:40.703 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-17T01:40:40.750 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T01:40:40.750 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="22.04" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=jammy 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T01:40:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=jammy 2024-09-17T01:40:40.752 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-17T01:40:40.772 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-09-17T01:40:40.778 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-09-17T01:40:40.778 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-09-17T01:40:40.824 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T01:40:40.824 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-09-17T01:40:40.824 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-09-17T01:40:40.824 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T01:40:40.824 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T01:40:40.825 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-09-17T01:40:40.825 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-09-17T01:40:40.847 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-17T01:40:40.852 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-17T01:40:40.853 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-17T01:40:40.901 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T01:40:40.901 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2024-09-17T01:40:40.901 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2024-09-17T01:40:40.901 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T01:40:40.902 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2024-09-17T01:40:40.902 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-17T01:40:40.931 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-17T01:40:40.937 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-17T01:40:40.937 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-17T01:40:40.982 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T01:40:40.982 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-09-17T01:40:40.982 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-09-17T01:40:40.982 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T01:40:40.982 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T01:40:40.983 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-09-17T01:40:40.983 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-17T01:40:41.014 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T01:40:41.027 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T01:40:41.033 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T01:40:41.034 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:40:41.037 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:40:41.039 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:40:41.042 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:40:41.047 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T01:40:41.053 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T01:40:41.053 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:40:41.083 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:40:41.086 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:40:41.090 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:40:41.103 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T01:40:41.192 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T01:40:41.206 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T01:40:41.206 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T01:40:41.206 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:40:41.207 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:40:41.207 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:40:41.208 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:40:41.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:40:41.213 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-17T01:40:41.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:40:41.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:40:41.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:40:41.215 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-17T01:40:41.215 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-17T01:40:41.216 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-17T01:40:41.263 INFO:teuthology.orchestra.run.smithi098.stdout:5.15.0-56-generic 2024-09-17T01:40:41.264 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.15.0-56-generic 2024-09-17T01:40:41.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2024-09-17T01:40:41.268 INFO:teuthology.orchestra.run.smithi063.stdout:5.15.0-56-generic 2024-09-17T01:40:41.269 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-09-17T01:40:41.269 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.15.0-56-generic 2024-09-17T01:40:41.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2024-09-17T01:40:41.270 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-09-17T01:40:41.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-17T01:40:41.270 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-09-17T01:40:41.271 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-09-17T01:40:41.271 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-17T01:40:41.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-17T01:40:41.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-09-17T01:40:41.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-17T01:40:41.410 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-17T01:40:41.536 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:40:41.540 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T01:40:41.552 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T01:40:41.555 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:40:41.555 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T01:40:41.555 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T01:40:41.621 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T01:40:41.625 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T01:40:41.645 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T01:40:41.645 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T01:40:41.659 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:40:41.667 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:40:41.734 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T01:40:41.740 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-17T01:40:41.754 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T01:40:41.772 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T01:40:41.796 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T01:40:41.840 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T01:40:41.845 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T01:40:41.865 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T01:40:41.870 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T01:40:41.879 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T01:40:41.883 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T01:40:41.884 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T01:40:41.885 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T01:40:41.886 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T01:40:41.889 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T01:40:41.890 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T01:40:41.904 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T01:40:41.908 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T01:40:41.908 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T01:40:41.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T01:40:41.919 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T01:40:41.920 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T01:40:41.921 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T01:40:41.921 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T01:40:41.924 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T01:40:41.924 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T01:40:41.927 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T01:40:41.931 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T01:40:41.931 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T01:40:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T01:40:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T01:40:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T01:40:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T01:40:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T01:40:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T01:40:41.958 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T01:40:41.960 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T01:40:41.960 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T01:40:41.970 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T01:40:41.972 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T01:40:41.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T01:40:41.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T01:40:41.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T01:40:41.974 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T01:40:41.976 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T01:40:41.976 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T01:40:41.977 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T01:40:41.989 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T01:40:42.000 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T01:40:42.000 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T01:40:42.000 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T01:40:42.000 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T01:40:42.001 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T01:40:42.001 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T01:40:42.003 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T01:40:42.003 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T01:40:42.004 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T01:40:42.006 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T01:40:42.006 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T01:40:42.006 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T01:40:42.007 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T01:40:42.025 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T01:40:42.029 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T01:40:42.029 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T01:40:42.039 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T01:40:42.045 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T01:40:42.047 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T01:40:42.095 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T01:40:42.097 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T01:40:42.102 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-17T01:40:42.126 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-17T01:40:42.159 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T01:40:42.160 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T01:40:42.160 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T01:40:42.160 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T01:40:42.161 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T01:40:42.161 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T01:40:42.162 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T01:40:42.162 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T01:40:42.176 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T01:40:42.196 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T01:40:42.197 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T01:40:42.197 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T01:40:42.230 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T01:40:42.235 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-17T01:40:42.390 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T01:40:42.410 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-17T01:40:42.550 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T01:40:42.555 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-17T01:40:42.563 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T01:40:42.575 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T01:40:42.576 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T01:40:42.582 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-17T01:40:42.584 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T01:40:42.590 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-17T01:40:42.595 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-17T01:40:42.596 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-17T01:40:42.599 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T01:40:42.600 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T01:40:42.604 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-17T01:40:42.605 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-17T01:40:42.663 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T01:40:42.664 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T01:40:42.669 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T01:40:42.675 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-17T01:40:42.679 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T01:40:42.681 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-17T01:40:42.682 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-17T01:40:42.690 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T01:40:42.690 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T01:40:42.691 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T01:40:42.692 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T01:40:42.706 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-17T01:40:42.706 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-17T01:40:42.707 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-17T01:40:42.708 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T01:40:42.713 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T01:40:42.715 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-17T01:40:42.716 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-17T01:40:42.717 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-17T01:40:42.730 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-17T01:40:42.734 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T01:40:42.739 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T01:40:42.739 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T01:40:42.740 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T01:40:42.742 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-17T01:40:42.745 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T01:40:42.747 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-17T01:40:42.747 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-17T01:40:42.748 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-17T01:40:42.748 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-17T01:40:42.750 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T01:40:42.751 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T01:40:42.751 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-17T01:40:42.752 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T01:40:42.752 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-17T01:40:42.753 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-17T01:40:42.795 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T01:40:42.795 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T01:40:42.805 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-17T01:40:42.805 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-17T01:40:42.806 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T01:40:42.807 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T01:40:42.808 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T01:40:42.808 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T01:40:42.808 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T01:40:42.827 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-17T01:40:42.828 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-17T01:40:42.835 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-17T01:40:42.836 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-17T01:40:42.838 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-17T01:40:42.838 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T01:40:42.839 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T01:40:42.876 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T01:40:42.877 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T01:40:42.878 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T01:40:42.886 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-17T01:40:42.887 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-17T01:40:42.887 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-17T01:40:42.888 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-17T01:40:42.888 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-17T01:40:48.281 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 16.1 MB in 2s (7,517 kB/s) 2024-09-17T01:40:48.321 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 16.1 MB in 2s (7,572 kB/s) 2024-09-17T01:40:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 16.1 MB in 2s (7,078 kB/s) 2024-09-17T01:40:48.822 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 16.1 MB in 3s (5,790 kB/s) 2024-09-17T01:40:49.759 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:40:49.778 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:40:49.779 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:40:49.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:40:49.831 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:40:49.864 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:40:49.971 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:40:49.990 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:40:50.018 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-17T01:40:50.019 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-17T01:40:50.045 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:40:50.077 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T01:40:50.078 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T01:40:50.187 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:40:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:40:50.187 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:40:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:40:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T01:40:50.188 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-09-17T01:40:50.188 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:40:50.189 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-17T01:40:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.189 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T01:40:50.190 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-17T01:40:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T01:40:50.191 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-17T01:40:50.191 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-09-17T01:40:50.237 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-09-17T01:40:50.240 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-09-17T01:40:50.241 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-17T01:40:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T01:40:50.241 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.242 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-09-17T01:40:50.243 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-09-17T01:40:50.270 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:40:50.271 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-17T01:40:50.271 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.271 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T01:40:50.272 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.273 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-17T01:40:50.273 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T01:40:50.273 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-17T01:40:50.273 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-09-17T01:40:50.318 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-17T01:40:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.318 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T01:40:50.319 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.320 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-09-17T01:40:50.320 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T01:40:50.371 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:40:50.371 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-09-17T01:40:50.372 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T01:40:50.372 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T01:40:50.382 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:40:50.399 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:40:50.415 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:40:50.415 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:40:50.415 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:40:50.415 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:40:50.416 INFO:teuthology.orchestra.run.smithi063.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T01:40:50.416 INFO:teuthology.orchestra.run.smithi063.stdout: python2.7-minimal 2024-09-17T01:40:50.416 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:40:50.417 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-09-17T01:40:50.417 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.417 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T01:40:50.417 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.418 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-09-17T01:40:50.419 INFO:teuthology.orchestra.run.smithi063.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T01:40:50.419 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2024-09-17T01:40:50.419 INFO:teuthology.orchestra.run.smithi063.stdout: thermald 2024-09-17T01:40:50.422 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:40:50.422 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-09-17T01:40:50.422 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T01:40:50.422 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T01:40:50.454 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:40:50.458 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-09-17T01:40:50.458 INFO:teuthology.orchestra.run.smithi063.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.458 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T01:40:50.459 INFO:teuthology.orchestra.run.smithi063.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.460 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2024-09-17T01:40:50.460 INFO:teuthology.orchestra.run.smithi063.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T01:40:50.511 INFO:teuthology.orchestra.run.smithi063.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:40:50.512 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 113 MB of archives. 2024-09-17T01:40:50.512 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T01:40:50.512 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T01:40:50.641 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-17T01:40:50.641 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-17T01:40:50.799 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T01:40:50.809 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:40:50.809 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:40:50.809 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:40:50.810 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:40:50.810 INFO:teuthology.orchestra.run.smithi098.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-17T01:40:50.810 INFO:teuthology.orchestra.run.smithi098.stdout: python2.7-minimal 2024-09-17T01:40:50.810 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:40:50.811 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-17T01:40:50.811 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.811 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-17T01:40:50.812 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.813 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-17T01:40:50.813 INFO:teuthology.orchestra.run.smithi098.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-17T01:40:50.813 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2024-09-17T01:40:50.813 INFO:teuthology.orchestra.run.smithi098.stdout: thermald 2024-09-17T01:40:50.862 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-17T01:40:50.862 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-17T01:40:50.862 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-17T01:40:50.862 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-17T01:40:50.864 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2024-09-17T01:40:50.864 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T01:40:50.888 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T01:40:50.901 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T01:40:50.915 INFO:teuthology.orchestra.run.smithi098.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:40:50.915 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 113 MB of archives. 2024-09-17T01:40:50.915 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-17T01:40:50.915 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-17T01:40:50.992 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T01:40:51.293 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T01:40:51.382 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T01:40:51.693 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T01:40:51.694 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T01:40:51.694 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T01:40:51.802 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T01:40:51.803 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T01:40:51.803 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T01:40:51.813 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T01:40:51.825 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-17T01:40:51.834 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T01:40:51.929 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T01:40:51.950 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T01:40:52.175 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-17T01:40:52.209 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T01:40:52.209 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T01:40:52.209 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T01:40:52.295 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 2s (71.7 MB/s) 2024-09-17T01:40:52.336 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T01:40:52.357 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T01:40:52.446 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 113 MB in 2s (73.3 MB/s) 2024-09-17T01:40:52.472 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T01:40:52.628 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T01:40:52.752 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 113 MB in 1s (76.2 MB/s) 2024-09-17T01:40:52.920 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T01:40:54.421 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-17T01:40:54.422 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-17T01:40:54.422 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-17T01:40:54.528 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T01:40:54.532 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:54.595 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T01:40:54.599 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:54.619 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:54.676 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:54.768 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-17T01:40:54.846 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-17T01:40:54.922 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T01:40:54.927 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:55.111 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:55.234 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-09-17T01:40:55.421 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-17T01:40:56.919 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T01:40:56.941 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:57.030 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:57.162 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T01:40:57.183 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:57.274 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:57.395 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-17T01:40:57.399 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T01:40:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:57.486 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:57.514 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T01:40:57.535 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:57.539 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:57.572 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:57.732 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T01:40:57.753 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:57.790 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:57.982 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T01:40:58.003 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:40:58.040 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:40:59.742 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-17T01:40:59.763 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:41:00.067 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:00.549 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-17T01:41:00.569 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:41:00.607 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:04.091 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:04.219 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:04.235 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:04.341 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:04.508 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:04.527 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:04.605 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:04.661 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:04.665 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:04.794 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:04.908 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T01:41:04.930 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T01:41:04.974 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:05.027 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T01:41:05.145 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T01:41:05.156 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:05.400 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T01:41:05.423 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T01:41:05.458 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:06.951 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:07.054 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:07.378 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:07.499 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:07.811 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-17T01:41:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-17T01:41:07.869 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:10.363 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T01:41:10.400 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:41:10.438 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:10.452 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T01:41:10.490 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:41:10.527 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:11.064 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T01:41:11.100 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:41:11.138 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:13.350 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:13.484 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:13.732 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:13.817 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:13.854 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:13.945 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:13.982 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-17T01:41:14.020 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:14.090 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T01:41:14.197 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:14.219 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:14.325 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:14.385 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:14.452 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T01:41:14.507 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:14.580 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:14.865 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:14.987 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:15.138 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T01:41:15.267 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:15.529 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:15.529 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:15.529 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:15.529 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:15.671 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:15.913 INFO:teuthology.orchestra.run.smithi063.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:15.913 INFO:teuthology.orchestra.run.smithi063.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:15.913 INFO:teuthology.orchestra.run.smithi063.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:15.913 INFO:teuthology.orchestra.run.smithi063.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:16.065 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:16.605 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:16.605 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:16.606 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:16.606 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:16.699 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-17T01:41:16.768 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:16.822 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-17T01:41:17.960 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.007 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.089 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-17T01:41:18.124 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.133 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.202 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:18.250 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:18.259 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:18.320 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.328 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.449 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:18.450 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T01:41:18.572 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:19.619 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:19.687 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T01:41:19.687 INFO:teuthology.orchestra.run.smithi098.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:19.703 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:19.757 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T01:41:19.758 INFO:teuthology.orchestra.run.smithi063.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:19.784 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:19.784 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:19.784 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:19.784 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:19.942 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:20.007 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:20.069 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T01:41:20.069 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:21.385 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-17T01:41:21.511 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-17T01:41:21.645 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:23.064 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-17T01:41:23.589 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T01:41:23.589 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:34.106 INFO:teuthology.orchestra.run.smithi063.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T01:41:34.106 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub' 2024-09-17T01:41:34.121 INFO:teuthology.orchestra.run.smithi063.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:34.134 INFO:teuthology.orchestra.run.smithi063.stdout:Generating grub configuration file ... 2024-09-17T01:41:34.244 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T01:41:34.245 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub' 2024-09-17T01:41:34.258 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:34.282 INFO:teuthology.orchestra.run.smithi098.stdout:Generating grub configuration file ... 2024-09-17T01:41:34.444 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:34.457 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:34.482 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T01:41:34.482 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-09-17T01:41:34.506 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:34.527 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-09-17T01:41:34.549 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:34.570 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:34.777 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:34.794 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:34.800 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:34.801 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:34.869 INFO:teuthology.orchestra.run.smithi063.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:34.874 INFO:teuthology.orchestra.run.smithi063.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:34.881 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:34.886 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:34.951 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:34.956 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:35.018 INFO:teuthology.orchestra.run.smithi063.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:35.018 INFO:teuthology.orchestra.run.smithi063.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:35.019 INFO:teuthology.orchestra.run.smithi063.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:35.056 INFO:teuthology.orchestra.run.smithi063.stdout:done 2024-09-17T01:41:35.094 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:35.100 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:35.126 INFO:teuthology.orchestra.run.smithi098.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:35.127 INFO:teuthology.orchestra.run.smithi098.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:35.127 INFO:teuthology.orchestra.run.smithi098.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:35.168 INFO:teuthology.orchestra.run.smithi098.stdout:done 2024-09-17T01:41:35.175 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:35.180 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:35.379 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-09-17T01:41:35.496 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2024-09-17T01:41:35.524 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2024-09-17T01:41:35.524 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2024-09-17T01:41:35.524 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 21 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2024-09-17T01:41:35.526 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T01:41:35.526 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:41:35.526 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:41:35.526 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T01:41:35.526 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:41:35.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get clean 2024-09-17T01:41:35.654 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 21 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:35.675 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:35.676 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2024-09-17T01:41:35.676 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T01:41:35.676 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:41:35.676 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:41:35.677 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-17T01:41:35.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:41:35.677 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2024-09-17T01:41:35.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-09-17T01:41:35.808 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-17T01:41:35.808 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:41:35.818 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:41:35.821 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:41:35.835 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:41:35.868 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:35.891 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:35.892 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:35.892 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-17T01:41:35.892 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:35.892 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:35.892 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-17T01:41:35.892 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T01:41:35.892 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:41:35.892 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:41:35.892 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-17T01:41:35.893 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:41:35.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-17T01:41:35.918 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:41:36.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-17T01:41:36.040 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:41:36.132 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:41:36.158 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:41:36.166 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:41:36.183 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:41:36.203 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:41:36.278 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:41:37.307 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:41:37.310 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:41:37.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:41:37.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:41:37.393 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:41:37.393 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:41:37.599 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-17T01:41:37.600 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-17T01:41:37.604 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:41:37.609 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-09-17T01:41:37.609 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-09-17T01:41:37.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:41:37.686 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:41:37.783 INFO:teuthology.orchestra.run.smithi098.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T01:41:37.783 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:41:37.783 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:41:37.783 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:41:37.783 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:41:37.784 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:41:37.784 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:41:37.784 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:41:37.811 INFO:teuthology.orchestra.run.smithi063.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T01:41:37.811 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:41:37.811 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:41:37.811 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:41:37.812 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:41:37.812 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:41:37.812 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:41:37.813 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:41:37.826 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:41:37.832 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2024-09-17T01:41:37.847 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2024-09-17T01:41:37.847 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2024-09-17T01:41:37.847 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2024-09-17T01:41:37.847 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 21 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:37.848 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2024-09-17T01:41:37.849 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-17T01:41:37.856 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:41:37.858 DEBUG:teuthology.orchestra.run.smithi063:> dpkg -s linux-image-generic 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Package: linux-image-generic 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Status: install ok installed 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Priority: optional 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Section: kernel 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Installed-Size: 21 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: amd64 2024-09-17T01:41:37.874 INFO:teuthology.orchestra.run.smithi063.stdout:Source: linux-meta 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout:Recommends: thermald 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:37.875 INFO:teuthology.orchestra.run.smithi063.stdout: available. 2024-09-17T01:41:37.875 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-17T01:41:37.896 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.VDmQzkrHBD 2024-09-17T01:41:37.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub/grub.cfg /tmp/tmp.VDmQzkrHBD 2024-09-17T01:41:37.899 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T01:41:37.899 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T01:41:37.922 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.rIXb2zSWpS 2024-09-17T01:41:37.922 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rIXb2zSWpS 2024-09-17T01:41:37.952 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.VDmQzkrHBD 2024-09-17T01:41:37.979 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.rIXb2zSWpS 2024-09-17T01:41:38.014 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T01:41:38.014 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-09-17T01:41:38.029 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:38.060 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-09-17T01:41:38.076 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.VDmQzkrHBD is 10KB 2024-09-17T01:41:38.089 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.VDmQzkrHBD 2024-09-17T01:41:38.093 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T01:41:38.093 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:41:38.093 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:41:38.093 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:41:38.093 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:41:38.093 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:41:38.094 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:41:38.094 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:41:38.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.117 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.rIXb2zSWpS is 10KB 2024-09-17T01:41:38.132 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.rIXb2zSWpS 2024-09-17T01:41:38.135 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:41:38.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.139 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-17T01:41:38.148 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:41:38.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.154 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:38.155 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-17T01:41:38.156 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-17T01:41:38.195 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:41:38.196 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.196 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.205 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.p22tEzS8Ey 2024-09-17T01:41:38.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.p22tEzS8Ey 2024-09-17T01:41:38.226 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T01:41:38.227 DEBUG:teuthology.orchestra.run.smithi098:> sudo update-grub 2024-09-17T01:41:38.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.p22tEzS8Ey 2024-09-17T01:41:38.269 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T01:41:38.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo update-grub 2024-09-17T01:41:38.387 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.p22tEzS8Ey is 10KB 2024-09-17T01:41:38.400 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.p22tEzS8Ey 2024-09-17T01:41:38.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.417 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:38.435 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:38.460 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:41:38.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:38.524 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T01:41:38.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-09-17T01:41:38.780 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:38.787 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:38.855 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:39.063 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:39.063 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:39.063 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:39.116 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-09-17T01:41:39.399 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub' 2024-09-17T01:41:39.400 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:39.402 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-17T01:41:39.505 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2024-09-17T01:41:39.506 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:39.509 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-17T01:41:39.591 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:39.593 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-17T01:41:39.598 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:39.613 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:39.614 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-17T01:41:39.615 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-17T01:41:39.615 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:41:39.615 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:41:39.615 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-17T01:41:39.616 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:41:39.616 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-17T01:41:39.754 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-17T01:41:39.755 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:39.761 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-09-17T01:41:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:39.797 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-17T01:41:39.837 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:39.843 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:41:39.873 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:41:39.879 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:41:39.884 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:39.890 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:39.896 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:41:39.986 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:39.991 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:40.034 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-17T01:41:40.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-17T01:41:40.055 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:40.060 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:40.101 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:40.106 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:40.228 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:40.234 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:40.257 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:40.257 INFO:teuthology.orchestra.run.smithi063.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:40.257 INFO:teuthology.orchestra.run.smithi063.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:40.268 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-17T01:41:40.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-17T01:41:40.277 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:40.282 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:40.428 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:40.429 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:40.429 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:40.445 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-17T01:41:40.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-17T01:41:41.308 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:41:41.326 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T01:41:41.380 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:41:41.572 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-17T01:41:41.573 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-17T01:41:41.743 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:41:41.744 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:41:41.785 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-17T01:41:41.786 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-17T01:41:41.846 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-17T01:41:41.846 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-17T01:41:41.846 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-17T01:41:41.846 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-17T01:41:41.846 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.122.122 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-17T01:41:41.847 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-17T01:41:41.848 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-17T01:41:41.891 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.pPBJuVuNug 2024-09-17T01:41:41.892 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.pPBJuVuNug 2024-09-17T01:41:41.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.pPBJuVuNug 2024-09-17T01:41:42.076 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.pPBJuVuNug is 10KB 2024-09-17T01:41:42.093 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.pPBJuVuNug 2024-09-17T01:41:42.098 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:42.150 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:41:42.150 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T01:41:42.150 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T01:41:42.221 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-17T01:41:42.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-09-17T01:41:43.546 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-09-17T01:41:43.547 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T01:41:43.550 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-09-17T01:41:43.792 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-17T01:41:43.798 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-17T01:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T01:41:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T01:41:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T01:41:44.141 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T01:41:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T01:41:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T01:41:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T01:41:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-09-17T01:41:44.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-09-17T01:42:10.077 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-17T01:42:10.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:42:10.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:10.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T01:42:10.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:42:10.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:10.466 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-17T01:42:10.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:42:10.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:14.295 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-17T01:42:14.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:42:14.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:28.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T01:42:28.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-17T01:42:28.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-17T01:42:32.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-17T01:42:37.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:42:37.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:37.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:42:37.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:37.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:42:37.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:40.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T01:42:40.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-17T01:42:40.989 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-17T01:42:41.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:42:41.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:44.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-17T01:42:52.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:42:52.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:52.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:42:52.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:52.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:42:52.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:42:56.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:42:56.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:43:10.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T01:43:11.169 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-17T01:43:15.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-17T01:43:25.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:43:25.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:43:26.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:43:26.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:43:26.205 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-17T01:43:26.587 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-17T01:43:26.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:43:26.742 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-122-generic"... 2024-09-17T01:43:26.743 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-17T01:43:26.788 INFO:teuthology.orchestra.run.smithi098.stdout:5.15.0-122-generic 2024-09-17T01:43:26.789 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T01:43:26.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:43:26.789 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T01:43:27.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:43:27.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-17T01:43:27.257 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-17T01:43:27.302 INFO:teuthology.orchestra.run.smithi063.stdout:5.15.0-122-generic 2024-09-17T01:43:27.302 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T01:43:27.302 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:43:27.302 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T01:43:27.790 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-17T01:43:27.791 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:43:27.865 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-17T01:43:27.894 DEBUG:teuthology.parallel:result is None 2024-09-17T01:43:28.303 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T01:43:28.303 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:43:28.388 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-09-17T01:43:28.415 DEBUG:teuthology.parallel:result is None 2024-09-17T01:43:30.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:43:30.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:43:30.591 ERROR:teuthology.orchestra.connection:Error authenticating with smithi096.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-17T01:43:34.669 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-17T01:43:35.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:43:35.617 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-122-generic"... 2024-09-17T01:43:35.617 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-17T01:43:35.663 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-122-generic 2024-09-17T01:43:35.664 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T01:43:35.664 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:43:35.664 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T01:43:36.665 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-17T01:43:36.665 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:43:36.751 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-09-17T01:43:36.781 DEBUG:teuthology.parallel:result is None 2024-09-17T01:43:52.993 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:44:07.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:44:08.292 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-17T01:44:08.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:44:08.922 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-122-generic"... 2024-09-17T01:44:08.922 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-17T01:44:08.968 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-122-generic 2024-09-17T01:44:08.968 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-17T01:44:08.968 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:44:08.968 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T01:44:09.969 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-17T01:44:09.970 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:44:10.349 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-17T01:44:10.378 DEBUG:teuthology.parallel:result is None 2024-09-17T01:44:10.378 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T01:44:10.385 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T01:44:10.386 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:44:10.388 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:44:10.391 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:44:10.393 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:44:10.399 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T01:44:10.407 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T01:44:10.419 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T01:44:10.419 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:44:10.435 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:44:10.439 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:44:10.442 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:44:10.754 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T01:44:10.760 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T01:44:10.761 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:44:10.764 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:44:10.766 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:44:10.769 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:44:10.781 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.786 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.790 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.793 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.794 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.796 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.800 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.803 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:44:10.805 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T01:44:10.812 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T01:44:10.812 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:44:10.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:44:10.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:44:10.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:44:10.890 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T01:44:10.902 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T01:44:10.902 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:44:10.904 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:44:10.907 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:44:10.933 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:44:10.939 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:44:10.954 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:44:11.002 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:44:11.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:44:11.067 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:44:11.073 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:44:11.119 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:44:11.119 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:44:11.182 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:44:11.188 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:44:11.237 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:44:11.237 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:44:11.304 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:44:11.310 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:44:11.356 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:44:11.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:44:11.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-17T01:44:11.429 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-09-17T01:44:11.431 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-17T01:44:11.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-17T01:44:11.503 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T01:44:11.512 INFO:teuthology.task.internal:Starting timer... 2024-09-17T01:44:11.512 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T01:44:11.531 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T01:44:11.546 DEBUG:teuthology.task.selinux:Excluding smithi063: OS 'ubuntu' does not support SELinux 2024-09-17T01:44:11.547 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-09-17T01:44:11.547 DEBUG:teuthology.task.selinux:Excluding smithi098: OS 'ubuntu' does not support SELinux 2024-09-17T01:44:11.547 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-09-17T01:44:11.547 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T01:44:11.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T01:44:11.547 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T01:44:11.547 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T01:44:11.563 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T01:44:11.575 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T01:44:11.576 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi096.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T01:51:50.416 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-17T01:51:50.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:51:50.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:51:50.518 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-17T01:51:50.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T01:51:50.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:51:50.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:51:50.684 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-17T01:51:50.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-17T01:51:50.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:51:50.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:51:50.843 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-17T01:51:50.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T01:51:50.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:51:50.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:51:51.002 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-17T01:51:51.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:51:51.085 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T01:51:51.095 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T01:51:51.095 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:51:51.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:51:51.098 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:51:51.099 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:51:51.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:51:51.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:51:51.103 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:51:51.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Command line: ntpd -gq 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: ---------------------------------------------------- 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: corporation. Support and training for ntp-4 are 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: available at https://www.nwtime.org/support 2024-09-17T01:51:51.127 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: ---------------------------------------------------- 2024-09-17T01:51:51.129 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: proto: precision = 0.050 usec (-24) 2024-09-17T01:51:51.129 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: basedate set to 2022-02-04 2024-09-17T01:51:51.129 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: gps base set to 2022-02-06 (week 2196) 2024-09-17T01:51:51.129 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Command line: ntpd -gq 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: ---------------------------------------------------- 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: corporation. Support and training for ntp-4 are 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: available at https://www.nwtime.org/support 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: ---------------------------------------------------- 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: proto: precision = 0.061 usec (-24) 2024-09-17T01:51:51.130 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: basedate set to 2022-02-04 2024-09-17T01:51:51.131 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: gps base set to 2022-02-06 (week 2196) 2024-09-17T01:51:51.131 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.131 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.132 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.132 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listen normally on 3 enp3s0f1 172.21.15.63:123 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listen normally on 4 lo [::1]:123 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8d7%5]:123 2024-09-17T01:51:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:51 ntpd[18458]: Listening on routing socket on fd #22 for interface updates 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listen normally on 4 lo [::1]:123 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-09-17T01:51:51.134 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:51 ntpd[18486]: Listening on routing socket on fd #22 for interface updates 2024-09-17T01:51:51.136 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T01:51:51.136 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Command line: ntpd -gq 2024-09-17T01:51:51.136 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: ---------------------------------------------------- 2024-09-17T01:51:51.136 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T01:51:51.136 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T01:51:51.136 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: corporation. Support and training for ntp-4 are 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: available at https://www.nwtime.org/support 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: ---------------------------------------------------- 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: proto: precision = 0.045 usec (-24) 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: basedate set to 2022-02-04 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: gps base set to 2022-02-06 (week 2196) 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.137 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.138 INFO:teuthology.orchestra.run.smithi098.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listen normally on 3 enp3s0f1 172.21.15.98:123 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listen normally on 4 lo [::1]:123 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d26b%5]:123 2024-09-17T01:51:51.139 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:51 ntpd[18491]: Listening on routing socket on fd #22 for interface updates 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Command line: ntpd -gq 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: ---------------------------------------------------- 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: corporation. Support and training for ntp-4 are 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: available at https://www.nwtime.org/support 2024-09-17T01:51:51.157 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: ---------------------------------------------------- 2024-09-17T01:51:51.158 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: proto: precision = 0.058 usec (-24) 2024-09-17T01:51:51.158 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: basedate set to 2022-02-04 2024-09-17T01:51:51.158 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: gps base set to 2022-02-06 (week 2196) 2024-09-17T01:51:51.158 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.159 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T01:51:51.159 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.159 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listen normally on 4 lo [::1]:123 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-09-17T01:51:51.160 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:51 ntpd[18527]: Listening on routing socket on fd #22 for interface updates 2024-09-17T01:51:52.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:52 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:52 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:52 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:52 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:52 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:52.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:52 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:52 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:52 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:52 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:52 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:52 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:52.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:52 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:52.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:52 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:53 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:53 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:53 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:53 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:53 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:53 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:53.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:53 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:53.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:53 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:54 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:54 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:54 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:54 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:54 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:54 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:54.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:54 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:54 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:54 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:54 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:54 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:54 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:54.132 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:54 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:54.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:54.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:54 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:55 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:55.129 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:55.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:55 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:55.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:55.159 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:55.159 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:55 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:56 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:56 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.133 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.133 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:56 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:56.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:56 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:56 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:56 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:56 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:56 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:56 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:57.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:57 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.314 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:57 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.315 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:57 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.315 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:57 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.315 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:57 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:57.315 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:57 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:57 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:57 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.128 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stdout:17 Sep 01:51:58 ntpd[18458]: ntpd: time slew -0.003629 s 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stdout:ntpd: time slew -0.003629s 2024-09-17T01:51:58.129 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T01:51:58.130 INFO:teuthology.orchestra.run.smithi063.stderr:17 Sep 01:51:58 ntpd[18458]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T01:51:58.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.130 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stdout:17 Sep 01:51:58 ntpd[18486]: ntpd: time slew +0.002267 s 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew +0.002267s 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T01:51:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:17 Sep 01:51:58 ntpd[18486]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T01:51:58.133 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.134 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stdout:17 Sep 01:51:58 ntpd[18491]: ntpd: time slew -0.002530 s 2024-09-17T01:51:58.135 INFO:teuthology.orchestra.run.smithi098.stdout:ntpd: time slew -0.002530s 2024-09-17T01:51:58.136 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T01:51:58.136 INFO:teuthology.orchestra.run.smithi098.stderr:17 Sep 01:51:58 ntpd[18491]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T01:51:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:58 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:58 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:58 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:58.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:58 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:58.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:58 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:58.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:58 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:58.175 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T01:51:58.176 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-17T01:51:58.176 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.176 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.176 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.176 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T01:51:58.180 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2024-09-17T01:51:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.180 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.184 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T01:51:58.184 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-09-17T01:51:58.184 INFO:teuthology.orchestra.run.smithi063.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.184 INFO:teuthology.orchestra.run.smithi063.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.184 INFO:teuthology.orchestra.run.smithi063.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:58.184 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:59.157 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T01:51:59.158 INFO:teuthology.orchestra.run.smithi154.stdout:17 Sep 01:51:59 ntpd[18527]: ntpd: time slew +0.002567 s 2024-09-17T01:51:59.159 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew +0.002567s 2024-09-17T01:51:59.159 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T01:51:59.159 INFO:teuthology.orchestra.run.smithi154.stderr:17 Sep 01:51:59 ntpd[18527]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T01:51:59.214 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T01:51:59.214 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-17T01:51:59.215 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:59.215 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:59.215 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:59.215 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T01:51:59.216 INFO:teuthology.run_tasks:Running task install... 2024-09-17T01:51:59.224 DEBUG:teuthology.task.install:project ceph 2024-09-17T01:51:59.224 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-17T01:51:59.224 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T01:51:59.224 INFO:teuthology.task.install:Using flavor: default 2024-09-17T01:51:59.230 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T01:51:59.230 INFO:teuthology.task.install:extra packages: [] 2024-09-17T01:51:59.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-key list | grep Ceph 2024-09-17T01:51:59.231 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-09-17T01:51:59.232 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-key list | grep Ceph 2024-09-17T01:51:59.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-09-17T01:51:59.296 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T01:51:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T01:51:59.298 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T01:51:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T01:51:59.323 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T01:51:59.323 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T01:51:59.324 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T01:51:59.324 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T01:51:59.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:51:59.330 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T01:51:59.331 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T01:51:59.331 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T01:51:59.331 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T01:51:59.331 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T01:51:59.331 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T01:51:59.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:51:59.332 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T01:51:59.332 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T01:51:59.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:51:59.343 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T01:51:59.343 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T01:51:59.344 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T01:51:59.344 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-17T01:51:59.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:51:59.475 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T01:51:59.475 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:51:59.478 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T01:51:59.478 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:51:59.483 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T01:51:59.484 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:51:59.494 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default/ 2024-09-17T01:51:59.494 INFO:teuthology.task.install.deb:Package version is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:51:59.590 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:51:59.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T01:51:59.593 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:51:59.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T01:51:59.604 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:51:59.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T01:51:59.608 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-09-17T01:51:59.608 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-17T01:51:59.610 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:51:59.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T01:51:59.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-17T01:51:59.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-17T01:51:59.831 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T01:51:59.834 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T01:51:59.842 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T01:51:59.847 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T01:51:59.853 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T01:51:59.856 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T01:51:59.863 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T01:51:59.869 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-17T01:51:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T01:51:59.879 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T01:51:59.886 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T01:51:59.892 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T01:51:59.907 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:51:59.907 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:51:59.907 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T01:51:59.910 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:51:59.910 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:51:59.910 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T01:51:59.917 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:51:59.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T01:51:59.922 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T01:51:59.922 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:51:59.923 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T01:51:59.926 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T01:51:59.936 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T01:51:59.939 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T01:51:59.947 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-09-17T01:51:59.952 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-17T01:51:59.979 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:51:59.981 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:51:59.989 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:51:59.994 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T01:52:00.061 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:52:00.063 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:52:00.071 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:52:00.076 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T01:52:00.258 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 28.9 kB in 0s (61.3 kB/s) 2024-09-17T01:52:00.272 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 28.9 kB in 0s (60.8 kB/s) 2024-09-17T01:52:00.295 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.9 kB in 0s (59.2 kB/s) 2024-09-17T01:52:00.311 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 28.9 kB in 1s (56.4 kB/s) 2024-09-17T01:52:01.247 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:52:01.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:52:01.289 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:52:01.305 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:52:01.319 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:52:01.324 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:52:01.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:52:01.353 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:52:01.366 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:52:01.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-330-gc2ddf972-1jammy cephadm=19.1.1-330-gc2ddf972-1jammy ceph-mds=19.1.1-330-gc2ddf972-1jammy ceph-mgr=19.1.1-330-gc2ddf972-1jammy ceph-common=19.1.1-330-gc2ddf972-1jammy ceph-fuse=19.1.1-330-gc2ddf972-1jammy ceph-test=19.1.1-330-gc2ddf972-1jammy ceph-volume=19.1.1-330-gc2ddf972-1jammy radosgw=19.1.1-330-gc2ddf972-1jammy python3-rados=19.1.1-330-gc2ddf972-1jammy python3-rgw=19.1.1-330-gc2ddf972-1jammy python3-cephfs=19.1.1-330-gc2ddf972-1jammy python3-rbd=19.1.1-330-gc2ddf972-1jammy libcephfs2=19.1.1-330-gc2ddf972-1jammy libcephfs-dev=19.1.1-330-gc2ddf972-1jammy librados2=19.1.1-330-gc2ddf972-1jammy librbd1=19.1.1-330-gc2ddf972-1jammy rbd-fuse=19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:52:01.405 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:52:01.427 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:52:01.506 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-17T01:52:01.506 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-17T01:52:01.577 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-17T01:52:01.578 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-17T01:52:01.618 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-09-17T01:52:01.619 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-09-17T01:52:01.626 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T01:52:01.627 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T01:52:01.690 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:52:01.690 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:52:01.690 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:52:01.690 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:52:01.691 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:52:01.691 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:52:01.691 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:52:01.691 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-17T01:52:01.691 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T01:52:01.692 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T01:52:01.692 INFO:teuthology.orchestra.run.smithi098.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T01:52:01.692 INFO:teuthology.orchestra.run.smithi098.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet zip 2024-09-17T01:52:01.694 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2024-09-17T01:52:01.695 INFO:teuthology.orchestra.run.smithi098.stdout: btrfs-tools 2024-09-17T01:52:01.774 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:52:01.774 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:52:01.774 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:52:01.774 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:52:01.774 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:52:01.775 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:52:01.775 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:52:01.775 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-17T01:52:01.776 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T01:52:01.776 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T01:52:01.776 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T01:52:01.776 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.777 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet zip 2024-09-17T01:52:01.778 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-17T01:52:01.779 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T01:52:01.795 INFO:teuthology.orchestra.run.smithi098.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T01:52:01.796 INFO:teuthology.orchestra.run.smithi098.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T01:52:01.796 INFO:teuthology.orchestra.run.smithi098.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T01:52:01.796 INFO:teuthology.orchestra.run.smithi098.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T01:52:01.796 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T01:52:01.797 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T01:52:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T01:52:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T01:52:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T01:52:01.798 INFO:teuthology.orchestra.run.smithi098.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T01:52:01.812 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:52:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:52:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:52:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:52:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:52:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:52:01.813 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:52:01.814 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-09-17T01:52:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T01:52:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T01:52:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T01:52:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T01:52:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T01:52:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T01:52:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet zip 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T01:52:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T01:52:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T01:52:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T01:52:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T01:52:01.818 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2024-09-17T01:52:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: btrfs-tools 2024-09-17T01:52:01.829 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:52:01.829 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:52:01.829 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:52:01.829 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:52:01.829 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:52:01.830 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:52:01.830 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:52:01.830 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-17T01:52:01.830 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T01:52:01.831 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T01:52:01.831 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-17T01:52:01.831 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-17T01:52:01.833 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet zip 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-17T01:52:01.834 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-09-17T01:52:01.857 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T01:52:01.857 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 181 MB of archives. 2024-09-17T01:52:01.858 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T01:52:01.858 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T01:52:01.880 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-17T01:52:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T01:52:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T01:52:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T01:52:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T01:52:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T01:52:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T01:52:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T01:52:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T01:52:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T01:52:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T01:52:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T01:52:01.923 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-09-17T01:52:01.923 INFO:teuthology.orchestra.run.smithi063.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T01:52:01.923 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T01:52:01.923 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T01:52:01.923 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T01:52:01.923 INFO:teuthology.orchestra.run.smithi063.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T01:52:01.924 INFO:teuthology.orchestra.run.smithi063.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.925 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T01:52:01.926 INFO:teuthology.orchestra.run.smithi063.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T01:52:01.935 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-17T01:52:01.935 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T01:52:01.935 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T01:52:01.936 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-17T01:52:01.936 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-17T01:52:01.936 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T01:52:01.936 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-17T01:52:01.936 INFO:teuthology.orchestra.run.smithi154.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-17T01:52:01.937 INFO:teuthology.orchestra.run.smithi154.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-17T01:52:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-17T01:52:01.939 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-17T01:52:01.939 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-17T01:52:01.939 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-17T01:52:01.939 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-17T01:52:01.940 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T01:52:01.942 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T01:52:01.943 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 181 MB of archives. 2024-09-17T01:52:01.943 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T01:52:01.943 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T01:52:01.945 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T01:52:01.947 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T01:52:01.965 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T01:52:01.985 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T01:52:01.985 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 181 MB of archives. 2024-09-17T01:52:01.985 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T01:52:01.985 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T01:52:02.000 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-17T01:52:02.000 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 181 MB of archives. 2024-09-17T01:52:02.000 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-17T01:52:02.000 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T01:52:02.025 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T01:52:02.026 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T01:52:02.030 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T01:52:02.031 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T01:52:02.034 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T01:52:02.043 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T01:52:02.047 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T01:52:02.047 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T01:52:02.048 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T01:52:02.051 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T01:52:02.057 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T01:52:02.059 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T01:52:02.061 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T01:52:02.062 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T01:52:02.065 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T01:52:02.067 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T01:52:02.068 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T01:52:02.076 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T01:52:02.079 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T01:52:02.079 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-330-gc2ddf972-1jammy [3,591 kB] 2024-09-17T01:52:02.080 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T01:52:02.082 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T01:52:02.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T01:52:02.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T01:52:02.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T01:52:02.085 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T01:52:02.086 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T01:52:02.086 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T01:52:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T01:52:02.094 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T01:52:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T01:52:02.099 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T01:52:02.099 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T01:52:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T01:52:02.112 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T01:52:02.115 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T01:52:02.116 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T01:52:02.118 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T01:52:02.119 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T01:52:02.119 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T01:52:02.119 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T01:52:02.121 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T01:52:02.121 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T01:52:02.121 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T01:52:02.127 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T01:52:02.131 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T01:52:02.132 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T01:52:02.133 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T01:52:02.133 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T01:52:02.134 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T01:52:02.140 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T01:52:02.141 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T01:52:02.143 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T01:52:02.145 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T01:52:02.147 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T01:52:02.148 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T01:52:02.151 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T01:52:02.151 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T01:52:02.155 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T01:52:02.156 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T01:52:02.156 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T01:52:02.157 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T01:52:02.157 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T01:52:02.158 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T01:52:02.160 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T01:52:02.160 INFO:teuthology.orchestra.run.smithi098.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T01:52:02.161 INFO:teuthology.orchestra.run.smithi098.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T01:52:02.164 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T01:52:02.166 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T01:52:02.167 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T01:52:02.167 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T01:52:02.168 INFO:teuthology.orchestra.run.smithi098.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T01:52:02.169 INFO:teuthology.orchestra.run.smithi098.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T01:52:02.170 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T01:52:02.170 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T01:52:02.170 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T01:52:02.170 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T01:52:02.171 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T01:52:02.173 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T01:52:02.175 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T01:52:02.177 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T01:52:02.178 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T01:52:02.178 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T01:52:02.183 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T01:52:02.183 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T01:52:02.184 INFO:teuthology.orchestra.run.smithi098.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T01:52:02.185 INFO:teuthology.orchestra.run.smithi098.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T01:52:02.186 INFO:teuthology.orchestra.run.smithi098.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T01:52:02.187 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T01:52:02.187 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T01:52:02.188 INFO:teuthology.orchestra.run.smithi098.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T01:52:02.189 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T01:52:02.191 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T01:52:02.192 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T01:52:02.192 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T01:52:02.193 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T01:52:02.193 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T01:52:02.194 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T01:52:02.197 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T01:52:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T01:52:02.201 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T01:52:02.202 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T01:52:02.203 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T01:52:02.203 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T01:52:02.204 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T01:52:02.204 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T01:52:02.204 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T01:52:02.205 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T01:52:02.205 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T01:52:02.206 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T01:52:02.207 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T01:52:02.211 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T01:52:02.211 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T01:52:02.213 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T01:52:02.213 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T01:52:02.214 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T01:52:02.214 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T01:52:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T01:52:02.216 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T01:52:02.217 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T01:52:02.217 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T01:52:02.217 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T01:52:02.218 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T01:52:02.218 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T01:52:02.228 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T01:52:02.229 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T01:52:02.229 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T01:52:02.230 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T01:52:02.230 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T01:52:02.232 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T01:52:02.232 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T01:52:02.232 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T01:52:02.232 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T01:52:02.234 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T01:52:02.240 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T01:52:02.240 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T01:52:02.241 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T01:52:02.241 INFO:teuthology.orchestra.run.smithi098.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T01:52:02.242 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T01:52:02.242 INFO:teuthology.orchestra.run.smithi098.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T01:52:02.243 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T01:52:02.243 INFO:teuthology.orchestra.run.smithi098.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T01:52:02.243 INFO:teuthology.orchestra.run.smithi098.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T01:52:02.244 INFO:teuthology.orchestra.run.smithi098.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T01:52:02.245 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T01:52:02.245 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T01:52:02.246 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T01:52:02.246 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T01:52:02.246 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T01:52:02.246 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T01:52:02.249 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T01:52:02.250 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T01:52:02.250 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T01:52:02.251 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T01:52:02.251 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T01:52:02.252 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T01:52:02.252 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T01:52:02.253 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T01:52:02.253 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T01:52:02.261 INFO:teuthology.orchestra.run.smithi098.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T01:52:02.262 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T01:52:02.263 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T01:52:02.263 INFO:teuthology.orchestra.run.smithi098.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T01:52:02.264 INFO:teuthology.orchestra.run.smithi098.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T01:52:02.264 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T01:52:02.264 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T01:52:02.264 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T01:52:02.265 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T01:52:02.265 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T01:52:02.265 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T01:52:02.266 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T01:52:02.268 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T01:52:02.269 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T01:52:02.271 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T01:52:02.273 INFO:teuthology.orchestra.run.smithi098.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T01:52:02.276 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T01:52:02.278 INFO:teuthology.orchestra.run.smithi098.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T01:52:02.278 INFO:teuthology.orchestra.run.smithi098.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T01:52:02.278 INFO:teuthology.orchestra.run.smithi098.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T01:52:02.279 INFO:teuthology.orchestra.run.smithi098.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T01:52:02.279 INFO:teuthology.orchestra.run.smithi098.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T01:52:02.280 INFO:teuthology.orchestra.run.smithi098.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T01:52:02.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T01:52:02.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T01:52:02.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T01:52:02.281 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T01:52:02.285 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T01:52:02.287 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T01:52:02.287 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T01:52:02.288 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T01:52:02.288 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T01:52:02.290 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T01:52:02.292 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T01:52:02.293 INFO:teuthology.orchestra.run.smithi063.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T01:52:02.294 INFO:teuthology.orchestra.run.smithi098.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T01:52:02.294 INFO:teuthology.orchestra.run.smithi098.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T01:52:02.296 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T01:52:02.296 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T01:52:02.297 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T01:52:02.297 INFO:teuthology.orchestra.run.smithi098.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T01:52:02.298 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T01:52:02.298 INFO:teuthology.orchestra.run.smithi063.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T01:52:02.299 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T01:52:02.299 INFO:teuthology.orchestra.run.smithi063.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T01:52:02.301 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T01:52:02.301 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T01:52:02.311 INFO:teuthology.orchestra.run.smithi098.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T01:52:02.312 INFO:teuthology.orchestra.run.smithi098.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T01:52:02.312 INFO:teuthology.orchestra.run.smithi098.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T01:52:02.313 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T01:52:02.314 INFO:teuthology.orchestra.run.smithi098.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T01:52:02.314 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T01:52:02.315 INFO:teuthology.orchestra.run.smithi063.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T01:52:02.316 INFO:teuthology.orchestra.run.smithi098.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T01:52:02.316 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T01:52:02.317 INFO:teuthology.orchestra.run.smithi063.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T01:52:02.318 INFO:teuthology.orchestra.run.smithi063.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T01:52:02.318 INFO:teuthology.orchestra.run.smithi098.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T01:52:02.319 INFO:teuthology.orchestra.run.smithi098.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T01:52:02.319 INFO:teuthology.orchestra.run.smithi098.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T01:52:02.321 INFO:teuthology.orchestra.run.smithi063.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T01:52:02.324 INFO:teuthology.orchestra.run.smithi098.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T01:52:02.326 INFO:teuthology.orchestra.run.smithi098.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T01:52:02.328 INFO:teuthology.orchestra.run.smithi098.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T01:52:02.328 INFO:teuthology.orchestra.run.smithi098.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T01:52:02.331 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T01:52:02.331 INFO:teuthology.orchestra.run.smithi098.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T01:52:02.331 INFO:teuthology.orchestra.run.smithi098.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T01:52:02.332 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T01:52:02.334 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T01:52:02.342 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T01:52:02.343 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T01:52:02.344 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T01:52:02.345 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T01:52:02.345 INFO:teuthology.orchestra.run.smithi098.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T01:52:02.346 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T01:52:02.346 INFO:teuthology.orchestra.run.smithi098.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T01:52:02.346 INFO:teuthology.orchestra.run.smithi098.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T01:52:02.348 INFO:teuthology.orchestra.run.smithi098.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T01:52:02.349 INFO:teuthology.orchestra.run.smithi098.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T01:52:02.354 INFO:teuthology.orchestra.run.smithi098.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T01:52:02.355 INFO:teuthology.orchestra.run.smithi098.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T01:52:02.357 INFO:teuthology.orchestra.run.smithi098.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T01:52:02.363 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T01:52:02.363 INFO:teuthology.orchestra.run.smithi098.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T01:52:02.364 INFO:teuthology.orchestra.run.smithi098.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T01:52:02.365 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T01:52:02.365 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T01:52:02.366 INFO:teuthology.orchestra.run.smithi098.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T01:52:02.366 INFO:teuthology.orchestra.run.smithi098.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T01:52:02.378 INFO:teuthology.orchestra.run.smithi063.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T01:52:02.379 INFO:teuthology.orchestra.run.smithi063.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T01:52:02.380 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T01:52:02.380 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T01:52:02.380 INFO:teuthology.orchestra.run.smithi063.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T01:52:02.381 INFO:teuthology.orchestra.run.smithi063.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T01:52:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T01:52:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T01:52:02.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T01:52:02.382 INFO:teuthology.orchestra.run.smithi063.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T01:52:02.382 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T01:52:02.388 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T01:52:02.389 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T01:52:02.390 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T01:52:02.390 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T01:52:02.391 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T01:52:02.398 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T01:52:02.398 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T01:52:02.399 INFO:teuthology.orchestra.run.smithi063.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T01:52:02.401 INFO:teuthology.orchestra.run.smithi063.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T01:52:02.401 INFO:teuthology.orchestra.run.smithi063.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T01:52:02.402 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T01:52:02.403 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T01:52:02.404 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T01:52:02.405 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T01:52:02.408 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T01:52:02.410 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T01:52:02.410 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T01:52:02.415 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T01:52:02.416 INFO:teuthology.orchestra.run.smithi063.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T01:52:02.416 INFO:teuthology.orchestra.run.smithi063.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T01:52:02.416 INFO:teuthology.orchestra.run.smithi063.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T01:52:02.417 INFO:teuthology.orchestra.run.smithi063.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T01:52:02.417 INFO:teuthology.orchestra.run.smithi063.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T01:52:02.417 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T01:52:02.418 INFO:teuthology.orchestra.run.smithi063.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T01:52:02.418 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T01:52:02.418 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T01:52:02.426 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T01:52:02.426 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T01:52:02.426 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T01:52:02.432 INFO:teuthology.orchestra.run.smithi063.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T01:52:02.432 INFO:teuthology.orchestra.run.smithi063.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T01:52:02.433 INFO:teuthology.orchestra.run.smithi063.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T01:52:02.433 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T01:52:02.433 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T01:52:02.436 INFO:teuthology.orchestra.run.smithi063.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T01:52:02.436 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T01:52:02.436 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T01:52:02.436 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T01:52:02.437 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T01:52:02.449 INFO:teuthology.orchestra.run.smithi063.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T01:52:02.450 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T01:52:02.450 INFO:teuthology.orchestra.run.smithi063.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T01:52:02.450 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T01:52:02.451 INFO:teuthology.orchestra.run.smithi063.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T01:52:02.451 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T01:52:02.453 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T01:52:02.454 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T01:52:02.454 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T01:52:02.454 INFO:teuthology.orchestra.run.smithi063.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T01:52:02.455 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T01:52:02.455 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T01:52:02.456 INFO:teuthology.orchestra.run.smithi063.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T01:52:02.457 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T01:52:02.457 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T01:52:02.458 INFO:teuthology.orchestra.run.smithi063.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T01:52:02.458 INFO:teuthology.orchestra.run.smithi063.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T01:52:02.459 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T01:52:02.459 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T01:52:02.461 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T01:52:02.466 INFO:teuthology.orchestra.run.smithi063.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T01:52:02.467 INFO:teuthology.orchestra.run.smithi063.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T01:52:02.468 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T01:52:02.470 INFO:teuthology.orchestra.run.smithi063.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T01:52:02.470 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T01:52:02.470 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T01:52:02.473 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-330-gc2ddf972-1jammy [3,242 kB] 2024-09-17T01:52:02.475 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T01:52:02.478 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T01:52:02.480 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T01:52:02.481 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T01:52:02.482 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T01:52:02.483 INFO:teuthology.orchestra.run.smithi063.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T01:52:02.484 INFO:teuthology.orchestra.run.smithi063.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T01:52:02.484 INFO:teuthology.orchestra.run.smithi063.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T01:52:02.485 INFO:teuthology.orchestra.run.smithi063.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T01:52:02.486 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T01:52:02.486 INFO:teuthology.orchestra.run.smithi063.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T01:52:02.492 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T01:52:02.492 INFO:teuthology.orchestra.run.smithi063.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T01:52:02.493 INFO:teuthology.orchestra.run.smithi063.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T01:52:02.495 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T01:52:02.495 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T01:52:02.495 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T01:52:02.503 INFO:teuthology.orchestra.run.smithi063.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T01:52:02.504 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T01:52:02.505 INFO:teuthology.orchestra.run.smithi063.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T01:52:02.506 INFO:teuthology.orchestra.run.smithi063.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T01:52:02.511 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T01:52:02.511 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T01:52:02.512 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T01:52:02.513 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T01:52:02.513 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T01:52:02.516 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T01:52:02.519 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T01:52:02.519 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T01:52:02.519 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T01:52:02.529 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T01:52:02.529 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T01:52:02.545 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T01:52:02.557 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T01:52:02.685 INFO:teuthology.orchestra.run.smithi063.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T01:52:02.712 INFO:teuthology.orchestra.run.smithi098.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T01:52:02.715 INFO:teuthology.orchestra.run.smithi098.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T01:52:02.724 INFO:teuthology.orchestra.run.smithi098.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T01:52:02.741 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-330-gc2ddf972-1jammy [719 kB] 2024-09-17T01:52:02.749 INFO:teuthology.orchestra.run.smithi063.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T01:52:02.759 INFO:teuthology.orchestra.run.smithi063.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T01:52:02.760 INFO:teuthology.orchestra.run.smithi063.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T01:52:02.764 INFO:teuthology.orchestra.run.smithi063.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T01:52:02.766 INFO:teuthology.orchestra.run.smithi063.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T01:52:02.812 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-330-gc2ddf972-1jammy [356 kB] 2024-09-17T01:52:02.820 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-330-gc2ddf972-1jammy [32.8 kB] 2024-09-17T01:52:02.821 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-330-gc2ddf972-1jammy [180 kB] 2024-09-17T01:52:02.827 INFO:teuthology.orchestra.run.smithi063.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T01:52:02.880 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-330-gc2ddf972-1jammy [67.8 kB] 2024-09-17T01:52:02.884 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-330-gc2ddf972-1jammy [333 kB] 2024-09-17T01:52:02.891 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-330-gc2ddf972-1jammy [6,875 kB] 2024-09-17T01:52:02.967 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T01:52:03.056 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T01:52:03.080 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T01:52:03.303 INFO:teuthology.orchestra.run.smithi063.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T01:52:03.305 INFO:teuthology.orchestra.run.smithi063.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T01:52:03.354 INFO:teuthology.orchestra.run.smithi063.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T01:52:03.513 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-330-gc2ddf972-1jammy [112 kB] 2024-09-17T01:52:03.516 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-330-gc2ddf972-1jammy [472 kB] 2024-09-17T01:52:03.566 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-330-gc2ddf972-1jammy [25.9 MB] 2024-09-17T01:52:04.198 INFO:teuthology.orchestra.run.smithi098.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T01:52:04.419 INFO:teuthology.orchestra.run.smithi098.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T01:52:04.451 INFO:teuthology.orchestra.run.smithi098.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T01:52:04.454 INFO:teuthology.orchestra.run.smithi098.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T01:52:04.527 INFO:teuthology.orchestra.run.smithi098.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T01:52:04.593 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T01:52:04.796 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T01:52:04.835 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T01:52:04.837 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T01:52:04.853 INFO:teuthology.orchestra.run.smithi098.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T01:52:04.924 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T01:52:05.278 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T01:52:05.311 INFO:teuthology.orchestra.run.smithi063.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T01:52:05.608 INFO:teuthology.orchestra.run.smithi063.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T01:52:05.613 INFO:teuthology.orchestra.run.smithi063.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T01:52:05.666 INFO:teuthology.orchestra.run.smithi063.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T01:52:05.752 INFO:teuthology.orchestra.run.smithi063.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T01:52:05.837 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-330-gc2ddf972-1jammy [5,145 kB] 2024-09-17T01:52:06.178 INFO:teuthology.orchestra.run.smithi098.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T01:52:06.179 INFO:teuthology.orchestra.run.smithi098.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T01:52:06.189 INFO:teuthology.orchestra.run.smithi063.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T01:52:06.195 INFO:teuthology.orchestra.run.smithi098.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T01:52:06.212 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-330-gc2ddf972-1jammy [245 kB] 2024-09-17T01:52:06.217 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-330-gc2ddf972-1jammy [124 kB] 2024-09-17T01:52:06.220 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-330-gc2ddf972-1jammy [1,555 kB] 2024-09-17T01:52:06.255 INFO:teuthology.orchestra.run.smithi098.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T01:52:06.319 INFO:teuthology.orchestra.run.smithi098.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T01:52:06.322 INFO:teuthology.orchestra.run.smithi098.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T01:52:06.369 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-330-gc2ddf972-1jammy [6,143 kB] 2024-09-17T01:52:06.437 INFO:teuthology.orchestra.run.smithi098.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T01:52:06.709 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T01:52:06.709 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T01:52:06.726 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T01:52:06.802 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T01:52:06.863 INFO:teuthology.orchestra.run.smithi098.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T01:52:06.863 INFO:teuthology.orchestra.run.smithi098.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T01:52:06.870 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T01:52:06.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T01:52:06.904 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-330-gc2ddf972-1jammy [22.8 MB] 2024-09-17T01:52:06.996 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T01:52:07.537 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T01:52:07.537 INFO:teuthology.orchestra.run.smithi096.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T01:52:07.911 INFO:teuthology.orchestra.run.smithi063.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T01:52:07.912 INFO:teuthology.orchestra.run.smithi063.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T01:52:07.929 INFO:teuthology.orchestra.run.smithi063.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T01:52:08.069 INFO:teuthology.orchestra.run.smithi063.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T01:52:08.121 INFO:teuthology.orchestra.run.smithi063.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T01:52:08.124 INFO:teuthology.orchestra.run.smithi063.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T01:52:08.282 INFO:teuthology.orchestra.run.smithi063.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T01:52:08.850 INFO:teuthology.orchestra.run.smithi063.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T01:52:08.894 INFO:teuthology.orchestra.run.smithi063.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T01:52:09.276 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-330-gc2ddf972-1jammy [14.1 kB] 2024-09-17T01:52:09.276 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-330-gc2ddf972-1jammy [877 kB] 2024-09-17T01:52:09.296 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-330-gc2ddf972-1jammy [2,462 kB] 2024-09-17T01:52:09.519 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-330-gc2ddf972-1jammy [794 kB] 2024-09-17T01:52:09.519 INFO:teuthology.orchestra.run.smithi098.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T01:52:09.521 INFO:teuthology.orchestra.run.smithi098.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T01:52:09.522 INFO:teuthology.orchestra.run.smithi098.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T01:52:09.568 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-330-gc2ddf972-1jammy [152 kB] 2024-09-17T01:52:09.571 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-330-gc2ddf972-1jammy [2,275 kB] 2024-09-17T01:52:09.808 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-330-gc2ddf972-1jammy [8,625 kB] 2024-09-17T01:52:10.009 INFO:teuthology.orchestra.run.smithi098.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T01:52:10.452 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-330-gc2ddf972-1jammy [14.2 kB] 2024-09-17T01:52:10.453 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-330-gc2ddf972-1jammy [51.4 MB] 2024-09-17T01:52:10.541 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 181 MB in 8s (22.1 MB/s) 2024-09-17T01:52:10.711 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T01:52:10.811 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T01:52:10.817 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T01:52:10.901 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:52:10.924 INFO:teuthology.orchestra.run.smithi096.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T01:52:10.927 INFO:teuthology.orchestra.run.smithi096.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T01:52:10.928 INFO:teuthology.orchestra.run.smithi096.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T01:52:11.238 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T01:52:11.264 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T01:52:11.305 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:52:11.386 INFO:teuthology.orchestra.run.smithi096.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T01:52:11.628 INFO:teuthology.orchestra.run.smithi063.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T01:52:11.631 INFO:teuthology.orchestra.run.smithi063.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T01:52:11.632 INFO:teuthology.orchestra.run.smithi063.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T01:52:11.633 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T01:52:11.659 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T01:52:11.700 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:52:11.921 INFO:teuthology.orchestra.run.smithi063.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T01:52:11.953 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 181 MB in 9s (19.1 MB/s) 2024-09-17T01:52:12.070 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T01:52:12.096 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:12.110 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T01:52:12.136 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:12.211 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T01:52:12.217 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T01:52:12.301 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:52:12.523 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 181 MB in 10s (18.1 MB/s) 2024-09-17T01:52:12.540 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T01:52:12.566 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:12.606 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:12.637 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T01:52:12.664 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T01:52:12.670 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-330-gc2ddf972-1jammy [130 kB] 2024-09-17T01:52:12.673 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-330-gc2ddf972-1jammy [39.0 kB] 2024-09-17T01:52:12.674 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-330-gc2ddf972-1jammy [13.6 MB] 2024-09-17T01:52:12.685 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T01:52:12.703 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:52:12.788 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T01:52:12.794 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T01:52:12.883 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:52:12.968 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T01:52:12.974 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-330-gc2ddf972-1jammy [91.4 kB] 2024-09-17T01:52:12.995 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:13.035 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:13.049 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T01:52:13.075 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T01:52:13.149 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:52:13.178 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T01:52:13.205 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T01:52:13.237 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:52:13.540 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T01:52:13.543 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T01:52:13.549 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 181 MB in 11s (16.4 MB/s) 2024-09-17T01:52:13.566 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T01:52:13.570 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:13.580 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T01:52:13.606 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T01:52:13.606 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:52:13.614 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:13.646 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:52:13.664 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T01:52:13.722 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-17T01:52:13.727 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T01:52:13.797 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:52:13.966 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librados2. 2024-09-17T01:52:13.993 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:14.033 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:14.143 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T01:52:14.169 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T01:52:14.209 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:52:14.268 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T01:52:14.294 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:14.296 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T01:52:14.323 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:14.343 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:14.363 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:14.502 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librbd1. 2024-09-17T01:52:14.512 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T01:52:14.529 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:14.538 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T01:52:14.568 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:14.570 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:52:14.716 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T01:52:14.720 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T01:52:14.736 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:14.743 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:14.770 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:14.783 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:14.963 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T01:52:14.989 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:14.999 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T01:52:15.026 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:15.030 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:15.073 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T01:52:15.082 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:15.100 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:15.111 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T01:52:15.131 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:15.137 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T01:52:15.177 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:52:15.299 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rados. 2024-09-17T01:52:15.314 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:15.358 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:15.438 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-09-17T01:52:15.453 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:15.459 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T01:52:15.486 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T01:52:15.488 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:15.494 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T01:52:15.520 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:15.526 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:52:15.560 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:15.685 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T01:52:15.711 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:15.752 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:15.845 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librados2. 2024-09-17T01:52:15.872 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T01:52:15.872 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:15.898 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T01:52:15.912 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:15.930 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:52:15.949 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-09-17T01:52:15.976 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.004 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T01:52:16.016 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.031 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.071 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.292 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T01:52:16.318 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T01:52:16.358 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:52:16.373 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librbd1. 2024-09-17T01:52:16.383 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T01:52:16.400 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.409 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:16.440 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.441 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.469 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T01:52:16.495 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.535 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.686 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-09-17T01:52:16.712 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librados2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.727 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T01:52:16.753 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.753 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T01:52:16.794 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:52:16.813 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-09-17T01:52:16.839 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.859 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T01:52:16.871 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:16.886 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:16.917 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.138 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T01:52:17.157 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T01:52:17.165 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T01:52:17.178 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rados. 2024-09-17T01:52:17.180 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-09-17T01:52:17.183 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:17.194 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:17.205 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T01:52:17.206 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-librbd1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:17.223 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.236 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.238 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.449 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T01:52:17.465 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:17.476 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T01:52:17.502 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:17.508 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.542 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.572 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T01:52:17.599 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:17.639 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.641 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T01:52:17.657 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:17.700 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.837 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T01:52:17.844 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T01:52:17.864 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:17.870 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T01:52:17.891 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T01:52:17.902 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:52:17.903 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.907 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:17.949 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:17.986 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-09-17T01:52:18.001 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-python3-rados_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:18.044 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:18.163 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T01:52:18.178 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T01:52:18.206 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T01:52:18.221 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:52:18.233 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T01:52:18.260 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T01:52:18.273 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:52:18.287 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:18.326 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:18.372 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T01:52:18.398 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:18.438 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:18.541 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T01:52:18.568 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T01:52:18.576 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T01:52:18.602 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T01:52:18.642 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T01:52:18.646 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T01:52:18.647 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:52:18.666 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T01:52:18.673 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T01:52:18.681 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:18.713 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:52:18.724 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:18.979 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua5.1. 2024-09-17T01:52:19.005 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T01:52:19.027 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T01:52:19.045 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T01:52:19.045 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:52:19.050 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T01:52:19.053 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:19.072 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:19.076 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T01:52:19.094 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:19.111 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:19.251 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T01:52:19.323 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-any. 2024-09-17T01:52:19.349 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T01:52:19.390 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T01:52:19.414 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T01:52:19.431 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T01:52:19.440 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T01:52:19.458 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T01:52:19.480 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:52:19.497 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:52:19.510 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T01:52:19.526 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:19.560 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:19.651 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package zip. 2024-09-17T01:52:19.666 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T01:52:19.709 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T01:52:19.775 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T01:52:19.802 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T01:52:19.808 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T01:52:19.834 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T01:52:19.842 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:52:19.854 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T01:52:19.874 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T01:52:19.881 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T01:52:19.921 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:52:20.021 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package unzip. 2024-09-17T01:52:20.048 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T01:52:20.079 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:52:20.128 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T01:52:20.144 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T01:52:20.154 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T01:52:20.160 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:20.182 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T01:52:20.194 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:20.194 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:52:20.198 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T01:52:20.240 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:52:20.467 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package luarocks. 2024-09-17T01:52:20.492 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T01:52:20.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T01:52:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T01:52:20.533 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:52:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T01:52:20.539 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua5.1. 2024-09-17T01:52:20.540 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T01:52:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T01:52:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:52:20.580 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:52:20.597 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:52:20.841 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T01:52:20.856 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T01:52:20.907 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:52:20.908 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librgw2. 2024-09-17T01:52:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-any. 2024-09-17T01:52:20.933 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T01:52:20.935 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:20.946 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua5.1. 2024-09-17T01:52:20.972 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T01:52:20.974 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:20.975 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T01:52:21.012 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:52:21.227 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T01:52:21.228 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package zip. 2024-09-17T01:52:21.242 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T01:52:21.243 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T01:52:21.286 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:52:21.286 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T01:52:21.307 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-any. 2024-09-17T01:52:21.330 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T01:52:21.374 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T01:52:21.552 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T01:52:21.579 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:21.589 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-09-17T01:52:21.610 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:21.614 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package unzip. 2024-09-17T01:52:21.615 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T01:52:21.626 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package zip. 2024-09-17T01:52:21.640 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T01:52:21.642 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T01:52:21.647 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:52:21.681 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:52:21.685 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T01:52:21.947 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T01:52:21.973 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T01:52:21.987 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package unzip. 2024-09-17T01:52:21.992 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-09-17T01:52:22.007 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-17T01:52:22.013 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:52:22.014 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T01:52:22.050 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T01:52:22.053 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:52:22.093 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package luarocks. 2024-09-17T01:52:22.120 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T01:52:22.159 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:52:22.283 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T01:52:22.303 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-09-17T01:52:22.311 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:22.329 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-17T01:52:22.350 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:22.369 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T01:52:22.399 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package luarocks. 2024-09-17T01:52:22.426 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T01:52:22.457 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:52:22.527 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-09-17T01:52:22.554 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:22.594 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:22.647 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-09-17T01:52:22.662 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T01:52:22.697 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:52:22.770 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-common. 2024-09-17T01:52:22.796 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:22.815 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librgw2. 2024-09-17T01:52:22.836 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:22.842 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:22.881 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:23.076 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-09-17T01:52:23.102 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T01:52:23.143 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:52:23.146 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T01:52:23.161 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:23.425 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T01:52:23.441 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:23.483 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:23.501 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-09-17T01:52:23.527 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-librgw2_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:23.540 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T01:52:23.567 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:23.567 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T01:52:23.607 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:52:23.820 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T01:52:23.846 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T01:52:23.886 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:52:24.035 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T01:52:24.062 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.110 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.169 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T01:52:24.184 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.197 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T01:52:24.219 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.224 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.264 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.334 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-base. 2024-09-17T01:52:24.360 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.409 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.489 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T01:52:24.501 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T01:52:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-09-17T01:52:24.530 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:52:24.531 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.571 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.775 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-common. 2024-09-17T01:52:24.802 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.817 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T01:52:24.842 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.844 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:24.883 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:24.963 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T01:52:24.989 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T01:52:25.030 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:52:25.312 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-09-17T01:52:25.324 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T01:52:25.338 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-ceph-common_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:25.351 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T01:52:25.378 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:25.391 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:52:25.719 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T01:52:25.745 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T01:52:25.811 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:52:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-09-17T01:52:26.113 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T01:52:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:26.140 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T01:52:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:26.180 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:52:26.263 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-base. 2024-09-17T01:52:26.292 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:26.339 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:26.458 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T01:52:26.485 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T01:52:26.525 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:52:26.767 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-09-17T01:52:26.793 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-ceph-base_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:26.805 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T01:52:26.828 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T01:52:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T01:52:26.843 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:26.854 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T01:52:26.880 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:52:26.894 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T01:52:26.926 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T01:52:26.954 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T01:52:26.992 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:52:27.197 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-portend. 2024-09-17T01:52:27.208 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T01:52:27.224 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T01:52:27.234 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T01:52:27.245 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T01:52:27.264 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T01:52:27.272 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T01:52:27.274 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:52:27.337 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:52:27.413 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T01:52:27.439 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T01:52:27.479 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:52:27.559 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T01:52:27.585 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T01:52:27.619 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T01:52:27.625 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T01:52:27.645 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T01:52:27.686 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:52:27.706 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T01:52:27.733 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T01:52:27.743 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T01:52:27.758 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:52:27.790 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:52:27.928 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T01:52:27.955 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T01:52:27.995 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:52:28.022 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T01:52:28.048 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T01:52:28.076 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T01:52:28.077 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T01:52:28.097 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:52:28.102 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T01:52:28.103 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T01:52:28.135 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:52:28.142 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:52:28.323 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T01:52:28.350 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T01:52:28.390 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T01:52:28.403 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T01:52:28.430 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T01:52:28.438 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T01:52:28.461 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:52:28.464 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T01:52:28.466 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T01:52:28.493 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T01:52:28.505 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:52:28.541 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:52:28.710 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T01:52:28.737 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T01:52:28.747 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T01:52:28.768 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T01:52:28.774 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T01:52:28.807 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T01:52:28.813 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T01:52:28.834 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T01:52:28.869 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T01:52:28.874 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:52:28.895 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T01:52:28.936 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T01:52:29.046 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T01:52:29.073 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T01:52:29.113 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:52:29.127 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T01:52:29.142 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T01:52:29.177 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T01:52:29.214 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-portend. 2024-09-17T01:52:29.238 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-09-17T01:52:29.240 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T01:52:29.264 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T01:52:29.283 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T01:52:29.305 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T01:52:29.416 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-mako. 2024-09-17T01:52:29.442 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T01:52:29.446 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-09-17T01:52:29.472 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-17T01:52:29.482 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:52:29.513 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T01:52:29.586 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T01:52:29.613 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T01:52:29.674 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T01:52:29.700 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T01:52:29.749 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T01:52:29.752 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T01:52:29.811 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T01:52:29.816 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T01:52:29.838 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T01:52:29.842 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T01:52:29.877 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:52:29.882 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T01:52:30.022 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T01:52:30.049 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T01:52:30.080 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:52:30.128 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T01:52:30.154 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T01:52:30.178 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T01:52:30.202 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:52:30.204 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T01:52:30.205 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T01:52:30.232 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T01:52:30.235 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:52:30.263 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:52:30.434 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T01:52:30.460 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T01:52:30.500 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T01:52:30.550 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webob. 2024-09-17T01:52:30.564 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T01:52:30.572 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T01:52:30.577 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T01:52:30.591 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T01:52:30.598 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T01:52:30.617 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:52:30.630 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T01:52:30.639 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T01:52:30.836 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T01:52:30.863 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T01:52:30.901 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T01:52:30.903 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T01:52:30.925 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T01:52:30.927 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T01:52:30.940 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T01:52:30.953 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T01:52:30.967 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T01:52:30.975 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T01:52:30.980 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T01:52:31.023 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:52:31.147 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T01:52:31.171 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T01:52:31.205 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:52:31.270 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T01:52:31.286 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T01:52:31.297 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T01:52:31.312 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T01:52:31.331 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T01:52:31.336 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:52:31.353 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:52:31.357 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T01:52:31.398 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:52:31.508 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-mako. 2024-09-17T01:52:31.535 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T01:52:31.575 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:52:31.639 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-09-17T01:52:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-09-17T01:52:31.665 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T01:52:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T01:52:31.701 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-paste. 2024-09-17T01:52:31.705 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:52:31.706 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:52:31.727 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T01:52:31.767 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:52:31.903 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T01:52:31.930 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T01:52:31.969 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:52:32.034 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T01:52:32.060 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T01:52:32.093 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T01:52:32.095 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T01:52:32.100 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:52:32.111 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T01:52:32.120 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T01:52:32.154 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:52:32.159 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T01:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T01:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:52:32.361 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T01:52:32.388 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T01:52:32.428 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:52:32.437 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T01:52:32.457 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T01:52:32.464 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T01:52:32.483 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T01:52:32.495 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:52:32.523 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:52:32.591 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webob. 2024-09-17T01:52:32.607 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T01:52:32.641 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:52:32.705 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-09-17T01:52:32.732 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T01:52:32.772 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:52:32.798 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-09-17T01:52:32.801 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T01:52:32.825 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T01:52:32.828 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T01:52:32.865 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:52:32.868 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T01:52:32.936 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T01:52:32.962 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T01:52:32.997 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:52:33.116 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T01:52:33.143 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T01:52:33.180 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T01:52:33.186 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:52:33.206 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T01:52:33.218 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T01:52:33.245 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T01:52:33.246 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:52:33.289 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:52:33.289 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T01:52:33.315 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T01:52:33.355 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:52:33.503 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T01:52:33.530 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T01:52:33.569 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:52:33.596 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T01:52:33.609 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T01:52:33.623 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T01:52:33.636 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T01:52:33.662 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:52:33.666 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-paste. 2024-09-17T01:52:33.676 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T01:52:33.693 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T01:52:33.732 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:52:33.872 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-09-17T01:52:33.899 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T01:52:33.939 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:52:34.232 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T01:52:34.279 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-idna. 2024-09-17T01:52:34.290 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:52:34.308 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T01:52:34.603 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T01:52:34.627 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T01:52:34.630 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T01:52:34.653 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T01:52:34.694 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:52:34.763 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:52:34.861 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:52:34.971 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T01:52:34.998 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T01:52:35.038 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:52:35.164 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T01:52:35.191 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T01:52:35.230 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:52:35.368 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T01:52:35.374 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T01:52:35.394 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T01:52:35.397 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T01:52:35.432 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:52:35.434 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:52:35.517 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T01:52:35.543 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T01:52:35.583 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T01:52:35.737 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T01:52:35.755 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests. 2024-09-17T01:52:35.763 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T01:52:35.781 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T01:52:35.803 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:52:35.821 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:52:35.886 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T01:52:35.913 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T01:52:35.952 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:52:36.073 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T01:52:36.099 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T01:52:36.132 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T01:52:36.139 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T01:52:36.159 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T01:52:36.199 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:52:36.200 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T01:52:36.228 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T01:52:36.269 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T01:52:36.298 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T01:52:36.325 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T01:52:36.365 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T01:52:36.401 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T01:52:36.428 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T01:52:36.459 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:52:36.502 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T01:52:36.528 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:36.577 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:36.580 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T01:52:36.607 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T01:52:36.646 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:52:36.651 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-idna. 2024-09-17T01:52:36.678 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T01:52:36.718 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:52:36.822 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T01:52:36.849 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T01:52:36.888 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T01:52:36.957 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T01:52:36.983 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:37.015 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:37.018 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T01:52:37.029 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T01:52:37.044 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T01:52:37.056 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T01:52:37.084 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T01:52:37.095 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:52:37.216 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-09-17T01:52:37.243 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T01:52:37.282 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:52:37.310 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T01:52:37.336 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T01:52:37.371 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-09-17T01:52:37.376 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:52:37.397 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T01:52:37.423 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests. 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:52:37.450 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T01:52:37.489 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:52:37.602 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T01:52:37.629 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T01:52:37.646 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T01:52:37.669 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:52:37.672 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T01:52:37.705 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T01:52:37.732 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T01:52:37.758 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T01:52:37.793 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T01:52:37.798 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:52:37.819 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T01:52:37.859 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:52:37.972 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-09-17T01:52:37.999 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T01:52:38.032 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T01:52:38.038 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:52:38.059 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:38.099 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:38.118 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-09-17T01:52:38.145 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T01:52:38.145 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T01:52:38.161 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:38.185 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:52:38.203 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:38.333 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T01:52:38.360 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T01:52:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:52:38.469 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T01:52:38.495 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:38.496 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T01:52:38.522 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T01:52:38.535 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:38.563 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:52:38.566 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T01:52:38.583 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:38.625 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:38.677 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T01:52:38.705 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:38.744 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:38.824 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T01:52:38.839 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:38.882 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:38.902 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T01:52:38.929 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T01:52:38.969 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:52:39.080 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T01:52:39.096 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T01:52:39.138 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:39.151 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:39.190 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:39.229 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T01:52:39.255 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:39.271 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T01:52:39.295 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:39.298 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T01:52:39.338 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T01:52:39.510 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T01:52:39.537 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T01:52:39.576 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:52:39.590 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T01:52:39.616 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T01:52:39.656 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:52:39.666 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T01:52:39.693 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:39.732 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:39.820 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T01:52:39.847 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T01:52:39.878 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T01:52:39.984 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T01:52:40.011 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T01:52:40.051 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T01:52:40.167 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph. 2024-09-17T01:52:40.182 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.223 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T01:52:40.225 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.244 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T01:52:40.250 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.271 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.289 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.302 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.404 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T01:52:40.430 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.470 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.545 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T01:52:40.571 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.611 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.685 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T01:52:40.711 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.751 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T01:52:40.867 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.880 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T01:52:40.898 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.907 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.931 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T01:52:40.946 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:40.958 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:40.998 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:41.321 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T01:52:41.348 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:41.368 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephadm. 2024-09-17T01:52:41.379 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:41.394 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:41.434 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:41.519 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T01:52:41.545 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:41.585 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:41.762 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T01:52:41.789 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T01:52:41.828 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T01:52:41.991 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph. 2024-09-17T01:52:42.007 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:42.050 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:42.106 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T01:52:42.121 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:42.164 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:42.369 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T01:52:42.396 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:42.435 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:42.449 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-09-17T01:52:42.464 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:42.507 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:42.647 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-09-17T01:52:42.662 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:42.705 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:42.747 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T01:52:42.774 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:42.805 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:42.843 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T01:52:42.870 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:42.909 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.024 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T01:52:43.051 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:43.091 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.200 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephadm. 2024-09-17T01:52:43.203 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-babel. 2024-09-17T01:52:43.227 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:43.230 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:43.246 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T01:52:43.266 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.269 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:43.272 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.453 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T01:52:43.480 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:43.519 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.560 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T01:52:43.587 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T01:52:43.614 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T01:52:43.626 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T01:52:43.641 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T01:52:43.674 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-09-17T01:52:43.681 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:52:43.700 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:43.740 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.908 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-09-17T01:52:43.921 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T01:52:43.932 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-cephadm_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:43.937 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:43.972 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:43.995 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:44.025 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T01:52:44.052 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:44.076 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T01:52:44.092 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:44.103 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T01:52:44.143 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T01:52:44.283 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T01:52:44.310 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T01:52:44.383 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T01:52:44.445 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T01:52:44.473 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T01:52:44.478 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T01:52:44.494 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:44.512 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T01:52:44.537 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:44.702 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T01:52:44.729 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:44.777 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:45.001 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-babel. 2024-09-17T01:52:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-routes. 2024-09-17T01:52:45.028 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:45.033 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T01:52:45.067 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:45.073 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:52:45.370 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T01:52:45.397 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T01:52:45.434 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T01:52:45.436 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:52:45.450 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:45.493 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-09-17T01:52:45.603 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:45.633 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:45.764 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T01:52:45.791 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:45.816 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-09-17T01:52:45.830 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:45.843 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T01:52:45.882 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:52:45.920 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T01:52:45.947 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T01:52:45.978 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:52:46.161 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T01:52:46.177 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T01:52:46.210 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T01:52:46.210 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T01:52:46.237 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T01:52:46.276 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:52:46.298 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T01:52:46.324 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:46.356 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:46.480 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-routes. 2024-09-17T01:52:46.507 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T01:52:46.546 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:52:46.663 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T01:52:46.667 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T01:52:46.690 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:46.694 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T01:52:46.723 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T01:52:46.725 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T01:52:46.730 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:46.739 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T01:52:46.773 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:52:46.849 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T01:52:46.866 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:46.899 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:47.003 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-09-17T01:52:47.030 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T01:52:47.058 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T01:52:47.070 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:52:47.085 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T01:52:47.124 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T01:52:47.260 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T01:52:47.287 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T01:52:47.326 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:52:47.356 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T01:52:47.383 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:47.423 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:47.435 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-09-17T01:52:47.463 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T01:52:47.511 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:52:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T01:52:47.724 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T01:52:47.763 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:52:47.847 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T01:52:47.874 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:47.914 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:48.066 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T01:52:48.093 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T01:52:48.096 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T01:52:48.112 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T01:52:48.132 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:52:48.154 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:52:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T01:52:48.626 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T01:52:48.665 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:52:48.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T01:52:48.768 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T01:52:48.811 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:52:48.850 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T01:52:48.877 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:49.002 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:49.044 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T01:52:49.071 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T01:52:49.110 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:52:49.219 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T01:52:49.246 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T01:52:49.285 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:52:49.306 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T01:52:49.333 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T01:52:49.364 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:52:49.388 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T01:52:49.415 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T01:52:49.454 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:52:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T01:52:49.745 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T01:52:49.784 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:52:49.789 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T01:52:49.816 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T01:52:49.855 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:52:49.964 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T01:52:49.992 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T01:52:50.031 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T01:52:50.154 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T01:52:50.183 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:50.226 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T01:52:50.242 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T01:52:50.284 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:52:50.306 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:50.312 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T01:52:50.340 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T01:52:50.351 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T01:52:50.378 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:52:50.379 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T01:52:50.417 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:52:50.604 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T01:52:50.631 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T01:52:50.670 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:52:50.754 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T01:52:50.782 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T01:52:50.821 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:52:51.095 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T01:52:51.116 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T01:52:51.123 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:51.143 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T01:52:51.182 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T01:52:51.247 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:51.370 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T01:52:51.384 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T01:52:51.386 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:51.412 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T01:52:51.450 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T01:52:51.478 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T01:52:51.505 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T01:52:51.522 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:51.544 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T01:52:51.754 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T01:52:51.781 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T01:52:51.820 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:52:51.847 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T01:52:51.874 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T01:52:51.914 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:52:52.148 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T01:52:52.176 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T01:52:52.215 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:52:52.242 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T01:52:52.242 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T01:52:52.269 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T01:52:52.270 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T01:52:52.309 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T01:52:52.309 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T01:52:52.526 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T01:52:52.526 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T01:52:52.553 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T01:52:52.554 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T01:52:52.592 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T01:52:52.593 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T01:52:52.628 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T01:52:52.629 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T01:52:52.656 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T01:52:52.656 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T01:52:52.695 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:52:52.695 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:52:52.871 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T01:52:52.895 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T01:52:52.904 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T01:52:52.929 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T01:52:52.931 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T01:52:52.970 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:52:53.031 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T01:52:53.059 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T01:52:53.098 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:52:53.199 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T01:52:53.226 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T01:52:53.265 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:52:53.282 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T01:52:53.309 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T01:52:53.340 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:52:53.342 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T01:52:53.359 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:53.401 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T01:52:53.445 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T01:52:53.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T01:52:53.576 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T01:52:53.604 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T01:52:53.635 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T01:52:53.643 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T01:52:53.657 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-17T01:52:53.701 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T01:52:53.737 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T01:52:53.746 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T01:52:53.765 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T01:52:53.774 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T01:52:53.804 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:52:53.804 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T01:52:53.980 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T01:52:54.007 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T01:52:54.022 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T01:52:54.046 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:52:54.049 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T01:52:54.088 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T01:52:54.098 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T01:52:54.099 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T01:52:54.114 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:54.127 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T01:52:54.157 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:52:54.165 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:52:54.408 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T01:52:54.409 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package jq. 2024-09-17T01:52:54.435 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T01:52:54.437 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:54.474 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:52:54.476 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T01:52:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T01:52:54.513 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T01:52:54.552 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T01:52:54.693 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T01:52:54.706 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:54.737 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package socat. 2024-09-17T01:52:54.751 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:54.761 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T01:52:54.765 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T01:52:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T01:52:54.804 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:52:54.836 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T01:52:54.863 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T01:52:54.891 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T01:52:54.929 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:52:55.107 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T01:52:55.134 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T01:52:55.174 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:52:55.221 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T01:52:55.248 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T01:52:55.249 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T01:52:55.275 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T01:52:55.287 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:52:55.322 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:52:55.623 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T01:52:55.651 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:55.677 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T01:52:55.690 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:52:55.693 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:55.735 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:55.828 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-test. 2024-09-17T01:52:55.855 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:55.894 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package jq. 2024-09-17T01:52:55.945 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:55.975 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T01:52:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T01:52:56.027 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:56.037 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T01:52:56.065 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T01:52:56.069 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:56.123 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:52:56.220 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package socat. 2024-09-17T01:52:56.248 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T01:52:56.286 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:52:56.339 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T01:52:56.366 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T01:52:56.406 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:52:56.457 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T01:52:56.484 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:56.523 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:52:56.589 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T01:52:56.617 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T01:52:56.656 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:52:56.750 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T01:52:56.751 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-09-17T01:52:56.767 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:56.777 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:56.809 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T01:52:56.817 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:52:56.985 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-test. 2024-09-17T01:52:57.001 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:57.034 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:57.045 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-09-17T01:52:57.069 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-09-17T01:52:57.072 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T01:52:57.085 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T01:52:57.112 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:52:57.128 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T01:52:57.347 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-09-17T01:52:57.362 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T01:52:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:52:57.423 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T01:52:57.450 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T01:52:57.490 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:52:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T01:52:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T01:52:57.758 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:52:57.869 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-09-17T01:52:57.896 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:57.935 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:58.121 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-09-17T01:52:58.137 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-ceph-test_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:58.179 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:58.282 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T01:52:58.310 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:58.349 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:58.653 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T01:52:58.681 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:58.719 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:58.989 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T01:52:59.005 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T01:52:59.039 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:52:59.206 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T01:52:59.234 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:52:59.272 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:59.369 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T01:52:59.396 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T01:52:59.435 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:52:59.551 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T01:52:59.567 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:52:59.609 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:52:59.798 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T01:52:59.826 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T01:52:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:52:59.921 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T01:52:59.949 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T01:52:59.987 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:00.223 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T01:53:00.251 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:53:00.278 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package pkg-config. 2024-09-17T01:53:00.289 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:00.305 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T01:53:00.308 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T01:53:00.336 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T01:53:00.344 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:00.374 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:00.492 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T01:53:00.519 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-330-gc2ddf972-1jammy_all.deb ... 2024-09-17T01:53:00.558 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:00.593 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T01:53:00.597 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T01:53:00.609 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:00.614 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T01:53:00.647 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:00.651 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:00.728 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T01:53:00.756 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T01:53:00.786 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:00.863 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T01:53:00.890 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:00.929 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:00.971 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T01:53:00.998 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T01:53:01.037 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:01.067 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T01:53:01.094 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T01:53:01.125 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:01.198 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T01:53:01.215 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T01:53:01.224 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package pkg-config. 2024-09-17T01:53:01.252 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T01:53:01.256 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:01.291 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:01.359 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T01:53:01.386 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T01:53:01.412 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T01:53:01.416 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:01.438 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T01:53:01.477 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:01.578 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T01:53:01.605 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T01:53:01.644 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:01.795 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T01:53:01.798 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T01:53:01.802 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T01:53:01.822 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T01:53:01.826 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T01:53:01.830 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T01:53:01.861 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:01.868 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:02.023 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T01:53:02.050 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T01:53:02.090 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:02.159 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T01:53:02.187 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T01:53:02.225 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:02.280 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T01:53:02.286 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package pkg-config. 2024-09-17T01:53:02.308 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T01:53:02.313 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T01:53:02.346 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:02.352 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:02.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-09-17T01:53:02.531 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T01:53:02.554 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-py. 2024-09-17T01:53:02.569 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:02.581 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T01:53:02.596 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T01:53:02.612 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T01:53:02.620 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T01:53:02.624 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T01:53:02.646 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:02.652 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T01:53:02.690 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:02.831 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T01:53:02.847 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T01:53:02.889 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:02.941 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T01:53:02.968 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T01:53:03.007 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:03.018 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T01:53:03.046 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T01:53:03.058 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T01:53:03.085 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:03.085 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T01:53:03.124 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:03.363 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T01:53:03.375 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T01:53:03.379 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T01:53:03.403 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T01:53:03.411 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T01:53:03.412 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:03.438 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T01:53:03.442 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:03.477 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:03.478 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T01:53:03.505 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T01:53:03.544 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:03.745 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T01:53:03.773 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T01:53:03.774 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-py. 2024-09-17T01:53:03.797 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T01:53:03.802 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T01:53:03.812 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:03.825 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T01:53:03.847 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-toml. 2024-09-17T01:53:03.848 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T01:53:03.864 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:03.875 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T01:53:03.913 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T01:53:04.106 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T01:53:04.122 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T01:53:04.156 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:04.175 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T01:53:04.177 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T01:53:04.200 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T01:53:04.202 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T01:53:04.205 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T01:53:04.227 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T01:53:04.241 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:04.243 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:04.266 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:04.451 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T01:53:04.478 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T01:53:04.517 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:04.562 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-09-17T01:53:04.589 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T01:53:04.595 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T01:53:04.623 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T01:53:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T01:53:04.661 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:04.730 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T01:53:04.759 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T01:53:04.797 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:04.931 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T01:53:04.947 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T01:53:04.948 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T01:53:04.977 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T01:53:04.989 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:05.014 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:05.099 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-toml. 2024-09-17T01:53:05.128 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T01:53:05.163 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-09-17T01:53:05.166 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T01:53:05.191 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-17T01:53:05.270 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T01:53:05.485 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T01:53:05.513 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T01:53:05.551 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:05.565 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T01:53:05.581 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T01:53:05.615 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:05.752 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package radosgw. 2024-09-17T01:53:05.761 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T01:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:05.788 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T01:53:05.818 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:05.827 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:05.839 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T01:53:05.867 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T01:53:05.896 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:06.061 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T01:53:06.089 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T01:53:06.124 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T01:53:06.127 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-09-17T01:53:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T01:53:06.166 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T01:53:06.190 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:06.205 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T01:53:06.447 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-09-17T01:53:06.475 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-17T01:53:06.483 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T01:53:06.510 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T01:53:06.513 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T01:53:06.549 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:06.654 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T01:53:06.670 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:06.712 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:06.774 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T01:53:06.790 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T01:53:06.824 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:06.887 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package radosgw. 2024-09-17T01:53:06.887 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T01:53:06.914 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T01:53:06.915 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:06.953 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:06.953 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:07.009 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:07.178 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T01:53:07.206 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T01:53:07.206 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T01:53:07.233 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T01:53:07.244 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:07.264 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:07.276 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:53:07.385 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:07.505 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T01:53:07.521 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T01:53:07.564 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:07.650 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T01:53:07.780 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T01:53:07.797 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:07.839 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:07.968 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-09-17T01:53:07.977 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T01:53:07.996 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:08.026 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:08.127 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:08.360 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-09-17T01:53:08.385 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:53:08.387 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-radosgw_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:08.425 INFO:teuthology.orchestra.run.smithi098.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T01:53:08.426 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:08.496 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:08.520 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:08.790 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T01:53:08.821 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T01:53:08.849 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:08.887 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:08.988 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user cephadm....done 2024-09-17T01:53:09.128 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T01:53:09.135 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:53:09.201 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:09.229 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T01:53:09.245 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-330-gc2ddf972-1jammy_amd64.deb ... 2024-09-17T01:53:09.279 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:09.403 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:53:09.468 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:53:09.586 INFO:teuthology.orchestra.run.smithi063.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T01:53:09.592 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T01:53:09.619 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:09.663 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:09.671 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:09.789 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:53:09.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T01:53:09.881 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T01:53:09.951 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T01:53:10.065 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T01:53:10.128 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user cephadm....done 2024-09-17T01:53:10.207 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T01:53:10.212 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T01:53:10.316 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:53:10.319 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:53:10.434 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T01:53:10.530 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T01:53:10.610 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T01:53:10.679 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:10.698 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:53:10.728 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:53:10.957 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T01:53:11.020 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:11.103 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:11.225 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-09-17T01:53:11.229 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T01:53:11.312 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:53:11.377 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:53:11.470 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-09-17T01:53:11.489 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T01:53:11.609 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T01:53:11.654 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:53:11.666 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T01:53:11.765 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:53:11.878 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T01:53:11.913 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:12.017 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:53:12.024 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:53:12.112 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T01:53:12.117 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:53:12.238 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T01:53:12.243 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T01:53:12.268 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:12.274 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T01:53:12.490 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T01:53:12.527 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:53:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:53:12.558 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:53:12.685 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T01:53:12.749 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T01:53:12.778 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:12.875 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T01:53:12.921 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T01:53:12.995 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:53:13.063 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:53:13.189 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T01:53:13.201 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T01:53:13.315 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:53:13.355 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T01:53:13.441 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:53:13.474 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:53:13.562 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T01:53:13.615 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T01:53:13.709 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:53:13.717 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:53:13.813 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T01:53:13.899 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:53:14.081 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T01:53:14.085 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:14.124 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T01:53:14.158 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T01:53:14.168 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:53:14.246 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:53:14.316 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T01:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:14.377 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:53:14.427 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:14.567 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T01:53:14.636 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:14.695 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:53:14.731 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:14.849 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T01:53:14.851 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T01:53:14.913 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:53:14.963 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:15.038 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:15.103 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:15.117 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:53:15.164 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:53:15.290 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:53:15.331 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:53:15.377 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:15.421 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T01:53:15.440 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:15.530 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T01:53:15.550 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:53:15.566 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:53:15.656 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T01:53:15.669 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T01:53:15.692 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:53:15.782 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T01:53:15.804 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:15.912 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T01:53:15.948 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T01:53:15.952 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:53:16.020 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:53:16.033 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T01:53:16.145 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:16.333 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T01:53:16.366 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T01:53:16.416 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T01:53:16.439 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:53:16.448 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T01:53:16.456 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:53:16.503 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T01:53:16.513 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:16.589 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:16.612 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T01:53:16.639 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T01:53:16.707 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:53:16.833 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:16.907 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:53:16.966 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:16.968 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:53:16.972 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:17.092 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T01:53:17.098 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T01:53:17.174 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:17.252 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T01:53:17.357 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:53:17.368 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T01:53:17.501 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T01:53:17.601 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:17.625 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:17.637 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T01:53:17.669 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T01:53:17.890 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:53:17.926 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T01:53:17.979 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T01:53:18.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:18.096 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T01:53:18.267 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:53:18.320 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:53:18.568 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:53:18.597 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:53:18.681 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:53:18.722 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:18.731 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T01:53:18.848 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:53:18.903 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:53:18.932 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:53:18.999 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T01:53:19.058 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:19.134 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T01:53:19.153 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:53:19.165 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T01:53:19.184 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:53:19.260 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T01:53:19.280 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:19.485 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T01:53:19.542 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T01:53:19.579 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T01:53:19.581 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:53:19.784 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:53:19.836 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T01:53:19.899 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:53:19.996 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T01:53:20.062 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:53:20.169 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:53:20.231 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T01:53:20.456 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:53:20.487 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:53:20.640 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T01:53:20.749 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:53:20.880 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:53:21.034 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T01:53:21.092 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:53:21.139 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:53:21.266 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:21.297 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:21.343 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:53:21.452 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:21.548 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:21.583 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:53:21.674 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T01:53:21.719 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T01:53:21.729 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:53:21.893 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:53:21.959 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:53:21.970 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T01:53:22.063 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:53:22.085 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:53:22.096 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:22.211 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:53:22.372 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T01:53:22.504 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:22.673 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T01:53:22.763 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T01:53:23.014 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:23.090 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:23.132 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:53:23.252 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:23.317 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:23.426 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T01:53:23.434 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:53:23.470 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:23.605 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T01:53:23.685 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:53:23.693 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T01:53:23.819 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:53:23.837 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T01:53:23.873 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:53:23.944 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T01:53:23.970 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:53:23.998 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:53:24.080 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:24.124 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:53:24.195 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:53:24.207 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T01:53:24.280 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:24.417 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:24.446 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T01:53:24.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T01:53:24.548 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T01:53:24.601 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T01:53:24.685 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T01:53:24.722 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:53:24.727 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T01:53:24.798 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:24.849 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T01:53:24.900 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:53:24.919 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:25.029 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:53:25.045 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T01:53:25.133 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:53:25.193 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:53:25.243 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:53:25.296 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T01:53:25.330 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:53:25.435 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T01:53:25.510 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:53:25.539 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:25.582 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T01:53:25.648 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T01:53:25.695 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T01:53:25.811 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:53:25.841 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T01:53:25.932 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T01:53:25.954 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:53:26.071 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:53:26.100 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:53:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T01:53:26.202 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:26.205 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T01:53:26.331 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:26.377 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T01:53:26.403 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T01:53:26.452 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T01:53:26.473 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:53:26.599 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T01:53:26.627 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:53:26.641 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:53:26.703 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T01:53:26.737 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T01:53:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:53:26.954 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T01:53:26.984 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:53:27.022 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:53:27.147 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:53:27.169 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:53:27.213 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T01:53:27.269 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:53:27.331 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T01:53:27.432 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:53:27.445 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T01:53:27.571 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T01:53:27.615 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T01:53:27.624 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:53:27.725 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:53:27.742 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T01:53:27.824 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:27.904 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:53:27.948 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:53:27.984 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:53:28.030 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:28.034 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T01:53:28.093 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:28.156 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:28.203 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:28.244 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T01:53:28.266 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:53:28.276 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T01:53:28.336 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T01:53:28.482 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:53:28.521 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:53:28.559 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:53:28.583 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:28.603 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T01:53:28.647 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:28.729 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T01:53:28.818 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T01:53:28.855 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T01:53:28.928 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T01:53:28.945 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T01:53:28.951 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:53:29.040 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:53:29.157 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T01:53:29.217 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T01:53:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T01:53:29.292 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T01:53:29.308 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T01:53:29.337 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T01:53:29.434 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T01:53:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:53:29.596 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:29.677 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T01:53:29.685 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:29.722 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:53:29.811 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:53:29.817 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:53:29.936 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T01:53:30.048 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:53:30.062 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T01:53:30.137 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:53:30.202 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:30.313 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T01:53:30.374 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:53:30.439 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T01:53:30.472 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:53:30.487 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:53:30.692 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T01:53:30.748 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T01:53:30.749 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T01:53:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T01:53:30.831 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:53:30.857 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T01:53:30.965 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:31.025 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T01:53:31.060 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T01:53:31.093 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:31.116 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T01:53:31.201 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:53:31.302 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T01:53:31.347 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:53:31.384 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:53:31.427 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T01:53:31.703 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T01:53:31.717 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:53:31.729 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:53:31.753 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:31.880 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:31.987 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T01:53:32.005 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T01:53:32.085 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:32.148 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:32.290 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:32.341 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T01:53:32.370 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:53:32.416 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:53:32.416 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:32.543 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:32.714 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:53:32.718 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T01:53:32.759 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:32.759 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:32.776 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:53:32.841 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:32.903 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:32.942 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.003 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T01:53:33.029 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.042 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:53:33.155 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:53:33.311 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.330 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T01:53:33.387 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.431 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.458 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.513 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.533 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.546 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.584 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.640 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T01:53:33.684 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T01:53:33.710 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T01:53:33.713 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.840 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:53:33.925 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:33.987 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.020 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.025 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.146 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.146 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.152 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.264 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T01:53:34.272 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.372 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:34.372 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:34.488 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:34.488 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:34.541 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.667 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.793 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.878 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:34.932 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.002 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:35.002 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T01:53:35.004 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.066 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.139 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.184 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.265 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:53:35.310 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:53:35.453 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.494 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.579 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.646 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.679 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.771 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.797 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:35.881 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T01:53:35.943 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.483 INFO:teuthology.orchestra.run.smithi098.stdout:Adding group ceph....done 2024-09-17T01:53:36.493 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.522 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.620 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.648 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.745 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.774 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.843 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user ceph....done 2024-09-17T01:53:36.872 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.900 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:36.998 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.009 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.020 INFO:teuthology.orchestra.run.smithi098.stdout:Setting system user ceph properties....done 2024-09-17T01:53:37.039 INFO:teuthology.orchestra.run.smithi098.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T01:53:37.076 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.176 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T01:53:37.194 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.303 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.405 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.507 INFO:teuthology.orchestra.run.smithi063.stdout:Adding group ceph....done 2024-09-17T01:53:37.527 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-09-17T01:53:37.530 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:37.553 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T01:53:37.818 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user ceph....done 2024-09-17T01:53:37.912 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-09-17T01:53:37.952 INFO:teuthology.orchestra.run.smithi063.stdout:Setting system user ceph properties....done 2024-09-17T01:53:37.972 INFO:teuthology.orchestra.run.smithi063.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T01:53:38.022 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-09-17T01:53:38.036 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T01:53:38.040 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-09-17T01:53:38.042 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:38.116 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T01:53:38.168 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:38.173 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T01:53:38.418 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-09-17T01:53:38.464 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T01:53:38.525 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T01:53:38.577 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-09-17T01:53:38.594 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T01:53:38.636 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:38.636 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:38.727 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T01:53:39.002 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.025 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T01:53:39.120 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.128 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.183 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.293 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.438 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T01:53:39.474 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.600 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:39.600 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:39.600 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:39.787 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:39.787 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:39.913 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:40.053 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:40.053 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:53:40.055 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:40.134 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:40.134 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:40.253 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:40.385 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T01:53:40.485 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:40.621 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T01:53:40.623 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:40.821 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T01:53:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:40.846 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:40.846 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:41.050 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:41.050 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:41.113 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:41.254 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:41.343 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:41.343 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:41.358 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:41.486 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:41.486 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T01:53:41.500 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:41.637 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:41.638 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:41.710 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:41.710 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:41.840 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:41.981 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.046 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:42.046 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:42.161 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.201 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:42.201 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T01:53:42.202 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.278 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.404 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.475 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:42.475 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:42.491 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.601 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:42.601 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:42.683 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.744 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:42.744 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:42.928 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:42.969 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:42.969 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T01:53:43.055 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.114 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.206 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.237 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.265 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.372 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.391 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.400 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:43.400 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:43.418 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.523 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.527 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.542 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.670 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.765 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:43.765 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:43.873 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:43.883 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:43.883 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T01:53:43.895 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T01:53:43.987 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:43.991 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.117 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.123 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:44.233 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.268 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.350 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.371 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.460 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.506 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.611 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.623 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T01:53:44.632 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.722 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:44.791 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (19.1.1-330-gc2ddf972-1jammy) ... 2024-09-17T01:53:44.875 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:44.972 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T01:53:45.073 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:45.152 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T01:53:45.199 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:45.217 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:45.262 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:45.406 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:45.851 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:45.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T01:53:45.912 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-17T01:53:45.984 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:46.126 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-17T01:53:46.127 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-17T01:53:46.321 INFO:teuthology.orchestra.run.smithi098.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T01:53:46.321 INFO:teuthology.orchestra.run.smithi098.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T01:53:46.321 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:53:46.321 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:53:46.321 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:53:46.321 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:53:46.322 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:53:46.322 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:53:46.322 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:53:46.322 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-17T01:53:46.323 INFO:teuthology.orchestra.run.smithi098.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T01:53:46.325 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-17T01:53:46.325 INFO:teuthology.orchestra.run.smithi098.stdout: bison-doc flex-doc libssl-doc 2024-09-17T01:53:46.354 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-17T01:53:46.355 INFO:teuthology.orchestra.run.smithi098.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T01:53:46.356 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2024-09-17T01:53:46.357 INFO:teuthology.orchestra.run.smithi098.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T01:53:46.410 INFO:teuthology.orchestra.run.smithi098.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T01:53:46.411 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 5,494 kB of archives. 2024-09-17T01:53:46.411 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T01:53:46.411 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T01:53:46.426 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:46.507 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:46.512 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T01:53:46.575 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T01:53:46.576 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T01:53:46.577 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T01:53:46.593 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T01:53:46.594 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T01:53:46.595 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T01:53:46.595 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T01:53:46.595 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T01:53:46.670 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:46.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T01:53:46.728 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-17T01:53:46.926 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-17T01:53:46.927 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-17T01:53:46.945 INFO:teuthology.orchestra.run.smithi098.stdout:Preconfiguring packages ... 2024-09-17T01:53:47.035 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 5,494 kB in 0s (21.2 MB/s) 2024-09-17T01:53:47.103 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:47.106 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T01:53:47.110 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T01:53:47.110 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T01:53:47.110 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:53:47.110 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:53:47.110 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:53:47.110 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:53:47.111 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:53:47.111 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:53:47.111 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:53:47.112 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-17T01:53:47.113 INFO:teuthology.orchestra.run.smithi154.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T01:53:47.114 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-17T01:53:47.114 INFO:teuthology.orchestra.run.smithi154.stdout: bison-doc flex-doc libssl-doc 2024-09-17T01:53:47.144 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-17T01:53:47.146 INFO:teuthology.orchestra.run.smithi154.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T01:53:47.147 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-09-17T01:53:47.148 INFO:teuthology.orchestra.run.smithi154.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T01:53:47.164 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-17T01:53:47.164 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package flex. 2024-09-17T01:53:47.198 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T01:53:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 5,494 kB of archives. 2024-09-17T01:53:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T01:53:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T01:53:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:47.258 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-17T01:53:47.260 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T01:53:47.266 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:47.299 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T01:53:47.304 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T01:53:47.314 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-17T01:53:47.360 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T01:53:47.361 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T01:53:47.361 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T01:53:47.375 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T01:53:47.376 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T01:53:47.377 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T01:53:47.378 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T01:53:47.378 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T01:53:47.380 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-09-17T01:53:47.381 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-09-17T01:53:47.525 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-17T01:53:47.526 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-17T01:53:47.594 INFO:teuthology.orchestra.run.smithi063.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T01:53:47.594 INFO:teuthology.orchestra.run.smithi063.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T01:53:47.594 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:53:47.594 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:53:47.594 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:53:47.595 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:53:47.595 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:53:47.595 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:53:47.595 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:53:47.596 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-09-17T01:53:47.597 INFO:teuthology.orchestra.run.smithi063.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T01:53:47.598 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-09-17T01:53:47.598 INFO:teuthology.orchestra.run.smithi063.stdout: bison-doc flex-doc libssl-doc 2024-09-17T01:53:47.629 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-09-17T01:53:47.630 INFO:teuthology.orchestra.run.smithi063.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T01:53:47.632 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2024-09-17T01:53:47.632 INFO:teuthology.orchestra.run.smithi063.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T01:53:47.725 INFO:teuthology.orchestra.run.smithi096.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T01:53:47.725 INFO:teuthology.orchestra.run.smithi096.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T01:53:47.725 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T01:53:47.725 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T01:53:47.725 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T01:53:47.725 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T01:53:47.726 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T01:53:47.726 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T01:53:47.726 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T01:53:47.726 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-17T01:53:47.727 INFO:teuthology.orchestra.run.smithi096.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-17T01:53:47.728 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-17T01:53:47.728 INFO:teuthology.orchestra.run.smithi096.stdout: bison-doc flex-doc libssl-doc 2024-09-17T01:53:47.742 INFO:teuthology.orchestra.run.smithi154.stdout:Preconfiguring packages ... 2024-09-17T01:53:47.757 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-17T01:53:47.758 INFO:teuthology.orchestra.run.smithi096.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-17T01:53:47.760 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-09-17T01:53:47.760 INFO:teuthology.orchestra.run.smithi096.stdout: libssl3 libuuid1 uuid-dev 2024-09-17T01:53:47.813 INFO:teuthology.orchestra.run.smithi063.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T01:53:47.813 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 5,494 kB of archives. 2024-09-17T01:53:47.813 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T01:53:47.813 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T01:53:47.845 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 5,494 kB in 0s (21.8 MB/s) 2024-09-17T01:53:47.854 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-17T01:53:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 5,494 kB of archives. 2024-09-17T01:53:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-17T01:53:47.941 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T01:53:47.981 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package flex. 2024-09-17T01:53:48.035 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T01:53:48.059 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T01:53:48.065 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:48.105 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T01:53:48.286 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T01:53:48.419 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T01:53:48.438 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:48.539 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T01:53:48.540 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T01:53:48.541 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T01:53:48.575 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T01:53:48.576 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T01:53:48.579 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T01:53:48.579 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T01:53:48.579 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T01:53:48.663 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:48.673 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T01:53:48.674 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T01:53:48.675 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T01:53:48.709 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T01:53:48.710 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T01:53:48.712 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T01:53:48.712 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T01:53:48.713 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T01:53:48.836 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T01:53:48.931 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:48.937 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:49.004 INFO:teuthology.orchestra.run.smithi063.stdout:Preconfiguring packages ... 2024-09-17T01:53:49.077 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:49.120 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 5,494 kB in 1s (5,438 kB/s) 2024-09-17T01:53:49.126 INFO:teuthology.orchestra.run.smithi096.stdout:Preconfiguring packages ... 2024-09-17T01:53:49.239 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 5,494 kB in 1s (5,409 kB/s) 2024-09-17T01:53:49.255 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:49.259 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package flex. 2024-09-17T01:53:49.355 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package flex. 2024-09-17T01:53:49.365 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T01:53:49.372 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:49.416 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T01:53:49.418 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2024-09-17T01:53:49.423 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:49.471 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T01:53:49.494 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:49.625 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:49.758 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:49.763 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:49.860 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:49.953 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:49.975 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:50.013 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:50.130 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T01:53:50.276 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T01:53:50.311 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:50.325 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package bison. 2024-09-17T01:53:50.429 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:50.434 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T01:53:50.442 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:50.485 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:50.550 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:50.764 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:50.772 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:50.795 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T01:53:50.822 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T01:53:50.853 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:51.078 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:51.083 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:51.106 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T01:53:51.122 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T01:53:51.134 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package bison. 2024-09-17T01:53:51.165 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:51.213 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:51.236 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:51.242 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T01:53:51.295 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:51.308 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:51.313 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:51.452 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:51.493 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T01:53:51.521 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:51.560 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:51.614 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:51.713 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T01:53:51.729 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T01:53:51.745 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:51.771 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:51.850 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T01:53:51.863 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T01:53:51.877 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:52.059 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T01:53:52.086 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T01:53:52.090 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:52.117 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:52.200 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:52.365 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T01:53:52.445 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T01:53:52.448 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package bison. 2024-09-17T01:53:52.473 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:52.511 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:52.552 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:52.558 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T01:53:52.575 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T01:53:52.591 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:52.615 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:52.633 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:52.773 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T01:53:52.789 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:52.831 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:52.848 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:52.957 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T01:53:52.985 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T01:53:53.023 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:53.083 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T01:53:53.094 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T01:53:53.099 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:53.142 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:53.221 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:53.230 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package bison. 2024-09-17T01:53:53.277 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T01:53:53.294 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T01:53:53.331 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2024-09-17T01:53:53.335 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:53.336 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T01:53:53.364 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:53.391 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:53.490 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:53.616 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:53.639 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T01:53:53.661 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T01:53:53.667 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:53.697 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:53.716 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T01:53:53.731 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T01:53:53.733 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:53.765 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:53.796 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:53.843 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:53.922 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:53.923 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T01:53:53.966 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T01:53:53.983 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:53.986 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:54.020 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T01:53:54.024 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:54.036 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T01:53:54.048 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:54.078 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:54.113 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:54.174 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:54.265 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:54.269 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T01:53:54.286 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:54.301 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:54.327 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:54.418 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:54.423 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T01:53:54.451 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:54.490 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:54.500 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T01:53:54.561 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:54.688 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:54.701 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T01:53:54.716 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T01:53:54.759 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:54.840 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:54.848 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T01:53:54.949 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:55.012 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T01:53:55.028 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T01:53:55.050 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:55.070 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:55.176 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:55.302 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:55.428 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:55.457 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:55.554 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:55.581 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T01:53:55.643 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T01:53:55.683 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T01:53:55.714 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:55.784 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T01:53:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:55.910 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T01:53:55.967 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:55.975 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:55.982 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:56.024 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:56.036 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T01:53:56.163 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:56.289 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T01:53:56.377 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T01:53:56.440 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T01:53:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:56.551 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:56.552 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T01:53:56.694 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T01:53:57.219 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:57.672 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:57.938 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T01:53:58.448 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T01:53:58.452 DEBUG:teuthology.parallel:result is None 2024-09-17T01:53:58.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:53:58.598 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-query -W -f '${Version}' ceph 2024-09-17T01:53:58.618 INFO:teuthology.orchestra.run.smithi063.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:58.619 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:58.619 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T01:53:58.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:53:58.765 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-09-17T01:53:58.784 INFO:teuthology.orchestra.run.smithi096.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:58.784 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:58.784 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T01:53:58.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:53:58.930 DEBUG:teuthology.orchestra.run.smithi098:> dpkg-query -W -f '${Version}' ceph 2024-09-17T01:53:58.949 INFO:teuthology.orchestra.run.smithi098.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:58.950 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:58.950 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T01:53:58.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:53:59.097 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-09-17T01:53:59.116 INFO:teuthology.orchestra.run.smithi154.stdout:19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:59.116 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330-gc2ddf972-1jammy 2024-09-17T01:53:59.116 INFO:teuthology.task.install:The correct ceph version 19.1.1-330-gc2ddf972-1jammy is installed. 2024-09-17T01:53:59.118 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T01:53:59.118 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:53:59.119 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:53:59.134 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:53:59.134 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:53:59.149 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:53:59.149 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:53:59.163 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:53:59.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:53:59.178 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T01:53:59.178 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:53:59.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:53:59.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:53:59.246 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:53:59.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:53:59.260 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:53:59.314 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:53:59.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:53:59.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:53:59.381 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:53:59.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:53:59.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:53:59.450 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T01:53:59.450 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:53:59.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:53:59.463 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:53:59.519 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:53:59.519 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:53:59.532 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:53:59.588 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:53:59.588 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:53:59.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:53:59.657 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:53:59.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:53:59.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:53:59.727 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T01:53:59.728 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:53:59.728 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:53:59.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:53:59.799 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:53:59.799 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:53:59.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:53:59.866 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:53:59.866 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:53:59.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:53:59.933 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:53:59.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:53:59.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:54:00.005 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T01:54:00.094 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T01:54:00.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-17T01:54:00.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-09-17T01:54:00.100 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-17T01:54:00.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-17T01:54:00.114 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T01:54:00.115 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T01:54:00.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T01:54:00.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T01:54:00.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T01:54:00.170 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T01:54:00.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T01:54:00.204 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T01:54:00.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T01:54:00.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T01:54:00.240 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T01:54:00.240 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T01:54:00.240 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7908069', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 4845, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227', 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVzX1wRa0KcNN8tpej7whpwidjX2bO4hXQkbwwZK1up2JqY9/uNDrBAK8cujxRC6eWwb2d6wd6qXPtGchJsVsY=', 'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOVvnEWvJTFHkTdDXxlA0+UKTHfPuaoxSBKgDOb//dhyPnyLK9wtDGZjUkOof6T7YM9VLM9neRsPzAX0dVSU08=', 'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBBUsHi0pqz/Ngr+RW7KYg1YMeyTWYxjPru326sFBG2hU7PiZn7tmfxh9JdZOTdZLmJVx62JnZ0X6peN3yPVQ6c=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUkIiakwwsU/0sA5XovXUbzcUzAghsdqjHgYGfev+TEQ2OVzVtSFD5PQv9jIl+QLQGtiM5beeGVoqEAF0bzA30='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T01:54:00.241 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T01:54:00.259 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T01:54:00.268 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T01:54:00.274 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T01:54:00.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:54:00.307 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:54:00.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:54:00.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:54:00.337 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:54:00.337 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:54:00.375 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:54:00.376 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-09-17T01:54:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:54:00.423 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:00.424 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-17T01:54:00.424 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:00.424 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-17 01:48:13.986446286 +0000 2024-09-17T01:54:00.424 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-17 01:48:13.982446321 +0000 2024-09-17T01:54:00.424 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-17 01:48:13.982446321 +0000 2024-09-17T01:54:00.424 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-17T01:54:00.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:54:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-17T01:54:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-17T01:54:00.477 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000373111 s, 1.4 MB/s 2024-09-17T01:54:00.478 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:54:00.529 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-09-17T01:54:00.575 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:54:00.575 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:00.575 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-17T01:54:00.575 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:00.575 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-17 01:48:14.742439533 +0000 2024-09-17T01:54:00.575 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-17 01:48:14.490441784 +0000 2024-09-17T01:54:00.576 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-17 01:48:14.490441784 +0000 2024-09-17T01:54:00.576 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-17T01:54:00.576 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:54:00.632 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-17T01:54:00.632 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-17T01:54:00.632 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000440564 s, 1.2 MB/s 2024-09-17T01:54:00.633 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:54:00.680 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-17 01:48:15.226435210 +0000 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-17 01:48:14.974437461 +0000 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-17 01:48:14.974437461 +0000 2024-09-17T01:54:00.727 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-17T01:54:00.728 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:54:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-17T01:54:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-17T01:54:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000417634 s, 1.2 MB/s 2024-09-17T01:54:00.783 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:54:00.832 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-17 01:48:15.726430744 +0000 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-17 01:48:15.466433066 +0000 2024-09-17T01:54:00.879 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-17 01:48:15.466433066 +0000 2024-09-17T01:54:00.880 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-17T01:54:00.880 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:54:00.933 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-17T01:54:00.934 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-17T01:54:00.934 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000387434 s, 1.3 MB/s 2024-09-17T01:54:00.935 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:54:00.984 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-17T01:54:00.984 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:54:00.984 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:54:00.990 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:54:00.991 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-17T01:54:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:54:01.038 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.038 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 862 Links: 1 2024-09-17T01:54:01.038 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.038 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 01:48:14.226593560 +0000 2024-09-17T01:54:01.038 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 01:48:13.966595882 +0000 2024-09-17T01:54:01.039 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 01:48:13.966595882 +0000 2024-09-17T01:54:01.039 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-17T01:54:01.039 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:54:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T01:54:01.093 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T01:54:01.093 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000443346 s, 1.2 MB/s 2024-09-17T01:54:01.094 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:54:01.143 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-17T01:54:01.189 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 01:48:14.702589307 +0000 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 01:48:14.442591631 +0000 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 01:48:14.442591631 +0000 2024-09-17T01:54:01.190 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-17T01:54:01.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:54:01.244 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T01:54:01.244 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T01:54:01.244 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000305385 s, 1.7 MB/s 2024-09-17T01:54:01.245 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:54:01.295 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 01:48:14.938587201 +0000 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 01:48:14.934587236 +0000 2024-09-17T01:54:01.342 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 01:48:14.934587236 +0000 2024-09-17T01:54:01.343 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-17T01:54:01.343 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:54:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T01:54:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T01:54:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00036463 s, 1.4 MB/s 2024-09-17T01:54:01.397 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:54:01.447 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-17T01:54:01.493 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 01:48:15.674580627 +0000 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 01:48:15.422582878 +0000 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 01:48:15.422582878 +0000 2024-09-17T01:54:01.494 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-17T01:54:01.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:54:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T01:54:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T01:54:01.548 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000271294 s, 1.9 MB/s 2024-09-17T01:54:01.549 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:54:01.599 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-17T01:54:01.599 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:54:01.599 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:54:01.605 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:54:01.605 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 01:48:16.454804580 +0000 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 01:48:16.218806689 +0000 2024-09-17T01:54:01.652 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 01:48:16.218806689 +0000 2024-09-17T01:54:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T01:54:01.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:54:01.706 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T01:54:01.706 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T01:54:01.706 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000442816 s, 1.2 MB/s 2024-09-17T01:54:01.707 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:54:01.756 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-17T01:54:01.803 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:54:01.803 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.803 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-17T01:54:01.803 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.803 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 01:48:16.970799970 +0000 2024-09-17T01:54:01.803 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 01:48:16.722802186 +0000 2024-09-17T01:54:01.804 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 01:48:16.722802186 +0000 2024-09-17T01:54:01.804 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T01:54:01.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:54:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T01:54:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T01:54:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000418166 s, 1.2 MB/s 2024-09-17T01:54:01.859 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:54:01.908 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 01:48:17.470795506 +0000 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 01:48:17.206797862 +0000 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 01:48:17.206797862 +0000 2024-09-17T01:54:01.959 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T01:54:01.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:54:02.017 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T01:54:02.017 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T01:54:02.017 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000437607 s, 1.2 MB/s 2024-09-17T01:54:02.018 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:54:02.068 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-17T01:54:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:54:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:54:02.116 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-17T01:54:02.116 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:54:02.116 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-17 01:48:17.978790967 +0000 2024-09-17T01:54:02.116 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-17 01:48:17.702793432 +0000 2024-09-17T01:54:02.116 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-17 01:48:17.702793432 +0000 2024-09-17T01:54:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-17T01:54:02.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:54:02.170 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-17T01:54:02.170 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-17T01:54:02.170 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000385144 s, 1.3 MB/s 2024-09-17T01:54:02.171 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:54:02.220 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-17T01:54:02.220 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-17T01:54:02.220 INFO:tasks.ceph:Generating config... 2024-09-17T01:54:02.222 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T01:54:02.222 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T01:54:02.222 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T01:54:02.222 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T01:54:02.222 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T01:54:02.222 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T01:54:02.222 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-17T01:54:02.222 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-17T01:54:02.222 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T01:54:02.222 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T01:54:02.222 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T01:54:02.223 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T01:54:02.223 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T01:54:02.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T01:54:02.258 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T01:54:02.268 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T01:54:02.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:54:02.403 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '[v2:172.21.15.63:3301,v1:172.21.15.63:6790]'), ('mon.c', '[v2:172.21.15.63:3302,v1:172.21.15.63:6791]')] 2024-09-17T01:54:02.403 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-09-17T01:54:02.404 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:02.404 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T01:54:02.451 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --addv b '[v2:172.21.15.63:3301,v1:172.21.15.63:6790]' --addv c '[v2:172.21.15.63:3302,v1:172.21.15.63:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:02.539 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:02.539 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-17T01:54:02.539597+0000 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-17T01:54:02.539597+0000 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.b 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.c 2024-09-17T01:54:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T01:54:02.541 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T01:54:02.546 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7af2c608-be6c-4ac4-a462-cff6aa13e357... 2024-09-17T01:54:02.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:54:02.591 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:54:02.594 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:54:02.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.620 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.621 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.622 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791]" 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-17T01:54:02.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore compression algorithm = zstd 2024-09-17T01:54:02.625 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore compression mode = aggressive 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: osd blocked scrub grace period = 3600 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: osd max markdown count = 1000 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-17T01:54:02.626 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-17T01:54:02.627 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:54:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:54:02.629 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-17T01:54:02.630 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-09-17T01:54:02.630 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-09-17T01:54:02.630 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-17T01:54:02.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-17T01:54:02.632 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.633 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791]" 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-09-17T01:54:02.634 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.635 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression algorithm = zstd 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression mode = aggressive 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-09-17T01:54:02.636 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-17T01:54:02.637 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-17T01:54:02.639 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-17T01:54:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:54:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791]" 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-17T01:54:02.643 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-17T01:54:02.644 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression algorithm = zstd 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression mode = aggressive 2024-09-17T01:54:02.645 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: osd blocked scrub grace period = 3600 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: osd max markdown count = 1000 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-17T01:54:02.646 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.647 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:54:02.648 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-09-17T01:54:02.649 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.650 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-09-17T01:54:02.651 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791]" 2024-09-17T01:54:02.652 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-09-17T01:54:02.653 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.654 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression algorithm = zstd 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 1/20 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 1/20 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 4/10 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: osd blocked scrub grace period = 3600 2024-09-17T01:54:02.655 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: osd max markdown count = 1000 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-09-17T01:54:02.656 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.657 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-09-17T01:54:02.658 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-09-17T01:54:02.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-09-17T01:54:02.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-09-17T01:54:02.661 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T01:54:02.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T01:54:02.752 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T01:54:02.752 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:02.752 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T01:54:02.757 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:02.757 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T01:54:02.807 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T01:54:02.807 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:02.807 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T01:54:02.807 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:54:02.872 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:02.872 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:02.919 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-09-17T01:54:02.919 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:54:02.919 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T01:54:02.919 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:54:02.944 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:54:02.944 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:02.991 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T01:54:02.992 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:54:02.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T01:54:02.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:54:03.014 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:54:03.015 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:03.062 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:54:03.062 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:54:03.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T01:54:03.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:54:03.086 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:54:03.086 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:03.131 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T01:54:03.132 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T01:54:03.132 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T01:54:03.178 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T01:54:03.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T01:54:03.225 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T01:54:03.228 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T01:54:03.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T01:54:03.310 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T01:54:03.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T01:54:03.365 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T01:54:03.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T01:54:03.445 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T01:54:03.458 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T01:54:03.458 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-17T01:54:03.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T01:54:03.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-17T01:54:03.472 INFO:tasks.ceph:role: osd.0 2024-09-17T01:54:03.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-17T01:54:03.473 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T01:54:03.535 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:54:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:54:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:54:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T01:54:03.536 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:54:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:54:03.536 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:54:03.536 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T01:54:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:54:03.536 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:54:03.990 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-17T01:54:03.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-17T01:54:03.993 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T01:54:04.085 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T01:54:04.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:54:04.097 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T01:54:04.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-17T01:54:04.206+0000 7f1ff17e77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T01:54:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-17T01:54:04.206+0000 7f1ff17e77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T01:54:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-17T01:54:04.206+0000 7f1ff17e77c0 -1 bdev(0x5603e4271800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T01:54:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-17T01:54:04.206+0000 7f1ff17e77c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T01:54:07.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:54:07.372 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T01:54:07.386 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-17T01:54:07.386 INFO:tasks.ceph:role: osd.1 2024-09-17T01:54:07.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T01:54:07.386 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:54:07.449 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:54:07.450 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T01:54:07.450 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:54:07.450 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:54:07.905 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T01:54:07.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T01:54:07.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-17T01:54:08.036 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T01:54:08.047 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T01:54:08.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:54:08.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:08.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T01:54:08.155+0000 7f6ab70cf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T01:54:08.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T01:54:08.155+0000 7f6ab70cf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T01:54:08.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T01:54:08.155+0000 7f6ab70cf7c0 -1 bdev(0x55fb834a1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T01:54:08.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T01:54:08.155+0000 7f6ab70cf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T01:54:11.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:54:11.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T01:54:11.352 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-17T01:54:11.352 INFO:tasks.ceph:role: osd.2 2024-09-17T01:54:11.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:54:11.353 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T01:54:11.414 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:54:11.414 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:54:11.414 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:54:11.414 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T01:54:11.415 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:54:11.415 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:54:11.415 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:54:11.415 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T01:54:11.415 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:54:11.415 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:54:11.867 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-17T01:54:11.869 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-17T01:54:11.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-17T01:54:11.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T01:54:11.968 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T01:54:11.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:54:11.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T01:54:12.074+0000 7ff76f9047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T01:54:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T01:54:12.082+0000 7ff76f9047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T01:54:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T01:54:12.082+0000 7ff76f9047c0 -1 bdev(0x55ff8d907800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T01:54:12.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-17T01:54:12.082+0000 7ff76f9047c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T01:54:15.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:54:15.356 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T01:54:15.357 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:15.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T01:54:15.371 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:15.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T01:54:15.428 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:15.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T01:54:15.482 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:54:15.483 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T01:54:15.497 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:54:15.497 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T01:54:15.510 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:54:15.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T01:54:15.526 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:54:15.527 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T01:54:15.533 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T01:54:15.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T01:54:15.585 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA74ehmOCSqChAADy6W9qrJKDeE5hwwGJCV5g== 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA74ehmG7VxDRAALkUnXrYdpYqNebfARyrb6Q== 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA74ehmVnWAEhAAZw1IeV43pu4V42T0OPkXDA== 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA84ehmMyuNDBAArXcWrk6EabGfhc+nB8Po/w== 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBA4ehmU9N5CRAAuqK1BCvDQa6gR4xGKe6PYg== 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBE4ehmnHrWBBAAy4pC6tpfdIcikrwO+LYjtg== 2024-09-17T01:54:15.586 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-17T01:54:15.587 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA74ehmZTGTGhAAPlC74YrhCHE3ciiHqzooAg== 2024-09-17T01:54:15.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T01:54:15.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T01:54:15.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:54:15.806 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:54:15.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:54:15.979 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:54:16.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:54:16.110 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T01:54:16.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T01:54:16.121 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T01:54:16.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T01:54:16.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T01:54:16.296 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T01:54:16.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T01:54:16.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T01:54:16.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T01:54:16.536 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T01:54:16.549 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:54:16.594 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T01:54:16.594 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T01:54:16.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T01:54:16.639 INFO:tasks.ceph.mon.a:Started 2024-09-17T01:54:16.640 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T01:54:16.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T01:54:16.642 INFO:tasks.ceph.mon.b:Started 2024-09-17T01:54:16.642 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T01:54:16.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T01:54:16.645 INFO:tasks.ceph.mon.c:Started 2024-09-17T01:54:16.645 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T01:54:16.645 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T01:54:16.645 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T01:54:16.647 INFO:tasks.ceph.mgr.x:Started 2024-09-17T01:54:16.647 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T01:54:16.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T01:54:16.649 INFO:tasks.ceph.mgr.y:Started 2024-09-17T01:54:16.649 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T01:54:16.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T01:54:22.880 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-17T01:54:22.901 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T01:54:22.901 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T01:54:22.902 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-17T01:54:22.902 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T01:54:22.916 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T01:54:22.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T01:54:22.930 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-17T01:54:22.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T01:54:22.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 321981a6-5caa-44f3-b6ae-aa4e97947db6 0 2024-09-17T01:54:23.009 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:23.006+0000 7f2c06b52180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:54:23.013 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:23.010+0000 7f73a2b2e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T01:54:23.224 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-17T01:54:23.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 36930e57-781c-48b6-a499-40cb00df2f38 1 2024-09-17T01:54:23.464 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-17T01:54:23.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 5a5a5a07-1fcd-4160-a4b1-e8431052e44c 2 2024-09-17T01:54:23.610 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:23.610+0000 7f2c06b52180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:54:23.622 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:23.618+0000 7f73a2b2e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T01:54:23.683 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-17T01:54:23.701 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T01:54:23.702 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T01:54:23.704 INFO:tasks.ceph.osd.0:Started 2024-09-17T01:54:23.704 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T01:54:23.704 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T01:54:23.707 INFO:tasks.ceph.osd.1:Started 2024-09-17T01:54:23.707 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T01:54:23.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T01:54:23.709 INFO:tasks.ceph.osd.2:Started 2024-09-17T01:54:23.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:23.892 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:23.893 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:23.678756+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:23.908 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T01:54:23.909 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T01:54:23.944 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:23.942+0000 7f73a2b2e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:54:23.945 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:23.942+0000 7f2c06b52180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T01:54:24.211 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:24.417 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-17T01:54:24.418 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":5,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:23.678756+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:24.434 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-17T01:54:24.552 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.550+0000 7f2c06b52180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:54:24.553 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.550+0000 7f73a2b2e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T01:54:24.609 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.606+0000 7f73a2b2e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:54:24.610 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.606+0000 7f2c06b52180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T01:54:24.665 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.662+0000 7f2c06b52180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:54:24.665 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.662+0000 7f73a2b2e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T01:54:24.747 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.746+0000 7f73a2b2e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:54:24.748 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.746+0000 7f2c06b52180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T01:54:24.768 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:54:24.770+0000 7f63430f77c0 -1 Falling back to public interface 2024-09-17T01:54:24.780 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:54:24.785+0000 7fd0f464e7c0 -1 Falling back to public interface 2024-09-17T01:54:24.790 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:54:24.787+0000 7fcab15007c0 -1 Falling back to public interface 2024-09-17T01:54:24.803 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.802+0000 7f2c06b52180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:54:24.803 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.802+0000 7f73a2b2e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T01:54:24.886 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.882+0000 7f2c06b52180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:54:24.886 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.886+0000 7f73a2b2e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T01:54:24.942 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:24.942+0000 7f73a2b2e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:54:24.943 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:24.942+0000 7f2c06b52180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T01:54:25.103 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:25.102+0000 7f73a2b2e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:54:25.104 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:25.102+0000 7f2c06b52180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T01:54:25.169 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:25.166+0000 7f2c06b52180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:54:25.169 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:25.166+0000 7f73a2b2e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T01:54:25.799 INFO:tasks.ceph.mgr.x.smithi063.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T01:54:25.799 INFO:tasks.ceph.mgr.x.smithi063.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T01:54:25.799 INFO:tasks.ceph.mgr.x.smithi063.stderr: from numpy import show_config as show_numpy_config 2024-09-17T01:54:25.799 INFO:tasks.ceph.mgr.y.smithi063.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T01:54:25.800 INFO:tasks.ceph.mgr.y.smithi063.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T01:54:25.800 INFO:tasks.ceph.mgr.y.smithi063.stderr: from numpy import show_config as show_numpy_config 2024-09-17T01:54:25.853 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:25.849+0000 7f2c06b52180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:54:25.860 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:25.857+0000 7f73a2b2e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T01:54:26.022 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:26.017+0000 7f2c06b52180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:54:26.044 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:26.041+0000 7f73a2b2e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:54:26.299 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:26.297+0000 7f73a2b2e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:54:26.303 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:26.301+0000 7f2c06b52180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T01:54:26.368 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:26.365+0000 7f73a2b2e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:54:26.380 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:26.377+0000 7f2c06b52180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T01:54:26.515 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:26.513+0000 7f73a2b2e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:54:26.521 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:26.517+0000 7f2c06b52180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T01:54:27.225 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:27.221+0000 7f2c06b52180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:54:27.226 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:27.221+0000 7f73a2b2e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T01:54:27.306 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:27.301+0000 7f2c06b52180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:54:27.306 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:27.301+0000 7f73a2b2e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T01:54:27.499 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:27.497+0000 7f2c06b52180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:54:27.500 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:27.497+0000 7f73a2b2e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T01:54:27.577 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:27.573+0000 7f2c06b52180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:54:27.594 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:27.593+0000 7f73a2b2e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T01:54:27.888 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:27.885+0000 7f2c06b52180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:54:27.894 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:27.889+0000 7f73a2b2e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T01:54:27.953 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-17T01:54:27.949+0000 7f2c06b52180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:54:27.954 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:27.949+0000 7f73a2b2e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T01:54:28.632 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:54:28.634+0000 7f63430f77c0 -1 osd.0 0 log_to_monitors true 2024-09-17T01:54:28.664 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:54:28.669+0000 7fd0f464e7c0 -1 osd.2 0 log_to_monitors true 2024-09-17T01:54:28.668 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:54:28.663+0000 7fcab15007c0 -1 osd.1 0 log_to_monitors true 2024-09-17T01:54:28.990 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:28.989+0000 7f7349668640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T01:54:28.991 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-09-17T01:54:28.989+0000 7f7349668640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T01:54:30.737 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:30.858 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:54:30.858+0000 7f633f8b2640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T01:54:30.867 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:54:30.863+0000 7fcaadcbb640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T01:54:30.875 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:54:30.878+0000 7f6336ed5640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:54:30.898 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:54:30.895+0000 7fcaa52de640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:54:31.003 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:54:31.009+0000 7fd0f05f7640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T01:54:31.031 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:54:31.037+0000 7fd0e842c640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:54:31.046 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-17T01:54:31.046 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":7,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:30.034535+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:31.065 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-17T01:54:37.368 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:37.669 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-17T01:54:37.669 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":11,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:34.876848+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:37.687 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-17T01:54:37.687 INFO:tasks.ceph:Creating RBD pool 2024-09-17T01:54:37.687 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T01:54:39.009 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'rbd' created 2024-09-17T01:54:39.031 DEBUG:teuthology.orchestra.run.smithi063:> rbd --cluster ceph pool init rbd 2024-09-17T01:54:42.068 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T01:54:42.068 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:54:42.068 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:54:42.070 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:54:42.071 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T01:54:42.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:54:42.157 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-17T01:54:42.404 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:42.404 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"btime":"2024-09-17T01:54:42:179197+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T01:54:42.404 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-09-17T01:54:42.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:54:42.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:42.711 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-17T01:54:42.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:54:42.711 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 2, 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": "rbd" 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:54:42.712 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-17T01:54:42.730 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:54:42.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:54:43.189 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-17T01:54:43.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:54:44.193 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-17T01:54:44.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:54:45.199 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 3 and data pool 4 2024-09-17T01:54:45.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:45.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:45.526 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:44.554875+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:45.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:45.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:45.848 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:44.554875+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:45.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:54:47.185 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-09-17T01:54:47.181+0000 7f6a3f717640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:54:47.234 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:54:47.235 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:54:48.244 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:54:48.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:54:48.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:48.582 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:54:44.555579+0000","modified":"2024-09-17T01:54:47.580458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4208,"qdb_cluster":[4208]},"id":1}]} 2024-09-17T01:54:48.583 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-17T01:54:48.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:48.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:48.895 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:46.062690+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:48.913 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:54:48.914 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:54:49.222 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:49.225 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:54:49.238 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T01:54:47.974168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":249,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90064,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025456,"statfs":{"total":289910292480,"available":289818066944,"internally_reserved":0,"allocated":671744,"data_stored":1357981,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.102687+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:54:45.102687+0000","last_peered":"2024-09-17T01:54:45.102687+0000","last_clean":"2024-09-17T01:54:45.102687+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:54:45.102687+0000","last_undegraded":"2024-09-17T01:54:45.102687+0000","last_fullsized":"2024-09-17T01:54:45.102687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:09.295310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.102898+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:54:45.102898+0000","last_peered":"2024-09-17T01:54:45.102898+0000","last_clean":"2024-09-17T01:54:45.102898+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:54:45.102898+0000","last_undegraded":"2024-09-17T01:54:45.102898+0000","last_fullsized":"2024-09-17T01:54:45.102898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:15.314431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085172+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:54:46.085172+0000","last_peered":"2024-09-17T01:54:46.085172+0000","last_clean":"2024-09-17T01:54:46.085172+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:54:46.085172+0000","last_undegraded":"2024-09-17T01:54:46.085172+0000","last_fullsized":"2024-09-17T01:54:46.085172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086124+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:54:46.086124+0000","last_peered":"2024-09-17T01:54:46.086124+0000","last_clean":"2024-09-17T01:54:46.086124+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:54:46.086124+0000","last_undegraded":"2024-09-17T01:54:46.086124+0000","last_fullsized":"2024-09-17T01:54:46.086124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093271+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:54:45.093271+0000","last_peered":"2024-09-17T01:54:45.093271+0000","last_clean":"2024-09-17T01:54:45.093271+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:54:45.093271+0000","last_undegraded":"2024-09-17T01:54:45.093271+0000","last_fullsized":"2024-09-17T01:54:45.093271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:08.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085234+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:54:46.085234+0000","last_peered":"2024-09-17T01:54:46.085234+0000","last_clean":"2024-09-17T01:54:46.085234+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:54:46.085234+0000","last_undegraded":"2024-09-17T01:54:46.085234+0000","last_fullsized":"2024-09-17T01:54:46.085234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084719+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:54:46.084719+0000","last_peered":"2024-09-17T01:54:46.084719+0000","last_clean":"2024-09-17T01:54:46.084719+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:54:46.084719+0000","last_undegraded":"2024-09-17T01:54:46.084719+0000","last_fullsized":"2024-09-17T01:54:46.084719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084228+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:54:46.084228+0000","last_peered":"2024-09-17T01:54:46.084228+0000","last_clean":"2024-09-17T01:54:46.084228+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:54:46.084228+0000","last_undegraded":"2024-09-17T01:54:46.084228+0000","last_fullsized":"2024-09-17T01:54:46.084228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147269+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:54:46.147269+0000","last_peered":"2024-09-17T01:54:46.147269+0000","last_clean":"2024-09-17T01:54:46.147269+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:54:46.147269+0000","last_undegraded":"2024-09-17T01:54:46.147269+0000","last_fullsized":"2024-09-17T01:54:46.147269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.102631+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:54:45.102631+0000","last_peered":"2024-09-17T01:54:45.102631+0000","last_clean":"2024-09-17T01:54:45.102631+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:54:45.102631+0000","last_undegraded":"2024-09-17T01:54:45.102631+0000","last_fullsized":"2024-09-17T01:54:45.102631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:52.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086169+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:54:46.086169+0000","last_peered":"2024-09-17T01:54:46.086169+0000","last_clean":"2024-09-17T01:54:46.086169+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:54:46.086169+0000","last_undegraded":"2024-09-17T01:54:46.086169+0000","last_fullsized":"2024-09-17T01:54:46.086169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096841+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:54:45.096841+0000","last_peered":"2024-09-17T01:54:45.096841+0000","last_clean":"2024-09-17T01:54:45.096841+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:54:45.096841+0000","last_undegraded":"2024-09-17T01:54:45.096841+0000","last_fullsized":"2024-09-17T01:54:45.096841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:25.923729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.091360+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:54:45.091360+0000","last_peered":"2024-09-17T01:54:45.091360+0000","last_clean":"2024-09-17T01:54:45.091360+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:54:45.091360+0000","last_undegraded":"2024-09-17T01:54:45.091360+0000","last_fullsized":"2024-09-17T01:54:45.091360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:48.625172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084990+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:54:46.084990+0000","last_peered":"2024-09-17T01:54:46.084990+0000","last_clean":"2024-09-17T01:54:46.084990+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:54:46.084990+0000","last_undegraded":"2024-09-17T01:54:46.084990+0000","last_fullsized":"2024-09-17T01:54:46.084990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084800+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:54:46.084800+0000","last_peered":"2024-09-17T01:54:46.084800+0000","last_clean":"2024-09-17T01:54:46.084800+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:54:46.084800+0000","last_undegraded":"2024-09-17T01:54:46.084800+0000","last_fullsized":"2024-09-17T01:54:46.084800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084333+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:54:46.084333+0000","last_peered":"2024-09-17T01:54:46.084333+0000","last_clean":"2024-09-17T01:54:46.084333+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:54:46.084333+0000","last_undegraded":"2024-09-17T01:54:46.084333+0000","last_fullsized":"2024-09-17T01:54:46.084333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148704+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:54:46.148704+0000","last_peered":"2024-09-17T01:54:46.148704+0000","last_clean":"2024-09-17T01:54:46.148704+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:54:46.148704+0000","last_undegraded":"2024-09-17T01:54:46.148704+0000","last_fullsized":"2024-09-17T01:54:46.148704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093914+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:54:45.093914+0000","last_peered":"2024-09-17T01:54:45.093914+0000","last_clean":"2024-09-17T01:54:45.093914+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:54:45.093914+0000","last_undegraded":"2024-09-17T01:54:45.093914+0000","last_fullsized":"2024-09-17T01:54:45.093914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:06.413999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146947+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:54:46.146947+0000","last_peered":"2024-09-17T01:54:46.146947+0000","last_clean":"2024-09-17T01:54:46.146947+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:54:46.146947+0000","last_undegraded":"2024-09-17T01:54:46.146947+0000","last_fullsized":"2024-09-17T01:54:46.146947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086067+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:54:46.086067+0000","last_peered":"2024-09-17T01:54:46.086067+0000","last_clean":"2024-09-17T01:54:46.086067+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:54:46.086067+0000","last_undegraded":"2024-09-17T01:54:46.086067+0000","last_fullsized":"2024-09-17T01:54:46.086067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085634+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:54:46.085634+0000","last_peered":"2024-09-17T01:54:46.085634+0000","last_clean":"2024-09-17T01:54:46.085634+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:54:46.085634+0000","last_undegraded":"2024-09-17T01:54:46.085634+0000","last_fullsized":"2024-09-17T01:54:46.085634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096677+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:54:45.096677+0000","last_peered":"2024-09-17T01:54:45.096677+0000","last_clean":"2024-09-17T01:54:45.096677+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:54:45.096677+0000","last_undegraded":"2024-09-17T01:54:45.096677+0000","last_fullsized":"2024-09-17T01:54:45.096677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:19.809823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.145561+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:54:46.145561+0000","last_peered":"2024-09-17T01:54:46.145561+0000","last_clean":"2024-09-17T01:54:46.145561+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:54:46.145561+0000","last_undegraded":"2024-09-17T01:54:46.145561+0000","last_fullsized":"2024-09-17T01:54:46.145561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.101616+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:54:45.101616+0000","last_peered":"2024-09-17T01:54:45.101616+0000","last_clean":"2024-09-17T01:54:45.101616+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:54:45.101616+0000","last_undegraded":"2024-09-17T01:54:45.101616+0000","last_fullsized":"2024-09-17T01:54:45.101616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:26.171276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096939+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:54:45.096939+0000","last_peered":"2024-09-17T01:54:45.096939+0000","last_clean":"2024-09-17T01:54:45.096939+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:54:45.096939+0000","last_undegraded":"2024-09-17T01:54:45.096939+0000","last_fullsized":"2024-09-17T01:54:45.096939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:55.312874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147687+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:54:46.147687+0000","last_peered":"2024-09-17T01:54:46.147687+0000","last_clean":"2024-09-17T01:54:46.147687+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:54:46.147687+0000","last_undegraded":"2024-09-17T01:54:46.147687+0000","last_fullsized":"2024-09-17T01:54:46.147687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086599+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:54:46.086599+0000","last_peered":"2024-09-17T01:54:46.086599+0000","last_clean":"2024-09-17T01:54:46.086599+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:54:46.086599+0000","last_undegraded":"2024-09-17T01:54:46.086599+0000","last_fullsized":"2024-09-17T01:54:46.086599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096780+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:54:45.096780+0000","last_peered":"2024-09-17T01:54:45.096780+0000","last_clean":"2024-09-17T01:54:45.096780+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:54:45.096780+0000","last_undegraded":"2024-09-17T01:54:45.096780+0000","last_fullsized":"2024-09-17T01:54:45.096780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:16.504577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148207+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:54:46.148207+0000","last_peered":"2024-09-17T01:54:46.148207+0000","last_clean":"2024-09-17T01:54:46.148207+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:54:46.148207+0000","last_undegraded":"2024-09-17T01:54:46.148207+0000","last_fullsized":"2024-09-17T01:54:46.148207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.090079+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:54:45.090079+0000","last_peered":"2024-09-17T01:54:45.090079+0000","last_clean":"2024-09-17T01:54:45.090079+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:54:45.090079+0000","last_undegraded":"2024-09-17T01:54:45.090079+0000","last_fullsized":"2024-09-17T01:54:45.090079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:57.435947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.145745+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:54:46.145745+0000","last_peered":"2024-09-17T01:54:46.145745+0000","last_clean":"2024-09-17T01:54:46.145745+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:54:46.145745+0000","last_undegraded":"2024-09-17T01:54:46.145745+0000","last_fullsized":"2024-09-17T01:54:46.145745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084709+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:54:46.084709+0000","last_peered":"2024-09-17T01:54:46.084709+0000","last_clean":"2024-09-17T01:54:46.084709+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:54:46.084709+0000","last_undegraded":"2024-09-17T01:54:46.084709+0000","last_fullsized":"2024-09-17T01:54:46.084709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093641+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:54:45.093641+0000","last_peered":"2024-09-17T01:54:45.093641+0000","last_clean":"2024-09-17T01:54:45.093641+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:54:45.093641+0000","last_undegraded":"2024-09-17T01:54:45.093641+0000","last_fullsized":"2024-09-17T01:54:45.093641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:23.676146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086624+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:54:46.086624+0000","last_peered":"2024-09-17T01:54:46.086624+0000","last_clean":"2024-09-17T01:54:46.086624+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:54:46.086624+0000","last_undegraded":"2024-09-17T01:54:46.086624+0000","last_fullsized":"2024-09-17T01:54:46.086624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.089763+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:54:45.089763+0000","last_peered":"2024-09-17T01:54:45.089763+0000","last_clean":"2024-09-17T01:54:45.089763+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:54:45.089763+0000","last_undegraded":"2024-09-17T01:54:45.089763+0000","last_fullsized":"2024-09-17T01:54:45.089763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:00.838463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146719+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:54:46.146719+0000","last_peered":"2024-09-17T01:54:46.146719+0000","last_clean":"2024-09-17T01:54:46.146719+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:54:46.146719+0000","last_undegraded":"2024-09-17T01:54:46.146719+0000","last_fullsized":"2024-09-17T01:54:46.146719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148451+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:54:46.148451+0000","last_peered":"2024-09-17T01:54:46.148451+0000","last_clean":"2024-09-17T01:54:46.148451+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:54:46.148451+0000","last_undegraded":"2024-09-17T01:54:46.148451+0000","last_fullsized":"2024-09-17T01:54:46.148451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.074337+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:54:45.074337+0000","last_peered":"2024-09-17T01:54:45.074337+0000","last_clean":"2024-09-17T01:54:45.074337+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:54:45.074337+0000","last_undegraded":"2024-09-17T01:54:45.074337+0000","last_fullsized":"2024-09-17T01:54:45.074337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147645+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:54:46.147645+0000","last_peered":"2024-09-17T01:54:46.147645+0000","last_clean":"2024-09-17T01:54:46.147645+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:54:46.147645+0000","last_undegraded":"2024-09-17T01:54:46.147645+0000","last_fullsized":"2024-09-17T01:54:46.147645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084599+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:54:46.084599+0000","last_peered":"2024-09-17T01:54:46.084599+0000","last_clean":"2024-09-17T01:54:46.084599+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:54:46.084599+0000","last_undegraded":"2024-09-17T01:54:46.084599+0000","last_fullsized":"2024-09-17T01:54:46.084599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085662+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:54:46.085662+0000","last_peered":"2024-09-17T01:54:46.085662+0000","last_clean":"2024-09-17T01:54:46.085662+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:54:46.085662+0000","last_undegraded":"2024-09-17T01:54:46.085662+0000","last_fullsized":"2024-09-17T01:54:46.085662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.097481+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:54:45.097481+0000","last_peered":"2024-09-17T01:54:45.097481+0000","last_clean":"2024-09-17T01:54:45.097481+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:54:45.097481+0000","last_undegraded":"2024-09-17T01:54:45.097481+0000","last_fullsized":"2024-09-17T01:54:45.097481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:21.568878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.210692+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:54:45.210692+0000","last_peered":"2024-09-17T01:54:45.210692+0000","last_clean":"2024-09-17T01:54:45.210692+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:54:45.210692+0000","last_undegraded":"2024-09-17T01:54:45.210692+0000","last_fullsized":"2024-09-17T01:54:45.210692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.088420+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:54:45.088420+0000","last_peered":"2024-09-17T01:54:45.088420+0000","last_clean":"2024-09-17T01:54:45.088420+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:54:45.088420+0000","last_undegraded":"2024-09-17T01:54:45.088420+0000","last_fullsized":"2024-09-17T01:54:45.088420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:00.532293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087126+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:54:46.087126+0000","last_peered":"2024-09-17T01:54:46.087126+0000","last_clean":"2024-09-17T01:54:46.087126+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:54:46.087126+0000","last_undegraded":"2024-09-17T01:54:46.087126+0000","last_fullsized":"2024-09-17T01:54:46.087126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086153+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:54:46.086153+0000","last_peered":"2024-09-17T01:54:46.086153+0000","last_clean":"2024-09-17T01:54:46.086153+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:54:46.086153+0000","last_undegraded":"2024-09-17T01:54:46.086153+0000","last_fullsized":"2024-09-17T01:54:46.086153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086752+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:54:46.086752+0000","last_peered":"2024-09-17T01:54:46.086752+0000","last_clean":"2024-09-17T01:54:46.086752+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:54:46.086752+0000","last_undegraded":"2024-09-17T01:54:46.086752+0000","last_fullsized":"2024-09-17T01:54:46.086752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146298+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:54:46.146298+0000","last_peered":"2024-09-17T01:54:46.146298+0000","last_clean":"2024-09-17T01:54:46.146298+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:54:46.146298+0000","last_undegraded":"2024-09-17T01:54:46.146298+0000","last_fullsized":"2024-09-17T01:54:46.146298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148384+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:54:46.148384+0000","last_peered":"2024-09-17T01:54:46.148384+0000","last_clean":"2024-09-17T01:54:46.148384+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:54:46.148384+0000","last_undegraded":"2024-09-17T01:54:46.148384+0000","last_fullsized":"2024-09-17T01:54:46.148384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086489+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:54:46.086489+0000","last_peered":"2024-09-17T01:54:46.086489+0000","last_clean":"2024-09-17T01:54:46.086489+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:54:46.086489+0000","last_undegraded":"2024-09-17T01:54:46.086489+0000","last_fullsized":"2024-09-17T01:54:46.086489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086282+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:54:46.086282+0000","last_peered":"2024-09-17T01:54:46.086282+0000","last_clean":"2024-09-17T01:54:46.086282+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:54:46.086282+0000","last_undegraded":"2024-09-17T01:54:46.086282+0000","last_fullsized":"2024-09-17T01:54:46.086282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086808+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:54:46.086808+0000","last_peered":"2024-09-17T01:54:46.086808+0000","last_clean":"2024-09-17T01:54:46.086808+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:54:46.086808+0000","last_undegraded":"2024-09-17T01:54:46.086808+0000","last_fullsized":"2024-09-17T01:54:46.086808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.074228+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:54:45.074228+0000","last_peered":"2024-09-17T01:54:45.074228+0000","last_clean":"2024-09-17T01:54:45.074228+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:54:45.074228+0000","last_undegraded":"2024-09-17T01:54:45.074228+0000","last_fullsized":"2024-09-17T01:54:45.074228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085872+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:54:46.085872+0000","last_peered":"2024-09-17T01:54:46.085872+0000","last_clean":"2024-09-17T01:54:46.085872+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:54:46.085872+0000","last_undegraded":"2024-09-17T01:54:46.085872+0000","last_fullsized":"2024-09-17T01:54:46.085872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.073316+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:54:45.073316+0000","last_peered":"2024-09-17T01:54:45.073316+0000","last_clean":"2024-09-17T01:54:45.073316+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:54:45.073316+0000","last_undegraded":"2024-09-17T01:54:45.073316+0000","last_fullsized":"2024-09-17T01:54:45.073316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147778+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:54:46.147778+0000","last_peered":"2024-09-17T01:54:46.147778+0000","last_clean":"2024-09-17T01:54:46.147778+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:54:46.147778+0000","last_undegraded":"2024-09-17T01:54:46.147778+0000","last_fullsized":"2024-09-17T01:54:46.147778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085728+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:54:46.085728+0000","last_peered":"2024-09-17T01:54:46.085728+0000","last_clean":"2024-09-17T01:54:46.085728+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:54:46.085728+0000","last_undegraded":"2024-09-17T01:54:46.085728+0000","last_fullsized":"2024-09-17T01:54:46.085728+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086866+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:54:46.086866+0000","last_peered":"2024-09-17T01:54:46.086866+0000","last_clean":"2024-09-17T01:54:46.086866+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:54:46.086866+0000","last_undegraded":"2024-09-17T01:54:46.086866+0000","last_fullsized":"2024-09-17T01:54:46.086866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147244+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:54:46.147244+0000","last_peered":"2024-09-17T01:54:46.147244+0000","last_clean":"2024-09-17T01:54:46.147244+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:54:46.147244+0000","last_undegraded":"2024-09-17T01:54:46.147244+0000","last_fullsized":"2024-09-17T01:54:46.147244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086868+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:54:46.086868+0000","last_peered":"2024-09-17T01:54:46.086868+0000","last_clean":"2024-09-17T01:54:46.086868+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:54:46.086868+0000","last_undegraded":"2024-09-17T01:54:46.086868+0000","last_fullsized":"2024-09-17T01:54:46.086868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085717+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:54:46.085717+0000","last_peered":"2024-09-17T01:54:46.085717+0000","last_clean":"2024-09-17T01:54:46.085717+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:54:46.085717+0000","last_undegraded":"2024-09-17T01:54:46.085717+0000","last_fullsized":"2024-09-17T01:54:46.085717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146482+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:54:46.146482+0000","last_peered":"2024-09-17T01:54:46.146482+0000","last_clean":"2024-09-17T01:54:46.146482+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:54:46.146482+0000","last_undegraded":"2024-09-17T01:54:46.146482+0000","last_fullsized":"2024-09-17T01:54:46.146482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.101635+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:54:45.101635+0000","last_peered":"2024-09-17T01:54:45.101635+0000","last_clean":"2024-09-17T01:54:45.101635+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:54:45.101635+0000","last_undegraded":"2024-09-17T01:54:45.101635+0000","last_fullsized":"2024-09-17T01:54:45.101635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:03.049594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146749+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:54:46.146749+0000","last_peered":"2024-09-17T01:54:46.146749+0000","last_clean":"2024-09-17T01:54:46.146749+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:54:46.146749+0000","last_undegraded":"2024-09-17T01:54:46.146749+0000","last_fullsized":"2024-09-17T01:54:46.146749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.073579+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:54:45.073579+0000","last_peered":"2024-09-17T01:54:45.073579+0000","last_clean":"2024-09-17T01:54:45.073579+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:54:45.073579+0000","last_undegraded":"2024-09-17T01:54:45.073579+0000","last_fullsized":"2024-09-17T01:54:45.073579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148099+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:54:46.148099+0000","last_peered":"2024-09-17T01:54:46.148099+0000","last_clean":"2024-09-17T01:54:46.148099+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:54:46.148099+0000","last_undegraded":"2024-09-17T01:54:46.148099+0000","last_fullsized":"2024-09-17T01:54:46.148099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086322+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:54:46.086322+0000","last_peered":"2024-09-17T01:54:46.086322+0000","last_clean":"2024-09-17T01:54:46.086322+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:54:46.086322+0000","last_undegraded":"2024-09-17T01:54:46.086322+0000","last_fullsized":"2024-09-17T01:54:46.086322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086860+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:54:46.086860+0000","last_peered":"2024-09-17T01:54:46.086860+0000","last_clean":"2024-09-17T01:54:46.086860+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:54:46.086860+0000","last_undegraded":"2024-09-17T01:54:46.086860+0000","last_fullsized":"2024-09-17T01:54:46.086860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147693+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:54:46.147693+0000","last_peered":"2024-09-17T01:54:46.147693+0000","last_clean":"2024-09-17T01:54:46.147693+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:54:46.147693+0000","last_undegraded":"2024-09-17T01:54:46.147693+0000","last_fullsized":"2024-09-17T01:54:46.147693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087036+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:54:46.087036+0000","last_peered":"2024-09-17T01:54:46.087036+0000","last_clean":"2024-09-17T01:54:46.087036+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:54:46.087036+0000","last_undegraded":"2024-09-17T01:54:46.087036+0000","last_fullsized":"2024-09-17T01:54:46.087036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147867+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:54:46.147867+0000","last_peered":"2024-09-17T01:54:46.147867+0000","last_clean":"2024-09-17T01:54:46.147867+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:54:46.147867+0000","last_undegraded":"2024-09-17T01:54:46.147867+0000","last_fullsized":"2024-09-17T01:54:46.147867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.094316+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:54:45.094316+0000","last_peered":"2024-09-17T01:54:45.094316+0000","last_clean":"2024-09-17T01:54:45.094316+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:54:45.094316+0000","last_undegraded":"2024-09-17T01:54:45.094316+0000","last_fullsized":"2024-09-17T01:54:45.094316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:20.800255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148246+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:54:46.148246+0000","last_peered":"2024-09-17T01:54:46.148246+0000","last_clean":"2024-09-17T01:54:46.148246+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:54:46.148246+0000","last_undegraded":"2024-09-17T01:54:46.148246+0000","last_fullsized":"2024-09-17T01:54:46.148246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.073679+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:54:45.073679+0000","last_peered":"2024-09-17T01:54:45.073679+0000","last_clean":"2024-09-17T01:54:45.073679+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:54:45.073679+0000","last_undegraded":"2024-09-17T01:54:45.073679+0000","last_fullsized":"2024-09-17T01:54:45.073679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093331+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:54:45.093331+0000","last_peered":"2024-09-17T01:54:45.093331+0000","last_clean":"2024-09-17T01:54:45.093331+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:54:45.093331+0000","last_undegraded":"2024-09-17T01:54:45.093331+0000","last_fullsized":"2024-09-17T01:54:45.093331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:50.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148573+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:54:46.148573+0000","last_peered":"2024-09-17T01:54:46.148573+0000","last_clean":"2024-09-17T01:54:46.148573+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:54:46.148573+0000","last_undegraded":"2024-09-17T01:54:46.148573+0000","last_fullsized":"2024-09-17T01:54:46.148573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148475+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:54:46.148475+0000","last_peered":"2024-09-17T01:54:46.148475+0000","last_clean":"2024-09-17T01:54:46.148475+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:54:46.148475+0000","last_undegraded":"2024-09-17T01:54:46.148475+0000","last_fullsized":"2024-09-17T01:54:46.148475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146242+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:54:46.146242+0000","last_peered":"2024-09-17T01:54:46.146242+0000","last_clean":"2024-09-17T01:54:46.146242+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:54:46.146242+0000","last_undegraded":"2024-09-17T01:54:46.146242+0000","last_fullsized":"2024-09-17T01:54:46.146242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148328+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:54:46.148328+0000","last_peered":"2024-09-17T01:54:46.148328+0000","last_clean":"2024-09-17T01:54:46.148328+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:54:46.148328+0000","last_undegraded":"2024-09-17T01:54:46.148328+0000","last_fullsized":"2024-09-17T01:54:46.148328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085617+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:54:46.085617+0000","last_peered":"2024-09-17T01:54:46.085617+0000","last_clean":"2024-09-17T01:54:46.085617+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:54:46.085617+0000","last_undegraded":"2024-09-17T01:54:46.085617+0000","last_fullsized":"2024-09-17T01:54:46.085617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.095087+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:54:45.095087+0000","last_peered":"2024-09-17T01:54:45.095087+0000","last_clean":"2024-09-17T01:54:45.095087+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:54:45.095087+0000","last_undegraded":"2024-09-17T01:54:45.095087+0000","last_fullsized":"2024-09-17T01:54:45.095087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:01.981434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086658+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:54:46.086658+0000","last_peered":"2024-09-17T01:54:46.086658+0000","last_clean":"2024-09-17T01:54:46.086658+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:54:46.086658+0000","last_undegraded":"2024-09-17T01:54:46.086658+0000","last_fullsized":"2024-09-17T01:54:46.086658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086598+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:54:46.086598+0000","last_peered":"2024-09-17T01:54:46.086598+0000","last_clean":"2024-09-17T01:54:46.086598+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:54:46.086598+0000","last_undegraded":"2024-09-17T01:54:46.086598+0000","last_fullsized":"2024-09-17T01:54:46.086598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146416+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:54:46.146416+0000","last_peered":"2024-09-17T01:54:46.146416+0000","last_clean":"2024-09-17T01:54:46.146416+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:54:46.146416+0000","last_undegraded":"2024-09-17T01:54:46.146416+0000","last_fullsized":"2024-09-17T01:54:46.146416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.211513+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:54:45.211513+0000","last_peered":"2024-09-17T01:54:45.211513+0000","last_clean":"2024-09-17T01:54:45.211513+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:54:45.211513+0000","last_undegraded":"2024-09-17T01:54:45.211513+0000","last_fullsized":"2024-09-17T01:54:45.211513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085763+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:54:46.085763+0000","last_peered":"2024-09-17T01:54:46.085763+0000","last_clean":"2024-09-17T01:54:46.085763+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:54:46.085763+0000","last_undegraded":"2024-09-17T01:54:46.085763+0000","last_fullsized":"2024-09-17T01:54:46.085763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.145995+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:54:46.145995+0000","last_peered":"2024-09-17T01:54:46.145995+0000","last_clean":"2024-09-17T01:54:46.145995+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:54:46.145995+0000","last_undegraded":"2024-09-17T01:54:46.145995+0000","last_fullsized":"2024-09-17T01:54:46.145995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148391+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:54:46.148391+0000","last_peered":"2024-09-17T01:54:46.148391+0000","last_clean":"2024-09-17T01:54:46.148391+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:54:46.148391+0000","last_undegraded":"2024-09-17T01:54:46.148391+0000","last_fullsized":"2024-09-17T01:54:46.148391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146170+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:54:46.146170+0000","last_peered":"2024-09-17T01:54:46.146170+0000","last_clean":"2024-09-17T01:54:46.146170+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:54:46.146170+0000","last_undegraded":"2024-09-17T01:54:46.146170+0000","last_fullsized":"2024-09-17T01:54:46.146170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.090355+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:54:45.090355+0000","last_peered":"2024-09-17T01:54:45.090355+0000","last_clean":"2024-09-17T01:54:45.090355+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:54:45.090355+0000","last_undegraded":"2024-09-17T01:54:45.090355+0000","last_fullsized":"2024-09-17T01:54:45.090355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:52.523096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146476+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:54:46.146476+0000","last_peered":"2024-09-17T01:54:46.146476+0000","last_clean":"2024-09-17T01:54:46.146476+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:54:46.146476+0000","last_undegraded":"2024-09-17T01:54:46.146476+0000","last_fullsized":"2024-09-17T01:54:46.146476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147451+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:54:46.147451+0000","last_peered":"2024-09-17T01:54:46.147451+0000","last_clean":"2024-09-17T01:54:46.147451+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:54:46.147451+0000","last_undegraded":"2024-09-17T01:54:46.147451+0000","last_fullsized":"2024-09-17T01:54:46.147451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146367+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:54:46.146367+0000","last_peered":"2024-09-17T01:54:46.146367+0000","last_clean":"2024-09-17T01:54:46.146367+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:54:46.146367+0000","last_undegraded":"2024-09-17T01:54:46.146367+0000","last_fullsized":"2024-09-17T01:54:46.146367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093361+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:54:45.093361+0000","last_peered":"2024-09-17T01:54:45.093361+0000","last_clean":"2024-09-17T01:54:45.093361+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:54:45.093361+0000","last_undegraded":"2024-09-17T01:54:45.093361+0000","last_fullsized":"2024-09-17T01:54:45.093361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:23.252316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.206753+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:54:45.206753+0000","last_peered":"2024-09-17T01:54:45.206753+0000","last_clean":"2024-09-17T01:54:45.206753+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:54:45.206753+0000","last_undegraded":"2024-09-17T01:54:45.206753+0000","last_fullsized":"2024-09-17T01:54:45.206753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093552+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:54:45.093552+0000","last_peered":"2024-09-17T01:54:45.093552+0000","last_clean":"2024-09-17T01:54:45.093552+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:54:45.093552+0000","last_undegraded":"2024-09-17T01:54:45.093552+0000","last_fullsized":"2024-09-17T01:54:45.093552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:32.033845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.208572+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:54:45.208572+0000","last_peered":"2024-09-17T01:54:45.208572+0000","last_clean":"2024-09-17T01:54:45.208572+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:54:45.208572+0000","last_undegraded":"2024-09-17T01:54:45.208572+0000","last_fullsized":"2024-09-17T01:54:45.208572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086178+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:54:46.086178+0000","last_peered":"2024-09-17T01:54:46.086178+0000","last_clean":"2024-09-17T01:54:46.086178+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:54:46.086178+0000","last_undegraded":"2024-09-17T01:54:46.086178+0000","last_fullsized":"2024-09-17T01:54:46.086178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086385+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:54:46.086385+0000","last_peered":"2024-09-17T01:54:46.086385+0000","last_clean":"2024-09-17T01:54:46.086385+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:54:46.086385+0000","last_undegraded":"2024-09-17T01:54:46.086385+0000","last_fullsized":"2024-09-17T01:54:46.086385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085984+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:54:46.085984+0000","last_peered":"2024-09-17T01:54:46.085984+0000","last_clean":"2024-09-17T01:54:46.085984+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:54:46.085984+0000","last_undegraded":"2024-09-17T01:54:46.085984+0000","last_fullsized":"2024-09-17T01:54:46.085984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.210877+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:54:45.210877+0000","last_peered":"2024-09-17T01:54:45.210877+0000","last_clean":"2024-09-17T01:54:45.210877+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:54:45.210877+0000","last_undegraded":"2024-09-17T01:54:45.210877+0000","last_fullsized":"2024-09-17T01:54:45.210877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.101950+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:54:45.101950+0000","last_peered":"2024-09-17T01:54:45.101950+0000","last_clean":"2024-09-17T01:54:45.101950+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:54:45.101950+0000","last_undegraded":"2024-09-17T01:54:45.101950+0000","last_fullsized":"2024-09-17T01:54:45.101950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:29.976598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147967+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:54:46.147967+0000","last_peered":"2024-09-17T01:54:46.147967+0000","last_clean":"2024-09-17T01:54:46.147967+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:54:46.147967+0000","last_undegraded":"2024-09-17T01:54:46.147967+0000","last_fullsized":"2024-09-17T01:54:46.147967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085228+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:54:46.085228+0000","last_peered":"2024-09-17T01:54:46.085228+0000","last_clean":"2024-09-17T01:54:46.085228+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:54:46.085228+0000","last_undegraded":"2024-09-17T01:54:46.085228+0000","last_fullsized":"2024-09-17T01:54:46.085228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148098+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:54:46.148098+0000","last_peered":"2024-09-17T01:54:46.148098+0000","last_clean":"2024-09-17T01:54:46.148098+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:54:46.148098+0000","last_undegraded":"2024-09-17T01:54:46.148098+0000","last_fullsized":"2024-09-17T01:54:46.148098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":651803,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":646537,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:54:49.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:54:49.589 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:49.591 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:54:49.608 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T01:54:47.974168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":249,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90064,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025456,"statfs":{"total":289910292480,"available":289818066944,"internally_reserved":0,"allocated":671744,"data_stored":1357981,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788976"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.102687+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:54:45.102687+0000","last_peered":"2024-09-17T01:54:45.102687+0000","last_clean":"2024-09-17T01:54:45.102687+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:54:45.102687+0000","last_undegraded":"2024-09-17T01:54:45.102687+0000","last_fullsized":"2024-09-17T01:54:45.102687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:09.295310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.102898+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:54:45.102898+0000","last_peered":"2024-09-17T01:54:45.102898+0000","last_clean":"2024-09-17T01:54:45.102898+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:54:45.102898+0000","last_undegraded":"2024-09-17T01:54:45.102898+0000","last_fullsized":"2024-09-17T01:54:45.102898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:15.314431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085172+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:54:46.085172+0000","last_peered":"2024-09-17T01:54:46.085172+0000","last_clean":"2024-09-17T01:54:46.085172+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:54:46.085172+0000","last_undegraded":"2024-09-17T01:54:46.085172+0000","last_fullsized":"2024-09-17T01:54:46.085172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086124+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:54:46.086124+0000","last_peered":"2024-09-17T01:54:46.086124+0000","last_clean":"2024-09-17T01:54:46.086124+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:54:46.086124+0000","last_undegraded":"2024-09-17T01:54:46.086124+0000","last_fullsized":"2024-09-17T01:54:46.086124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093271+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:54:45.093271+0000","last_peered":"2024-09-17T01:54:45.093271+0000","last_clean":"2024-09-17T01:54:45.093271+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:54:45.093271+0000","last_undegraded":"2024-09-17T01:54:45.093271+0000","last_fullsized":"2024-09-17T01:54:45.093271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:08.877501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085234+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:54:46.085234+0000","last_peered":"2024-09-17T01:54:46.085234+0000","last_clean":"2024-09-17T01:54:46.085234+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:54:46.085234+0000","last_undegraded":"2024-09-17T01:54:46.085234+0000","last_fullsized":"2024-09-17T01:54:46.085234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084719+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:54:46.084719+0000","last_peered":"2024-09-17T01:54:46.084719+0000","last_clean":"2024-09-17T01:54:46.084719+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:54:46.084719+0000","last_undegraded":"2024-09-17T01:54:46.084719+0000","last_fullsized":"2024-09-17T01:54:46.084719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084228+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:54:46.084228+0000","last_peered":"2024-09-17T01:54:46.084228+0000","last_clean":"2024-09-17T01:54:46.084228+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:54:46.084228+0000","last_undegraded":"2024-09-17T01:54:46.084228+0000","last_fullsized":"2024-09-17T01:54:46.084228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147269+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:54:46.147269+0000","last_peered":"2024-09-17T01:54:46.147269+0000","last_clean":"2024-09-17T01:54:46.147269+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:54:46.147269+0000","last_undegraded":"2024-09-17T01:54:46.147269+0000","last_fullsized":"2024-09-17T01:54:46.147269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.102631+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:54:45.102631+0000","last_peered":"2024-09-17T01:54:45.102631+0000","last_clean":"2024-09-17T01:54:45.102631+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:54:45.102631+0000","last_undegraded":"2024-09-17T01:54:45.102631+0000","last_fullsized":"2024-09-17T01:54:45.102631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:52.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086169+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:54:46.086169+0000","last_peered":"2024-09-17T01:54:46.086169+0000","last_clean":"2024-09-17T01:54:46.086169+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:54:46.086169+0000","last_undegraded":"2024-09-17T01:54:46.086169+0000","last_fullsized":"2024-09-17T01:54:46.086169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096841+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:54:45.096841+0000","last_peered":"2024-09-17T01:54:45.096841+0000","last_clean":"2024-09-17T01:54:45.096841+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:54:45.096841+0000","last_undegraded":"2024-09-17T01:54:45.096841+0000","last_fullsized":"2024-09-17T01:54:45.096841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:25.923729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.091360+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:54:45.091360+0000","last_peered":"2024-09-17T01:54:45.091360+0000","last_clean":"2024-09-17T01:54:45.091360+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:54:45.091360+0000","last_undegraded":"2024-09-17T01:54:45.091360+0000","last_fullsized":"2024-09-17T01:54:45.091360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:48.625172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084990+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:54:46.084990+0000","last_peered":"2024-09-17T01:54:46.084990+0000","last_clean":"2024-09-17T01:54:46.084990+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:54:46.084990+0000","last_undegraded":"2024-09-17T01:54:46.084990+0000","last_fullsized":"2024-09-17T01:54:46.084990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084800+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:54:46.084800+0000","last_peered":"2024-09-17T01:54:46.084800+0000","last_clean":"2024-09-17T01:54:46.084800+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:54:46.084800+0000","last_undegraded":"2024-09-17T01:54:46.084800+0000","last_fullsized":"2024-09-17T01:54:46.084800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084333+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:54:46.084333+0000","last_peered":"2024-09-17T01:54:46.084333+0000","last_clean":"2024-09-17T01:54:46.084333+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:54:46.084333+0000","last_undegraded":"2024-09-17T01:54:46.084333+0000","last_fullsized":"2024-09-17T01:54:46.084333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148704+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:54:46.148704+0000","last_peered":"2024-09-17T01:54:46.148704+0000","last_clean":"2024-09-17T01:54:46.148704+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:54:46.148704+0000","last_undegraded":"2024-09-17T01:54:46.148704+0000","last_fullsized":"2024-09-17T01:54:46.148704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093914+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:54:45.093914+0000","last_peered":"2024-09-17T01:54:45.093914+0000","last_clean":"2024-09-17T01:54:45.093914+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:54:45.093914+0000","last_undegraded":"2024-09-17T01:54:45.093914+0000","last_fullsized":"2024-09-17T01:54:45.093914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:06.413999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146947+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:54:46.146947+0000","last_peered":"2024-09-17T01:54:46.146947+0000","last_clean":"2024-09-17T01:54:46.146947+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:54:46.146947+0000","last_undegraded":"2024-09-17T01:54:46.146947+0000","last_fullsized":"2024-09-17T01:54:46.146947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086067+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:54:46.086067+0000","last_peered":"2024-09-17T01:54:46.086067+0000","last_clean":"2024-09-17T01:54:46.086067+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:54:46.086067+0000","last_undegraded":"2024-09-17T01:54:46.086067+0000","last_fullsized":"2024-09-17T01:54:46.086067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085634+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:54:46.085634+0000","last_peered":"2024-09-17T01:54:46.085634+0000","last_clean":"2024-09-17T01:54:46.085634+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:54:46.085634+0000","last_undegraded":"2024-09-17T01:54:46.085634+0000","last_fullsized":"2024-09-17T01:54:46.085634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096677+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:54:45.096677+0000","last_peered":"2024-09-17T01:54:45.096677+0000","last_clean":"2024-09-17T01:54:45.096677+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:54:45.096677+0000","last_undegraded":"2024-09-17T01:54:45.096677+0000","last_fullsized":"2024-09-17T01:54:45.096677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:19.809823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.145561+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:54:46.145561+0000","last_peered":"2024-09-17T01:54:46.145561+0000","last_clean":"2024-09-17T01:54:46.145561+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:54:46.145561+0000","last_undegraded":"2024-09-17T01:54:46.145561+0000","last_fullsized":"2024-09-17T01:54:46.145561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.101616+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:54:45.101616+0000","last_peered":"2024-09-17T01:54:45.101616+0000","last_clean":"2024-09-17T01:54:45.101616+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:54:45.101616+0000","last_undegraded":"2024-09-17T01:54:45.101616+0000","last_fullsized":"2024-09-17T01:54:45.101616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:26.171276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096939+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:54:45.096939+0000","last_peered":"2024-09-17T01:54:45.096939+0000","last_clean":"2024-09-17T01:54:45.096939+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:54:45.096939+0000","last_undegraded":"2024-09-17T01:54:45.096939+0000","last_fullsized":"2024-09-17T01:54:45.096939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:55.312874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147687+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:54:46.147687+0000","last_peered":"2024-09-17T01:54:46.147687+0000","last_clean":"2024-09-17T01:54:46.147687+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:54:46.147687+0000","last_undegraded":"2024-09-17T01:54:46.147687+0000","last_fullsized":"2024-09-17T01:54:46.147687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086599+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:54:46.086599+0000","last_peered":"2024-09-17T01:54:46.086599+0000","last_clean":"2024-09-17T01:54:46.086599+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:54:46.086599+0000","last_undegraded":"2024-09-17T01:54:46.086599+0000","last_fullsized":"2024-09-17T01:54:46.086599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.096780+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:54:45.096780+0000","last_peered":"2024-09-17T01:54:45.096780+0000","last_clean":"2024-09-17T01:54:45.096780+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:54:45.096780+0000","last_undegraded":"2024-09-17T01:54:45.096780+0000","last_fullsized":"2024-09-17T01:54:45.096780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:16.504577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148207+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:54:46.148207+0000","last_peered":"2024-09-17T01:54:46.148207+0000","last_clean":"2024-09-17T01:54:46.148207+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:54:46.148207+0000","last_undegraded":"2024-09-17T01:54:46.148207+0000","last_fullsized":"2024-09-17T01:54:46.148207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.090079+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:54:45.090079+0000","last_peered":"2024-09-17T01:54:45.090079+0000","last_clean":"2024-09-17T01:54:45.090079+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:54:45.090079+0000","last_undegraded":"2024-09-17T01:54:45.090079+0000","last_fullsized":"2024-09-17T01:54:45.090079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:57.435947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.145745+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:54:46.145745+0000","last_peered":"2024-09-17T01:54:46.145745+0000","last_clean":"2024-09-17T01:54:46.145745+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:54:46.145745+0000","last_undegraded":"2024-09-17T01:54:46.145745+0000","last_fullsized":"2024-09-17T01:54:46.145745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084709+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:54:46.084709+0000","last_peered":"2024-09-17T01:54:46.084709+0000","last_clean":"2024-09-17T01:54:46.084709+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:54:46.084709+0000","last_undegraded":"2024-09-17T01:54:46.084709+0000","last_fullsized":"2024-09-17T01:54:46.084709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093641+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:54:45.093641+0000","last_peered":"2024-09-17T01:54:45.093641+0000","last_clean":"2024-09-17T01:54:45.093641+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:54:45.093641+0000","last_undegraded":"2024-09-17T01:54:45.093641+0000","last_fullsized":"2024-09-17T01:54:45.093641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:23.676146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086624+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:54:46.086624+0000","last_peered":"2024-09-17T01:54:46.086624+0000","last_clean":"2024-09-17T01:54:46.086624+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:54:46.086624+0000","last_undegraded":"2024-09-17T01:54:46.086624+0000","last_fullsized":"2024-09-17T01:54:46.086624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.089763+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:54:45.089763+0000","last_peered":"2024-09-17T01:54:45.089763+0000","last_clean":"2024-09-17T01:54:45.089763+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:54:45.089763+0000","last_undegraded":"2024-09-17T01:54:45.089763+0000","last_fullsized":"2024-09-17T01:54:45.089763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:00.838463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146719+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:54:46.146719+0000","last_peered":"2024-09-17T01:54:46.146719+0000","last_clean":"2024-09-17T01:54:46.146719+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:54:46.146719+0000","last_undegraded":"2024-09-17T01:54:46.146719+0000","last_fullsized":"2024-09-17T01:54:46.146719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148451+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:54:46.148451+0000","last_peered":"2024-09-17T01:54:46.148451+0000","last_clean":"2024-09-17T01:54:46.148451+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:54:46.148451+0000","last_undegraded":"2024-09-17T01:54:46.148451+0000","last_fullsized":"2024-09-17T01:54:46.148451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.074337+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:54:45.074337+0000","last_peered":"2024-09-17T01:54:45.074337+0000","last_clean":"2024-09-17T01:54:45.074337+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:54:45.074337+0000","last_undegraded":"2024-09-17T01:54:45.074337+0000","last_fullsized":"2024-09-17T01:54:45.074337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147645+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:54:46.147645+0000","last_peered":"2024-09-17T01:54:46.147645+0000","last_clean":"2024-09-17T01:54:46.147645+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:54:46.147645+0000","last_undegraded":"2024-09-17T01:54:46.147645+0000","last_fullsized":"2024-09-17T01:54:46.147645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084599+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:54:46.084599+0000","last_peered":"2024-09-17T01:54:46.084599+0000","last_clean":"2024-09-17T01:54:46.084599+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:54:46.084599+0000","last_undegraded":"2024-09-17T01:54:46.084599+0000","last_fullsized":"2024-09-17T01:54:46.084599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085662+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:54:46.085662+0000","last_peered":"2024-09-17T01:54:46.085662+0000","last_clean":"2024-09-17T01:54:46.085662+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:54:46.085662+0000","last_undegraded":"2024-09-17T01:54:46.085662+0000","last_fullsized":"2024-09-17T01:54:46.085662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.097481+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:54:45.097481+0000","last_peered":"2024-09-17T01:54:45.097481+0000","last_clean":"2024-09-17T01:54:45.097481+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:54:45.097481+0000","last_undegraded":"2024-09-17T01:54:45.097481+0000","last_fullsized":"2024-09-17T01:54:45.097481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:21.568878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.210692+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:54:45.210692+0000","last_peered":"2024-09-17T01:54:45.210692+0000","last_clean":"2024-09-17T01:54:45.210692+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:54:45.210692+0000","last_undegraded":"2024-09-17T01:54:45.210692+0000","last_fullsized":"2024-09-17T01:54:45.210692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.088420+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:54:45.088420+0000","last_peered":"2024-09-17T01:54:45.088420+0000","last_clean":"2024-09-17T01:54:45.088420+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:54:45.088420+0000","last_undegraded":"2024-09-17T01:54:45.088420+0000","last_fullsized":"2024-09-17T01:54:45.088420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:00.532293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087126+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:54:46.087126+0000","last_peered":"2024-09-17T01:54:46.087126+0000","last_clean":"2024-09-17T01:54:46.087126+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:54:46.087126+0000","last_undegraded":"2024-09-17T01:54:46.087126+0000","last_fullsized":"2024-09-17T01:54:46.087126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086153+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:54:46.086153+0000","last_peered":"2024-09-17T01:54:46.086153+0000","last_clean":"2024-09-17T01:54:46.086153+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:54:46.086153+0000","last_undegraded":"2024-09-17T01:54:46.086153+0000","last_fullsized":"2024-09-17T01:54:46.086153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086752+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:54:46.086752+0000","last_peered":"2024-09-17T01:54:46.086752+0000","last_clean":"2024-09-17T01:54:46.086752+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:54:46.086752+0000","last_undegraded":"2024-09-17T01:54:46.086752+0000","last_fullsized":"2024-09-17T01:54:46.086752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146298+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:54:46.146298+0000","last_peered":"2024-09-17T01:54:46.146298+0000","last_clean":"2024-09-17T01:54:46.146298+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:54:46.146298+0000","last_undegraded":"2024-09-17T01:54:46.146298+0000","last_fullsized":"2024-09-17T01:54:46.146298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148384+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:54:46.148384+0000","last_peered":"2024-09-17T01:54:46.148384+0000","last_clean":"2024-09-17T01:54:46.148384+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:54:46.148384+0000","last_undegraded":"2024-09-17T01:54:46.148384+0000","last_fullsized":"2024-09-17T01:54:46.148384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086489+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:54:46.086489+0000","last_peered":"2024-09-17T01:54:46.086489+0000","last_clean":"2024-09-17T01:54:46.086489+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:54:46.086489+0000","last_undegraded":"2024-09-17T01:54:46.086489+0000","last_fullsized":"2024-09-17T01:54:46.086489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086282+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:54:46.086282+0000","last_peered":"2024-09-17T01:54:46.086282+0000","last_clean":"2024-09-17T01:54:46.086282+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:54:46.086282+0000","last_undegraded":"2024-09-17T01:54:46.086282+0000","last_fullsized":"2024-09-17T01:54:46.086282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086808+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:54:46.086808+0000","last_peered":"2024-09-17T01:54:46.086808+0000","last_clean":"2024-09-17T01:54:46.086808+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:54:46.086808+0000","last_undegraded":"2024-09-17T01:54:46.086808+0000","last_fullsized":"2024-09-17T01:54:46.086808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.074228+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:54:45.074228+0000","last_peered":"2024-09-17T01:54:45.074228+0000","last_clean":"2024-09-17T01:54:45.074228+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:54:45.074228+0000","last_undegraded":"2024-09-17T01:54:45.074228+0000","last_fullsized":"2024-09-17T01:54:45.074228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085872+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:54:46.085872+0000","last_peered":"2024-09-17T01:54:46.085872+0000","last_clean":"2024-09-17T01:54:46.085872+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:54:46.085872+0000","last_undegraded":"2024-09-17T01:54:46.085872+0000","last_fullsized":"2024-09-17T01:54:46.085872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.073316+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:54:45.073316+0000","last_peered":"2024-09-17T01:54:45.073316+0000","last_clean":"2024-09-17T01:54:45.073316+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:54:45.073316+0000","last_undegraded":"2024-09-17T01:54:45.073316+0000","last_fullsized":"2024-09-17T01:54:45.073316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147778+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:54:46.147778+0000","last_peered":"2024-09-17T01:54:46.147778+0000","last_clean":"2024-09-17T01:54:46.147778+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:54:46.147778+0000","last_undegraded":"2024-09-17T01:54:46.147778+0000","last_fullsized":"2024-09-17T01:54:46.147778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085728+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:54:46.085728+0000","last_peered":"2024-09-17T01:54:46.085728+0000","last_clean":"2024-09-17T01:54:46.085728+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:54:46.085728+0000","last_undegraded":"2024-09-17T01:54:46.085728+0000","last_fullsized":"2024-09-17T01:54:46.085728+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086866+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:54:46.086866+0000","last_peered":"2024-09-17T01:54:46.086866+0000","last_clean":"2024-09-17T01:54:46.086866+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:54:46.086866+0000","last_undegraded":"2024-09-17T01:54:46.086866+0000","last_fullsized":"2024-09-17T01:54:46.086866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147244+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:54:46.147244+0000","last_peered":"2024-09-17T01:54:46.147244+0000","last_clean":"2024-09-17T01:54:46.147244+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:54:46.147244+0000","last_undegraded":"2024-09-17T01:54:46.147244+0000","last_fullsized":"2024-09-17T01:54:46.147244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086868+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:54:46.086868+0000","last_peered":"2024-09-17T01:54:46.086868+0000","last_clean":"2024-09-17T01:54:46.086868+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:54:46.086868+0000","last_undegraded":"2024-09-17T01:54:46.086868+0000","last_fullsized":"2024-09-17T01:54:46.086868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085717+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:54:46.085717+0000","last_peered":"2024-09-17T01:54:46.085717+0000","last_clean":"2024-09-17T01:54:46.085717+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:54:46.085717+0000","last_undegraded":"2024-09-17T01:54:46.085717+0000","last_fullsized":"2024-09-17T01:54:46.085717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146482+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:54:46.146482+0000","last_peered":"2024-09-17T01:54:46.146482+0000","last_clean":"2024-09-17T01:54:46.146482+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:54:46.146482+0000","last_undegraded":"2024-09-17T01:54:46.146482+0000","last_fullsized":"2024-09-17T01:54:46.146482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.101635+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:54:45.101635+0000","last_peered":"2024-09-17T01:54:45.101635+0000","last_clean":"2024-09-17T01:54:45.101635+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:54:45.101635+0000","last_undegraded":"2024-09-17T01:54:45.101635+0000","last_fullsized":"2024-09-17T01:54:45.101635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:03.049594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146749+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:54:46.146749+0000","last_peered":"2024-09-17T01:54:46.146749+0000","last_clean":"2024-09-17T01:54:46.146749+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:54:46.146749+0000","last_undegraded":"2024-09-17T01:54:46.146749+0000","last_fullsized":"2024-09-17T01:54:46.146749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.073579+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:54:45.073579+0000","last_peered":"2024-09-17T01:54:45.073579+0000","last_clean":"2024-09-17T01:54:45.073579+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:54:45.073579+0000","last_undegraded":"2024-09-17T01:54:45.073579+0000","last_fullsized":"2024-09-17T01:54:45.073579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148099+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:54:46.148099+0000","last_peered":"2024-09-17T01:54:46.148099+0000","last_clean":"2024-09-17T01:54:46.148099+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:54:46.148099+0000","last_undegraded":"2024-09-17T01:54:46.148099+0000","last_fullsized":"2024-09-17T01:54:46.148099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086322+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:54:46.086322+0000","last_peered":"2024-09-17T01:54:46.086322+0000","last_clean":"2024-09-17T01:54:46.086322+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:54:46.086322+0000","last_undegraded":"2024-09-17T01:54:46.086322+0000","last_fullsized":"2024-09-17T01:54:46.086322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086860+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:54:46.086860+0000","last_peered":"2024-09-17T01:54:46.086860+0000","last_clean":"2024-09-17T01:54:46.086860+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:54:46.086860+0000","last_undegraded":"2024-09-17T01:54:46.086860+0000","last_fullsized":"2024-09-17T01:54:46.086860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147693+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:54:46.147693+0000","last_peered":"2024-09-17T01:54:46.147693+0000","last_clean":"2024-09-17T01:54:46.147693+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:54:46.147693+0000","last_undegraded":"2024-09-17T01:54:46.147693+0000","last_fullsized":"2024-09-17T01:54:46.147693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087036+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:54:46.087036+0000","last_peered":"2024-09-17T01:54:46.087036+0000","last_clean":"2024-09-17T01:54:46.087036+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:54:46.087036+0000","last_undegraded":"2024-09-17T01:54:46.087036+0000","last_fullsized":"2024-09-17T01:54:46.087036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147867+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:54:46.147867+0000","last_peered":"2024-09-17T01:54:46.147867+0000","last_clean":"2024-09-17T01:54:46.147867+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:54:46.147867+0000","last_undegraded":"2024-09-17T01:54:46.147867+0000","last_fullsized":"2024-09-17T01:54:46.147867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.094316+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:54:45.094316+0000","last_peered":"2024-09-17T01:54:45.094316+0000","last_clean":"2024-09-17T01:54:45.094316+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:54:45.094316+0000","last_undegraded":"2024-09-17T01:54:45.094316+0000","last_fullsized":"2024-09-17T01:54:45.094316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:20.800255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148246+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:54:46.148246+0000","last_peered":"2024-09-17T01:54:46.148246+0000","last_clean":"2024-09-17T01:54:46.148246+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:54:46.148246+0000","last_undegraded":"2024-09-17T01:54:46.148246+0000","last_fullsized":"2024-09-17T01:54:46.148246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.073679+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:54:45.073679+0000","last_peered":"2024-09-17T01:54:45.073679+0000","last_clean":"2024-09-17T01:54:45.073679+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:54:45.073679+0000","last_undegraded":"2024-09-17T01:54:45.073679+0000","last_fullsized":"2024-09-17T01:54:45.073679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093331+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:54:45.093331+0000","last_peered":"2024-09-17T01:54:45.093331+0000","last_clean":"2024-09-17T01:54:45.093331+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:54:45.093331+0000","last_undegraded":"2024-09-17T01:54:45.093331+0000","last_fullsized":"2024-09-17T01:54:45.093331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:50.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148573+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:54:46.148573+0000","last_peered":"2024-09-17T01:54:46.148573+0000","last_clean":"2024-09-17T01:54:46.148573+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:54:46.148573+0000","last_undegraded":"2024-09-17T01:54:46.148573+0000","last_fullsized":"2024-09-17T01:54:46.148573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148475+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:54:46.148475+0000","last_peered":"2024-09-17T01:54:46.148475+0000","last_clean":"2024-09-17T01:54:46.148475+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:54:46.148475+0000","last_undegraded":"2024-09-17T01:54:46.148475+0000","last_fullsized":"2024-09-17T01:54:46.148475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146242+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:54:46.146242+0000","last_peered":"2024-09-17T01:54:46.146242+0000","last_clean":"2024-09-17T01:54:46.146242+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:54:46.146242+0000","last_undegraded":"2024-09-17T01:54:46.146242+0000","last_fullsized":"2024-09-17T01:54:46.146242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148328+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:54:46.148328+0000","last_peered":"2024-09-17T01:54:46.148328+0000","last_clean":"2024-09-17T01:54:46.148328+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:54:46.148328+0000","last_undegraded":"2024-09-17T01:54:46.148328+0000","last_fullsized":"2024-09-17T01:54:46.148328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085617+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:54:46.085617+0000","last_peered":"2024-09-17T01:54:46.085617+0000","last_clean":"2024-09-17T01:54:46.085617+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:54:46.085617+0000","last_undegraded":"2024-09-17T01:54:46.085617+0000","last_fullsized":"2024-09-17T01:54:46.085617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.095087+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:54:45.095087+0000","last_peered":"2024-09-17T01:54:45.095087+0000","last_clean":"2024-09-17T01:54:45.095087+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:54:45.095087+0000","last_undegraded":"2024-09-17T01:54:45.095087+0000","last_fullsized":"2024-09-17T01:54:45.095087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:01.981434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086658+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:54:46.086658+0000","last_peered":"2024-09-17T01:54:46.086658+0000","last_clean":"2024-09-17T01:54:46.086658+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:54:46.086658+0000","last_undegraded":"2024-09-17T01:54:46.086658+0000","last_fullsized":"2024-09-17T01:54:46.086658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086598+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:54:46.086598+0000","last_peered":"2024-09-17T01:54:46.086598+0000","last_clean":"2024-09-17T01:54:46.086598+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:54:46.086598+0000","last_undegraded":"2024-09-17T01:54:46.086598+0000","last_fullsized":"2024-09-17T01:54:46.086598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146416+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:54:46.146416+0000","last_peered":"2024-09-17T01:54:46.146416+0000","last_clean":"2024-09-17T01:54:46.146416+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:54:46.146416+0000","last_undegraded":"2024-09-17T01:54:46.146416+0000","last_fullsized":"2024-09-17T01:54:46.146416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.211513+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:54:45.211513+0000","last_peered":"2024-09-17T01:54:45.211513+0000","last_clean":"2024-09-17T01:54:45.211513+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:54:45.211513+0000","last_undegraded":"2024-09-17T01:54:45.211513+0000","last_fullsized":"2024-09-17T01:54:45.211513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085763+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:54:46.085763+0000","last_peered":"2024-09-17T01:54:46.085763+0000","last_clean":"2024-09-17T01:54:46.085763+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:54:46.085763+0000","last_undegraded":"2024-09-17T01:54:46.085763+0000","last_fullsized":"2024-09-17T01:54:46.085763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.145995+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:54:46.145995+0000","last_peered":"2024-09-17T01:54:46.145995+0000","last_clean":"2024-09-17T01:54:46.145995+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:54:46.145995+0000","last_undegraded":"2024-09-17T01:54:46.145995+0000","last_fullsized":"2024-09-17T01:54:46.145995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148391+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:54:46.148391+0000","last_peered":"2024-09-17T01:54:46.148391+0000","last_clean":"2024-09-17T01:54:46.148391+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:54:46.148391+0000","last_undegraded":"2024-09-17T01:54:46.148391+0000","last_fullsized":"2024-09-17T01:54:46.148391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146170+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:54:46.146170+0000","last_peered":"2024-09-17T01:54:46.146170+0000","last_clean":"2024-09-17T01:54:46.146170+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:54:46.146170+0000","last_undegraded":"2024-09-17T01:54:46.146170+0000","last_fullsized":"2024-09-17T01:54:46.146170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.090355+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:54:45.090355+0000","last_peered":"2024-09-17T01:54:45.090355+0000","last_clean":"2024-09-17T01:54:45.090355+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:54:45.090355+0000","last_undegraded":"2024-09-17T01:54:45.090355+0000","last_fullsized":"2024-09-17T01:54:45.090355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:52.523096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146476+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:54:46.146476+0000","last_peered":"2024-09-17T01:54:46.146476+0000","last_clean":"2024-09-17T01:54:46.146476+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:54:46.146476+0000","last_undegraded":"2024-09-17T01:54:46.146476+0000","last_fullsized":"2024-09-17T01:54:46.146476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147451+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:54:46.147451+0000","last_peered":"2024-09-17T01:54:46.147451+0000","last_clean":"2024-09-17T01:54:46.147451+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:54:46.147451+0000","last_undegraded":"2024-09-17T01:54:46.147451+0000","last_fullsized":"2024-09-17T01:54:46.147451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.146367+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:54:46.146367+0000","last_peered":"2024-09-17T01:54:46.146367+0000","last_clean":"2024-09-17T01:54:46.146367+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:54:46.146367+0000","last_undegraded":"2024-09-17T01:54:46.146367+0000","last_fullsized":"2024-09-17T01:54:46.146367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093361+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:54:45.093361+0000","last_peered":"2024-09-17T01:54:45.093361+0000","last_clean":"2024-09-17T01:54:45.093361+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:54:45.093361+0000","last_undegraded":"2024-09-17T01:54:45.093361+0000","last_fullsized":"2024-09-17T01:54:45.093361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:23.252316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.206753+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:54:45.206753+0000","last_peered":"2024-09-17T01:54:45.206753+0000","last_clean":"2024-09-17T01:54:45.206753+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:54:45.206753+0000","last_undegraded":"2024-09-17T01:54:45.206753+0000","last_fullsized":"2024-09-17T01:54:45.206753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.093552+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:54:45.093552+0000","last_peered":"2024-09-17T01:54:45.093552+0000","last_clean":"2024-09-17T01:54:45.093552+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:54:45.093552+0000","last_undegraded":"2024-09-17T01:54:45.093552+0000","last_fullsized":"2024-09-17T01:54:45.093552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:32.033845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.208572+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:54:45.208572+0000","last_peered":"2024-09-17T01:54:45.208572+0000","last_clean":"2024-09-17T01:54:45.208572+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:54:45.208572+0000","last_undegraded":"2024-09-17T01:54:45.208572+0000","last_fullsized":"2024-09-17T01:54:45.208572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086178+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:54:46.086178+0000","last_peered":"2024-09-17T01:54:46.086178+0000","last_clean":"2024-09-17T01:54:46.086178+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:54:46.086178+0000","last_undegraded":"2024-09-17T01:54:46.086178+0000","last_fullsized":"2024-09-17T01:54:46.086178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086385+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:54:46.086385+0000","last_peered":"2024-09-17T01:54:46.086385+0000","last_clean":"2024-09-17T01:54:46.086385+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:54:46.086385+0000","last_undegraded":"2024-09-17T01:54:46.086385+0000","last_fullsized":"2024-09-17T01:54:46.086385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085984+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:54:46.085984+0000","last_peered":"2024-09-17T01:54:46.085984+0000","last_clean":"2024-09-17T01:54:46.085984+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:54:46.085984+0000","last_undegraded":"2024-09-17T01:54:46.085984+0000","last_fullsized":"2024-09-17T01:54:46.085984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.210877+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:54:45.210877+0000","last_peered":"2024-09-17T01:54:45.210877+0000","last_clean":"2024-09-17T01:54:45.210877+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:54:45.210877+0000","last_undegraded":"2024-09-17T01:54:45.210877+0000","last_fullsized":"2024-09-17T01:54:45.210877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T01:54:45.101950+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:54:45.101950+0000","last_peered":"2024-09-17T01:54:45.101950+0000","last_clean":"2024-09-17T01:54:45.101950+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:54:45.101950+0000","last_undegraded":"2024-09-17T01:54:45.101950+0000","last_fullsized":"2024-09-17T01:54:45.101950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:29.976598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.147967+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:54:46.147967+0000","last_peered":"2024-09-17T01:54:46.147967+0000","last_clean":"2024-09-17T01:54:46.147967+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:54:46.147967+0000","last_undegraded":"2024-09-17T01:54:46.147967+0000","last_fullsized":"2024-09-17T01:54:46.147967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085228+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:54:46.085228+0000","last_peered":"2024-09-17T01:54:46.085228+0000","last_clean":"2024-09-17T01:54:46.085228+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:54:46.085228+0000","last_undegraded":"2024-09-17T01:54:46.085228+0000","last_fullsized":"2024-09-17T01:54:46.085228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.148098+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:54:46.148098+0000","last_peered":"2024-09-17T01:54:46.148098+0000","last_clean":"2024-09-17T01:54:46.148098+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:54:46.148098+0000","last_undegraded":"2024-09-17T01:54:46.148098+0000","last_fullsized":"2024-09-17T01:54:46.148098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":651803,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":237568,"data_stored":646537,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:54:49.612 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:54:49.612 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T01:54:49.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T01:54:49.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T01:54:49.613 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T01:54:49.979 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:49.996 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3163310925},{"type":"v1","addr":"172.21.15.63:6801","nonce":3163310925}]},"active_addr":"172.21.15.63:6801/3163310925","active_change":"2024-09-17T01:54:27.957623+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3888038811}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":376518805}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3109162826}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":831122708}]}]} 2024-09-17T01:54:49.999 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T01:54:49.999 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T01:54:50.000 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:50.285 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:50.285 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:46.062690+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:50.303 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T01:54:50.303 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:50.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:50.603 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:46.062690+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:50.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T01:54:50.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T01:54:50.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T01:54:50.780 INFO:teuthology.orchestra.run.smithi063.stdout:34359738375 2024-09-17T01:54:50.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T01:54:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:34359738374 2024-09-17T01:54:50.782 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T01:54:50.784 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-17T01:54:50.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T01:54:51.071 INFO:teuthology.orchestra.run.smithi063.stdout:34359738374 2024-09-17T01:54:51.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-17T01:54:51.107 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-17T01:54:51.118 INFO:teuthology.orchestra.run.smithi063.stdout:34359738372 2024-09-17T01:54:51.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-17T01:54:51.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-09-17T01:54:52.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T01:54:52.127 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T01:54:52.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T01:54:52.420 INFO:teuthology.orchestra.run.smithi063.stdout:34359738374 2024-09-17T01:54:52.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-17T01:54:52.442 INFO:teuthology.orchestra.run.smithi063.stdout:34359738372 2024-09-17T01:54:52.444 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-17T01:54:52.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-09-17T01:54:52.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-17T01:54:53.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T01:54:53.462 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T01:54:53.463 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T01:54:53.763 INFO:teuthology.orchestra.run.smithi063.stdout:34359738375 2024-09-17T01:54:53.779 INFO:teuthology.orchestra.run.smithi063.stdout:34359738374 2024-09-17T01:54:53.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-17T01:54:53.781 DEBUG:teuthology.parallel:result is None 2024-09-17T01:54:53.790 INFO:teuthology.orchestra.run.smithi063.stdout:34359738373 2024-09-17T01:54:53.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-17T01:54:53.798 DEBUG:teuthology.parallel:result is None 2024-09-17T01:54:53.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-09-17T01:54:53.808 DEBUG:teuthology.parallel:result is None 2024-09-17T01:54:53.809 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:54:53.809 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:54:54.139 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:54.141 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:54:54.156 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-17T01:54:53.976039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90072,"kb_used_data":664,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025448,"statfs":{"total":289910292480,"available":289818058752,"internally_reserved":0,"allocated":679936,"data_stored":1362612,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002381"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761800+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:54:51.761800+0000","last_peered":"2024-09-17T01:54:51.761800+0000","last_clean":"2024-09-17T01:54:51.761800+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:54:51.761800+0000","last_undegraded":"2024-09-17T01:54:51.761800+0000","last_fullsized":"2024-09-17T01:54:51.761800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760791+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:54:51.760791+0000","last_peered":"2024-09-17T01:54:51.760791+0000","last_clean":"2024-09-17T01:54:51.760791+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:54:51.760791+0000","last_undegraded":"2024-09-17T01:54:51.760791+0000","last_fullsized":"2024-09-17T01:54:51.760791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085172+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:54:46.085172+0000","last_peered":"2024-09-17T01:54:46.085172+0000","last_clean":"2024-09-17T01:54:46.085172+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:54:46.085172+0000","last_undegraded":"2024-09-17T01:54:46.085172+0000","last_fullsized":"2024-09-17T01:54:46.085172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086124+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:54:46.086124+0000","last_peered":"2024-09-17T01:54:46.086124+0000","last_clean":"2024-09-17T01:54:46.086124+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:54:46.086124+0000","last_undegraded":"2024-09-17T01:54:46.086124+0000","last_fullsized":"2024-09-17T01:54:46.086124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761214+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:54:51.761214+0000","last_peered":"2024-09-17T01:54:51.761214+0000","last_clean":"2024-09-17T01:54:51.761214+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:54:51.761214+0000","last_undegraded":"2024-09-17T01:54:51.761214+0000","last_fullsized":"2024-09-17T01:54:51.761214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085234+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:54:46.085234+0000","last_peered":"2024-09-17T01:54:46.085234+0000","last_clean":"2024-09-17T01:54:46.085234+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:54:46.085234+0000","last_undegraded":"2024-09-17T01:54:46.085234+0000","last_fullsized":"2024-09-17T01:54:46.085234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084719+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:54:46.084719+0000","last_peered":"2024-09-17T01:54:46.084719+0000","last_clean":"2024-09-17T01:54:46.084719+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:54:46.084719+0000","last_undegraded":"2024-09-17T01:54:46.084719+0000","last_fullsized":"2024-09-17T01:54:46.084719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084228+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:54:46.084228+0000","last_peered":"2024-09-17T01:54:46.084228+0000","last_clean":"2024-09-17T01:54:46.084228+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:54:46.084228+0000","last_undegraded":"2024-09-17T01:54:46.084228+0000","last_fullsized":"2024-09-17T01:54:46.084228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047987+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:54:52.047987+0000","last_peered":"2024-09-17T01:54:52.047987+0000","last_clean":"2024-09-17T01:54:52.047987+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:54:52.047987+0000","last_undegraded":"2024-09-17T01:54:52.047987+0000","last_fullsized":"2024-09-17T01:54:52.047987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761041+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:54:51.761041+0000","last_peered":"2024-09-17T01:54:51.761041+0000","last_clean":"2024-09-17T01:54:51.761041+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:54:51.761041+0000","last_undegraded":"2024-09-17T01:54:51.761041+0000","last_fullsized":"2024-09-17T01:54:51.761041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086169+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:54:46.086169+0000","last_peered":"2024-09-17T01:54:46.086169+0000","last_clean":"2024-09-17T01:54:46.086169+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:54:46.086169+0000","last_undegraded":"2024-09-17T01:54:46.086169+0000","last_fullsized":"2024-09-17T01:54:46.086169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761113+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:54:51.761113+0000","last_peered":"2024-09-17T01:54:51.761113+0000","last_clean":"2024-09-17T01:54:51.761113+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:54:51.761113+0000","last_undegraded":"2024-09-17T01:54:51.761113+0000","last_fullsized":"2024-09-17T01:54:51.761113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760839+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:54:51.760839+0000","last_peered":"2024-09-17T01:54:51.760839+0000","last_clean":"2024-09-17T01:54:51.760839+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:54:51.760839+0000","last_undegraded":"2024-09-17T01:54:51.760839+0000","last_fullsized":"2024-09-17T01:54:51.760839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084990+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:54:46.084990+0000","last_peered":"2024-09-17T01:54:46.084990+0000","last_clean":"2024-09-17T01:54:46.084990+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:54:46.084990+0000","last_undegraded":"2024-09-17T01:54:46.084990+0000","last_fullsized":"2024-09-17T01:54:46.084990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084800+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:54:46.084800+0000","last_peered":"2024-09-17T01:54:46.084800+0000","last_clean":"2024-09-17T01:54:46.084800+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:54:46.084800+0000","last_undegraded":"2024-09-17T01:54:46.084800+0000","last_fullsized":"2024-09-17T01:54:46.084800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084333+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:54:46.084333+0000","last_peered":"2024-09-17T01:54:46.084333+0000","last_clean":"2024-09-17T01:54:46.084333+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:54:46.084333+0000","last_undegraded":"2024-09-17T01:54:46.084333+0000","last_fullsized":"2024-09-17T01:54:46.084333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048707+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:54:52.048707+0000","last_peered":"2024-09-17T01:54:52.048707+0000","last_clean":"2024-09-17T01:54:52.048707+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:54:52.048707+0000","last_undegraded":"2024-09-17T01:54:52.048707+0000","last_fullsized":"2024-09-17T01:54:52.048707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761836+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:54:51.761836+0000","last_peered":"2024-09-17T01:54:51.761836+0000","last_clean":"2024-09-17T01:54:51.761836+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:54:51.761836+0000","last_undegraded":"2024-09-17T01:54:51.761836+0000","last_fullsized":"2024-09-17T01:54:51.761836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047807+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:54:52.047807+0000","last_peered":"2024-09-17T01:54:52.047807+0000","last_clean":"2024-09-17T01:54:52.047807+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:54:52.047807+0000","last_undegraded":"2024-09-17T01:54:52.047807+0000","last_fullsized":"2024-09-17T01:54:52.047807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086067+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:54:46.086067+0000","last_peered":"2024-09-17T01:54:46.086067+0000","last_clean":"2024-09-17T01:54:46.086067+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:54:46.086067+0000","last_undegraded":"2024-09-17T01:54:46.086067+0000","last_fullsized":"2024-09-17T01:54:46.086067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085634+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:54:46.085634+0000","last_peered":"2024-09-17T01:54:46.085634+0000","last_clean":"2024-09-17T01:54:46.085634+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:54:46.085634+0000","last_undegraded":"2024-09-17T01:54:46.085634+0000","last_fullsized":"2024-09-17T01:54:46.085634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760250+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:54:51.760250+0000","last_peered":"2024-09-17T01:54:51.760250+0000","last_clean":"2024-09-17T01:54:51.760250+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:54:51.760250+0000","last_undegraded":"2024-09-17T01:54:51.760250+0000","last_fullsized":"2024-09-17T01:54:51.760250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045717+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:54:52.045717+0000","last_peered":"2024-09-17T01:54:52.045717+0000","last_clean":"2024-09-17T01:54:52.045717+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:54:52.045717+0000","last_undegraded":"2024-09-17T01:54:52.045717+0000","last_fullsized":"2024-09-17T01:54:52.045717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759679+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:54:51.759679+0000","last_peered":"2024-09-17T01:54:51.759679+0000","last_clean":"2024-09-17T01:54:51.759679+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:54:51.759679+0000","last_undegraded":"2024-09-17T01:54:51.759679+0000","last_fullsized":"2024-09-17T01:54:51.759679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761971+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:54:51.761971+0000","last_peered":"2024-09-17T01:54:51.761971+0000","last_clean":"2024-09-17T01:54:51.761971+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:54:51.761971+0000","last_undegraded":"2024-09-17T01:54:51.761971+0000","last_fullsized":"2024-09-17T01:54:51.761971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047934+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:54:52.047934+0000","last_peered":"2024-09-17T01:54:52.047934+0000","last_clean":"2024-09-17T01:54:52.047934+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:54:52.047934+0000","last_undegraded":"2024-09-17T01:54:52.047934+0000","last_fullsized":"2024-09-17T01:54:52.047934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086599+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:54:46.086599+0000","last_peered":"2024-09-17T01:54:46.086599+0000","last_clean":"2024-09-17T01:54:46.086599+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:54:46.086599+0000","last_undegraded":"2024-09-17T01:54:46.086599+0000","last_fullsized":"2024-09-17T01:54:46.086599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761581+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:54:51.761581+0000","last_peered":"2024-09-17T01:54:51.761581+0000","last_clean":"2024-09-17T01:54:51.761581+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:54:51.761581+0000","last_undegraded":"2024-09-17T01:54:51.761581+0000","last_fullsized":"2024-09-17T01:54:51.761581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046926+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:54:52.046926+0000","last_peered":"2024-09-17T01:54:52.046926+0000","last_clean":"2024-09-17T01:54:52.046926+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:54:52.046926+0000","last_undegraded":"2024-09-17T01:54:52.046926+0000","last_fullsized":"2024-09-17T01:54:52.046926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760578+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:54:51.760578+0000","last_peered":"2024-09-17T01:54:51.760578+0000","last_clean":"2024-09-17T01:54:51.760578+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:54:51.760578+0000","last_undegraded":"2024-09-17T01:54:51.760578+0000","last_fullsized":"2024-09-17T01:54:51.760578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045825+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:54:52.045825+0000","last_peered":"2024-09-17T01:54:52.045825+0000","last_clean":"2024-09-17T01:54:52.045825+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:54:52.045825+0000","last_undegraded":"2024-09-17T01:54:52.045825+0000","last_fullsized":"2024-09-17T01:54:52.045825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084709+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:54:46.084709+0000","last_peered":"2024-09-17T01:54:46.084709+0000","last_clean":"2024-09-17T01:54:46.084709+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:54:46.084709+0000","last_undegraded":"2024-09-17T01:54:46.084709+0000","last_fullsized":"2024-09-17T01:54:46.084709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761358+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:54:51.761358+0000","last_peered":"2024-09-17T01:54:51.761358+0000","last_clean":"2024-09-17T01:54:51.761358+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:54:51.761358+0000","last_undegraded":"2024-09-17T01:54:51.761358+0000","last_fullsized":"2024-09-17T01:54:51.761358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086624+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:54:46.086624+0000","last_peered":"2024-09-17T01:54:46.086624+0000","last_clean":"2024-09-17T01:54:46.086624+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:54:46.086624+0000","last_undegraded":"2024-09-17T01:54:46.086624+0000","last_fullsized":"2024-09-17T01:54:46.086624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761256+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:54:51.761256+0000","last_peered":"2024-09-17T01:54:51.761256+0000","last_clean":"2024-09-17T01:54:51.761256+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:54:51.761256+0000","last_undegraded":"2024-09-17T01:54:51.761256+0000","last_fullsized":"2024-09-17T01:54:51.761256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046506+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:54:52.046506+0000","last_peered":"2024-09-17T01:54:52.046506+0000","last_clean":"2024-09-17T01:54:52.046506+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:54:52.046506+0000","last_undegraded":"2024-09-17T01:54:52.046506+0000","last_fullsized":"2024-09-17T01:54:52.046506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048381+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:54:52.048381+0000","last_peered":"2024-09-17T01:54:52.048381+0000","last_clean":"2024-09-17T01:54:52.048381+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:54:52.048381+0000","last_undegraded":"2024-09-17T01:54:52.048381+0000","last_fullsized":"2024-09-17T01:54:52.048381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760219+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:54:51.760219+0000","last_peered":"2024-09-17T01:54:51.760219+0000","last_clean":"2024-09-17T01:54:51.760219+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:54:51.760219+0000","last_undegraded":"2024-09-17T01:54:51.760219+0000","last_fullsized":"2024-09-17T01:54:51.760219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048104+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:54:52.048104+0000","last_peered":"2024-09-17T01:54:52.048104+0000","last_clean":"2024-09-17T01:54:52.048104+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:54:52.048104+0000","last_undegraded":"2024-09-17T01:54:52.048104+0000","last_fullsized":"2024-09-17T01:54:52.048104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084599+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:54:46.084599+0000","last_peered":"2024-09-17T01:54:46.084599+0000","last_clean":"2024-09-17T01:54:46.084599+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:54:46.084599+0000","last_undegraded":"2024-09-17T01:54:46.084599+0000","last_fullsized":"2024-09-17T01:54:46.084599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085662+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:54:46.085662+0000","last_peered":"2024-09-17T01:54:46.085662+0000","last_clean":"2024-09-17T01:54:46.085662+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:54:46.085662+0000","last_undegraded":"2024-09-17T01:54:46.085662+0000","last_fullsized":"2024-09-17T01:54:46.085662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759780+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:54:51.759780+0000","last_peered":"2024-09-17T01:54:51.759780+0000","last_clean":"2024-09-17T01:54:51.759780+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:54:51.759780+0000","last_undegraded":"2024-09-17T01:54:51.759780+0000","last_fullsized":"2024-09-17T01:54:51.759780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761918+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:54:51.761918+0000","last_peered":"2024-09-17T01:54:51.761918+0000","last_clean":"2024-09-17T01:54:51.761918+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:54:51.761918+0000","last_undegraded":"2024-09-17T01:54:51.761918+0000","last_fullsized":"2024-09-17T01:54:51.761918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759924+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:54:51.759924+0000","last_peered":"2024-09-17T01:54:51.759924+0000","last_clean":"2024-09-17T01:54:51.759924+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:54:51.759924+0000","last_undegraded":"2024-09-17T01:54:51.759924+0000","last_fullsized":"2024-09-17T01:54:51.759924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087126+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:54:46.087126+0000","last_peered":"2024-09-17T01:54:46.087126+0000","last_clean":"2024-09-17T01:54:46.087126+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:54:46.087126+0000","last_undegraded":"2024-09-17T01:54:46.087126+0000","last_fullsized":"2024-09-17T01:54:46.087126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086153+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:54:46.086153+0000","last_peered":"2024-09-17T01:54:46.086153+0000","last_clean":"2024-09-17T01:54:46.086153+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:54:46.086153+0000","last_undegraded":"2024-09-17T01:54:46.086153+0000","last_fullsized":"2024-09-17T01:54:46.086153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086752+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:54:46.086752+0000","last_peered":"2024-09-17T01:54:46.086752+0000","last_clean":"2024-09-17T01:54:46.086752+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:54:46.086752+0000","last_undegraded":"2024-09-17T01:54:46.086752+0000","last_fullsized":"2024-09-17T01:54:46.086752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046429+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:54:52.046429+0000","last_peered":"2024-09-17T01:54:52.046429+0000","last_clean":"2024-09-17T01:54:52.046429+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:54:52.046429+0000","last_undegraded":"2024-09-17T01:54:52.046429+0000","last_fullsized":"2024-09-17T01:54:52.046429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047307+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:54:52.047307+0000","last_peered":"2024-09-17T01:54:52.047307+0000","last_clean":"2024-09-17T01:54:52.047307+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:54:52.047307+0000","last_undegraded":"2024-09-17T01:54:52.047307+0000","last_fullsized":"2024-09-17T01:54:52.047307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086489+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:54:46.086489+0000","last_peered":"2024-09-17T01:54:46.086489+0000","last_clean":"2024-09-17T01:54:46.086489+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:54:46.086489+0000","last_undegraded":"2024-09-17T01:54:46.086489+0000","last_fullsized":"2024-09-17T01:54:46.086489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086282+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:54:46.086282+0000","last_peered":"2024-09-17T01:54:46.086282+0000","last_clean":"2024-09-17T01:54:46.086282+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:54:46.086282+0000","last_undegraded":"2024-09-17T01:54:46.086282+0000","last_fullsized":"2024-09-17T01:54:46.086282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086808+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:54:46.086808+0000","last_peered":"2024-09-17T01:54:46.086808+0000","last_clean":"2024-09-17T01:54:46.086808+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:54:46.086808+0000","last_undegraded":"2024-09-17T01:54:46.086808+0000","last_fullsized":"2024-09-17T01:54:46.086808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760302+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:54:51.760302+0000","last_peered":"2024-09-17T01:54:51.760302+0000","last_clean":"2024-09-17T01:54:51.760302+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:54:51.760302+0000","last_undegraded":"2024-09-17T01:54:51.760302+0000","last_fullsized":"2024-09-17T01:54:51.760302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085872+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:54:46.085872+0000","last_peered":"2024-09-17T01:54:46.085872+0000","last_clean":"2024-09-17T01:54:46.085872+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:54:46.085872+0000","last_undegraded":"2024-09-17T01:54:46.085872+0000","last_fullsized":"2024-09-17T01:54:46.085872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759889+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:54:51.759889+0000","last_peered":"2024-09-17T01:54:51.759889+0000","last_clean":"2024-09-17T01:54:51.759889+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:54:51.759889+0000","last_undegraded":"2024-09-17T01:54:51.759889+0000","last_fullsized":"2024-09-17T01:54:51.759889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048271+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:54:52.048271+0000","last_peered":"2024-09-17T01:54:52.048271+0000","last_clean":"2024-09-17T01:54:52.048271+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:54:52.048271+0000","last_undegraded":"2024-09-17T01:54:52.048271+0000","last_fullsized":"2024-09-17T01:54:52.048271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085728+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:54:46.085728+0000","last_peered":"2024-09-17T01:54:46.085728+0000","last_clean":"2024-09-17T01:54:46.085728+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:54:46.085728+0000","last_undegraded":"2024-09-17T01:54:46.085728+0000","last_fullsized":"2024-09-17T01:54:46.085728+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086866+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:54:46.086866+0000","last_peered":"2024-09-17T01:54:46.086866+0000","last_clean":"2024-09-17T01:54:46.086866+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:54:46.086866+0000","last_undegraded":"2024-09-17T01:54:46.086866+0000","last_fullsized":"2024-09-17T01:54:46.086866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046780+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:54:52.046780+0000","last_peered":"2024-09-17T01:54:52.046780+0000","last_clean":"2024-09-17T01:54:52.046780+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:54:52.046780+0000","last_undegraded":"2024-09-17T01:54:52.046780+0000","last_fullsized":"2024-09-17T01:54:52.046780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086868+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:54:46.086868+0000","last_peered":"2024-09-17T01:54:46.086868+0000","last_clean":"2024-09-17T01:54:46.086868+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:54:46.086868+0000","last_undegraded":"2024-09-17T01:54:46.086868+0000","last_fullsized":"2024-09-17T01:54:46.086868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085717+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:54:46.085717+0000","last_peered":"2024-09-17T01:54:46.085717+0000","last_clean":"2024-09-17T01:54:46.085717+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:54:46.085717+0000","last_undegraded":"2024-09-17T01:54:46.085717+0000","last_fullsized":"2024-09-17T01:54:46.085717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046329+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:54:52.046329+0000","last_peered":"2024-09-17T01:54:52.046329+0000","last_clean":"2024-09-17T01:54:52.046329+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:54:52.046329+0000","last_undegraded":"2024-09-17T01:54:52.046329+0000","last_fullsized":"2024-09-17T01:54:52.046329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761354+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:54:51.761354+0000","last_peered":"2024-09-17T01:54:51.761354+0000","last_clean":"2024-09-17T01:54:51.761354+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:54:51.761354+0000","last_undegraded":"2024-09-17T01:54:51.761354+0000","last_fullsized":"2024-09-17T01:54:51.761354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046881+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:54:52.046881+0000","last_peered":"2024-09-17T01:54:52.046881+0000","last_clean":"2024-09-17T01:54:52.046881+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:54:52.046881+0000","last_undegraded":"2024-09-17T01:54:52.046881+0000","last_fullsized":"2024-09-17T01:54:52.046881+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760073+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:54:51.760073+0000","last_peered":"2024-09-17T01:54:51.760073+0000","last_clean":"2024-09-17T01:54:51.760073+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:54:51.760073+0000","last_undegraded":"2024-09-17T01:54:51.760073+0000","last_fullsized":"2024-09-17T01:54:51.760073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048326+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:54:52.048326+0000","last_peered":"2024-09-17T01:54:52.048326+0000","last_clean":"2024-09-17T01:54:52.048326+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:54:52.048326+0000","last_undegraded":"2024-09-17T01:54:52.048326+0000","last_fullsized":"2024-09-17T01:54:52.048326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086322+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:54:46.086322+0000","last_peered":"2024-09-17T01:54:46.086322+0000","last_clean":"2024-09-17T01:54:46.086322+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:54:46.086322+0000","last_undegraded":"2024-09-17T01:54:46.086322+0000","last_fullsized":"2024-09-17T01:54:46.086322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086860+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:54:46.086860+0000","last_peered":"2024-09-17T01:54:46.086860+0000","last_clean":"2024-09-17T01:54:46.086860+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:54:46.086860+0000","last_undegraded":"2024-09-17T01:54:46.086860+0000","last_fullsized":"2024-09-17T01:54:46.086860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047575+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:54:52.047575+0000","last_peered":"2024-09-17T01:54:52.047575+0000","last_clean":"2024-09-17T01:54:52.047575+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:54:52.047575+0000","last_undegraded":"2024-09-17T01:54:52.047575+0000","last_fullsized":"2024-09-17T01:54:52.047575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087036+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:54:46.087036+0000","last_peered":"2024-09-17T01:54:46.087036+0000","last_clean":"2024-09-17T01:54:46.087036+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:54:46.087036+0000","last_undegraded":"2024-09-17T01:54:46.087036+0000","last_fullsized":"2024-09-17T01:54:46.087036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048158+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:54:52.048158+0000","last_peered":"2024-09-17T01:54:52.048158+0000","last_clean":"2024-09-17T01:54:52.048158+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:54:52.048158+0000","last_undegraded":"2024-09-17T01:54:52.048158+0000","last_fullsized":"2024-09-17T01:54:52.048158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760247+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:54:51.760247+0000","last_peered":"2024-09-17T01:54:51.760247+0000","last_clean":"2024-09-17T01:54:51.760247+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:54:51.760247+0000","last_undegraded":"2024-09-17T01:54:51.760247+0000","last_fullsized":"2024-09-17T01:54:51.760247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048046+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:54:52.048046+0000","last_peered":"2024-09-17T01:54:52.048046+0000","last_clean":"2024-09-17T01:54:52.048046+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:54:52.048046+0000","last_undegraded":"2024-09-17T01:54:52.048046+0000","last_fullsized":"2024-09-17T01:54:52.048046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762206+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:54:51.762206+0000","last_peered":"2024-09-17T01:54:51.762206+0000","last_clean":"2024-09-17T01:54:51.762206+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:54:51.762206+0000","last_undegraded":"2024-09-17T01:54:51.762206+0000","last_fullsized":"2024-09-17T01:54:51.762206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761076+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:54:51.761076+0000","last_peered":"2024-09-17T01:54:51.761076+0000","last_clean":"2024-09-17T01:54:51.761076+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:54:51.761076+0000","last_undegraded":"2024-09-17T01:54:51.761076+0000","last_fullsized":"2024-09-17T01:54:51.761076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048881+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:54:52.048881+0000","last_peered":"2024-09-17T01:54:52.048881+0000","last_clean":"2024-09-17T01:54:52.048881+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:54:52.048881+0000","last_undegraded":"2024-09-17T01:54:52.048881+0000","last_fullsized":"2024-09-17T01:54:52.048881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048723+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:54:52.048723+0000","last_peered":"2024-09-17T01:54:52.048723+0000","last_clean":"2024-09-17T01:54:52.048723+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:54:52.048723+0000","last_undegraded":"2024-09-17T01:54:52.048723+0000","last_fullsized":"2024-09-17T01:54:52.048723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046260+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:54:52.046260+0000","last_peered":"2024-09-17T01:54:52.046260+0000","last_clean":"2024-09-17T01:54:52.046260+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:54:52.046260+0000","last_undegraded":"2024-09-17T01:54:52.046260+0000","last_fullsized":"2024-09-17T01:54:52.046260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048626+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:54:52.048626+0000","last_peered":"2024-09-17T01:54:52.048626+0000","last_clean":"2024-09-17T01:54:52.048626+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:54:52.048626+0000","last_undegraded":"2024-09-17T01:54:52.048626+0000","last_fullsized":"2024-09-17T01:54:52.048626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085617+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:54:46.085617+0000","last_peered":"2024-09-17T01:54:46.085617+0000","last_clean":"2024-09-17T01:54:46.085617+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:54:46.085617+0000","last_undegraded":"2024-09-17T01:54:46.085617+0000","last_fullsized":"2024-09-17T01:54:46.085617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759943+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:54:51.759943+0000","last_peered":"2024-09-17T01:54:51.759943+0000","last_clean":"2024-09-17T01:54:51.759943+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:54:51.759943+0000","last_undegraded":"2024-09-17T01:54:51.759943+0000","last_fullsized":"2024-09-17T01:54:51.759943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086658+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:54:46.086658+0000","last_peered":"2024-09-17T01:54:46.086658+0000","last_clean":"2024-09-17T01:54:46.086658+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:54:46.086658+0000","last_undegraded":"2024-09-17T01:54:46.086658+0000","last_fullsized":"2024-09-17T01:54:46.086658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086598+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:54:46.086598+0000","last_peered":"2024-09-17T01:54:46.086598+0000","last_clean":"2024-09-17T01:54:46.086598+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:54:46.086598+0000","last_undegraded":"2024-09-17T01:54:46.086598+0000","last_fullsized":"2024-09-17T01:54:46.086598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046124+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:54:52.046124+0000","last_peered":"2024-09-17T01:54:52.046124+0000","last_clean":"2024-09-17T01:54:52.046124+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:54:52.046124+0000","last_undegraded":"2024-09-17T01:54:52.046124+0000","last_fullsized":"2024-09-17T01:54:52.046124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761916+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:54:51.761916+0000","last_peered":"2024-09-17T01:54:51.761916+0000","last_clean":"2024-09-17T01:54:51.761916+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:54:51.761916+0000","last_undegraded":"2024-09-17T01:54:51.761916+0000","last_fullsized":"2024-09-17T01:54:51.761916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085763+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:54:46.085763+0000","last_peered":"2024-09-17T01:54:46.085763+0000","last_clean":"2024-09-17T01:54:46.085763+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:54:46.085763+0000","last_undegraded":"2024-09-17T01:54:46.085763+0000","last_fullsized":"2024-09-17T01:54:46.085763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045996+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:54:52.045996+0000","last_peered":"2024-09-17T01:54:52.045996+0000","last_clean":"2024-09-17T01:54:52.045996+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:54:52.045996+0000","last_undegraded":"2024-09-17T01:54:52.045996+0000","last_fullsized":"2024-09-17T01:54:52.045996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048711+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:54:52.048711+0000","last_peered":"2024-09-17T01:54:52.048711+0000","last_clean":"2024-09-17T01:54:52.048711+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:54:52.048711+0000","last_undegraded":"2024-09-17T01:54:52.048711+0000","last_fullsized":"2024-09-17T01:54:52.048711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046028+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:54:52.046028+0000","last_peered":"2024-09-17T01:54:52.046028+0000","last_clean":"2024-09-17T01:54:52.046028+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:54:52.046028+0000","last_undegraded":"2024-09-17T01:54:52.046028+0000","last_fullsized":"2024-09-17T01:54:52.046028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762090+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:54:51.762090+0000","last_peered":"2024-09-17T01:54:51.762090+0000","last_clean":"2024-09-17T01:54:51.762090+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:54:51.762090+0000","last_undegraded":"2024-09-17T01:54:51.762090+0000","last_fullsized":"2024-09-17T01:54:51.762090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046353+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:54:52.046353+0000","last_peered":"2024-09-17T01:54:52.046353+0000","last_clean":"2024-09-17T01:54:52.046353+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:54:52.046353+0000","last_undegraded":"2024-09-17T01:54:52.046353+0000","last_fullsized":"2024-09-17T01:54:52.046353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047872+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:54:52.047872+0000","last_peered":"2024-09-17T01:54:52.047872+0000","last_clean":"2024-09-17T01:54:52.047872+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:54:52.047872+0000","last_undegraded":"2024-09-17T01:54:52.047872+0000","last_fullsized":"2024-09-17T01:54:52.047872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046511+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:54:52.046511+0000","last_peered":"2024-09-17T01:54:52.046511+0000","last_clean":"2024-09-17T01:54:52.046511+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:54:52.046511+0000","last_undegraded":"2024-09-17T01:54:52.046511+0000","last_fullsized":"2024-09-17T01:54:52.046511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761094+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:54:51.761094+0000","last_peered":"2024-09-17T01:54:51.761094+0000","last_clean":"2024-09-17T01:54:51.761094+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:54:51.761094+0000","last_undegraded":"2024-09-17T01:54:51.761094+0000","last_fullsized":"2024-09-17T01:54:51.761094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760882+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:54:51.760882+0000","last_peered":"2024-09-17T01:54:51.760882+0000","last_clean":"2024-09-17T01:54:51.760882+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:54:51.760882+0000","last_undegraded":"2024-09-17T01:54:51.760882+0000","last_fullsized":"2024-09-17T01:54:51.760882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761252+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:54:51.761252+0000","last_peered":"2024-09-17T01:54:51.761252+0000","last_clean":"2024-09-17T01:54:51.761252+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:54:51.761252+0000","last_undegraded":"2024-09-17T01:54:51.761252+0000","last_fullsized":"2024-09-17T01:54:51.761252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761328+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:54:51.761328+0000","last_peered":"2024-09-17T01:54:51.761328+0000","last_clean":"2024-09-17T01:54:51.761328+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:54:51.761328+0000","last_undegraded":"2024-09-17T01:54:51.761328+0000","last_fullsized":"2024-09-17T01:54:51.761328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086178+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:54:46.086178+0000","last_peered":"2024-09-17T01:54:46.086178+0000","last_clean":"2024-09-17T01:54:46.086178+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:54:46.086178+0000","last_undegraded":"2024-09-17T01:54:46.086178+0000","last_fullsized":"2024-09-17T01:54:46.086178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086385+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:54:46.086385+0000","last_peered":"2024-09-17T01:54:46.086385+0000","last_clean":"2024-09-17T01:54:46.086385+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:54:46.086385+0000","last_undegraded":"2024-09-17T01:54:46.086385+0000","last_fullsized":"2024-09-17T01:54:46.086385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085984+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:54:46.085984+0000","last_peered":"2024-09-17T01:54:46.085984+0000","last_clean":"2024-09-17T01:54:46.085984+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:54:46.085984+0000","last_undegraded":"2024-09-17T01:54:46.085984+0000","last_fullsized":"2024-09-17T01:54:46.085984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761513+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:54:51.761513+0000","last_peered":"2024-09-17T01:54:51.761513+0000","last_clean":"2024-09-17T01:54:51.761513+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:54:51.761513+0000","last_undegraded":"2024-09-17T01:54:51.761513+0000","last_fullsized":"2024-09-17T01:54:51.761513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760671+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:54:51.760671+0000","last_peered":"2024-09-17T01:54:51.760671+0000","last_clean":"2024-09-17T01:54:51.760671+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:54:51.760671+0000","last_undegraded":"2024-09-17T01:54:51.760671+0000","last_fullsized":"2024-09-17T01:54:51.760671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048319+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:54:52.048319+0000","last_peered":"2024-09-17T01:54:52.048319+0000","last_clean":"2024-09-17T01:54:52.048319+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:54:52.048319+0000","last_undegraded":"2024-09-17T01:54:52.048319+0000","last_fullsized":"2024-09-17T01:54:52.048319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085228+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:54:46.085228+0000","last_peered":"2024-09-17T01:54:46.085228+0000","last_clean":"2024-09-17T01:54:46.085228+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:54:46.085228+0000","last_undegraded":"2024-09-17T01:54:46.085228+0000","last_fullsized":"2024-09-17T01:54:46.085228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048549+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:54:52.048549+0000","last_peered":"2024-09-17T01:54:52.048549+0000","last_clean":"2024-09-17T01:54:52.048549+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:54:52.048549+0000","last_undegraded":"2024-09-17T01:54:52.048549+0000","last_fullsized":"2024-09-17T01:54:52.048549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":651803,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":651168,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:54:54.161 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:54:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:54.515 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:54:54.533 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-17T01:54:53.976039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90072,"kb_used_data":664,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025448,"statfs":{"total":289910292480,"available":289818058752,"internally_reserved":0,"allocated":679936,"data_stored":1362612,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002381"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761800+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:54:51.761800+0000","last_peered":"2024-09-17T01:54:51.761800+0000","last_clean":"2024-09-17T01:54:51.761800+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:54:51.761800+0000","last_undegraded":"2024-09-17T01:54:51.761800+0000","last_fullsized":"2024-09-17T01:54:51.761800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760791+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:54:51.760791+0000","last_peered":"2024-09-17T01:54:51.760791+0000","last_clean":"2024-09-17T01:54:51.760791+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:54:51.760791+0000","last_undegraded":"2024-09-17T01:54:51.760791+0000","last_fullsized":"2024-09-17T01:54:51.760791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085172+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:54:46.085172+0000","last_peered":"2024-09-17T01:54:46.085172+0000","last_clean":"2024-09-17T01:54:46.085172+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:54:46.085172+0000","last_undegraded":"2024-09-17T01:54:46.085172+0000","last_fullsized":"2024-09-17T01:54:46.085172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086124+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:54:46.086124+0000","last_peered":"2024-09-17T01:54:46.086124+0000","last_clean":"2024-09-17T01:54:46.086124+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:54:46.086124+0000","last_undegraded":"2024-09-17T01:54:46.086124+0000","last_fullsized":"2024-09-17T01:54:46.086124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761214+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:54:51.761214+0000","last_peered":"2024-09-17T01:54:51.761214+0000","last_clean":"2024-09-17T01:54:51.761214+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:54:51.761214+0000","last_undegraded":"2024-09-17T01:54:51.761214+0000","last_fullsized":"2024-09-17T01:54:51.761214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085234+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:54:46.085234+0000","last_peered":"2024-09-17T01:54:46.085234+0000","last_clean":"2024-09-17T01:54:46.085234+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:54:46.085234+0000","last_undegraded":"2024-09-17T01:54:46.085234+0000","last_fullsized":"2024-09-17T01:54:46.085234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084719+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:54:46.084719+0000","last_peered":"2024-09-17T01:54:46.084719+0000","last_clean":"2024-09-17T01:54:46.084719+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:54:46.084719+0000","last_undegraded":"2024-09-17T01:54:46.084719+0000","last_fullsized":"2024-09-17T01:54:46.084719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084228+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:54:46.084228+0000","last_peered":"2024-09-17T01:54:46.084228+0000","last_clean":"2024-09-17T01:54:46.084228+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:54:46.084228+0000","last_undegraded":"2024-09-17T01:54:46.084228+0000","last_fullsized":"2024-09-17T01:54:46.084228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047987+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:54:52.047987+0000","last_peered":"2024-09-17T01:54:52.047987+0000","last_clean":"2024-09-17T01:54:52.047987+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:54:52.047987+0000","last_undegraded":"2024-09-17T01:54:52.047987+0000","last_fullsized":"2024-09-17T01:54:52.047987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761041+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:54:51.761041+0000","last_peered":"2024-09-17T01:54:51.761041+0000","last_clean":"2024-09-17T01:54:51.761041+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:54:51.761041+0000","last_undegraded":"2024-09-17T01:54:51.761041+0000","last_fullsized":"2024-09-17T01:54:51.761041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086169+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:54:46.086169+0000","last_peered":"2024-09-17T01:54:46.086169+0000","last_clean":"2024-09-17T01:54:46.086169+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:54:46.086169+0000","last_undegraded":"2024-09-17T01:54:46.086169+0000","last_fullsized":"2024-09-17T01:54:46.086169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761113+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:54:51.761113+0000","last_peered":"2024-09-17T01:54:51.761113+0000","last_clean":"2024-09-17T01:54:51.761113+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:54:51.761113+0000","last_undegraded":"2024-09-17T01:54:51.761113+0000","last_fullsized":"2024-09-17T01:54:51.761113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760839+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:54:51.760839+0000","last_peered":"2024-09-17T01:54:51.760839+0000","last_clean":"2024-09-17T01:54:51.760839+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:54:51.760839+0000","last_undegraded":"2024-09-17T01:54:51.760839+0000","last_fullsized":"2024-09-17T01:54:51.760839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084990+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:54:46.084990+0000","last_peered":"2024-09-17T01:54:46.084990+0000","last_clean":"2024-09-17T01:54:46.084990+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:54:46.084990+0000","last_undegraded":"2024-09-17T01:54:46.084990+0000","last_fullsized":"2024-09-17T01:54:46.084990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084800+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:54:46.084800+0000","last_peered":"2024-09-17T01:54:46.084800+0000","last_clean":"2024-09-17T01:54:46.084800+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:54:46.084800+0000","last_undegraded":"2024-09-17T01:54:46.084800+0000","last_fullsized":"2024-09-17T01:54:46.084800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084333+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:54:46.084333+0000","last_peered":"2024-09-17T01:54:46.084333+0000","last_clean":"2024-09-17T01:54:46.084333+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:54:46.084333+0000","last_undegraded":"2024-09-17T01:54:46.084333+0000","last_fullsized":"2024-09-17T01:54:46.084333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048707+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:54:52.048707+0000","last_peered":"2024-09-17T01:54:52.048707+0000","last_clean":"2024-09-17T01:54:52.048707+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:54:52.048707+0000","last_undegraded":"2024-09-17T01:54:52.048707+0000","last_fullsized":"2024-09-17T01:54:52.048707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761836+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:54:51.761836+0000","last_peered":"2024-09-17T01:54:51.761836+0000","last_clean":"2024-09-17T01:54:51.761836+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:54:51.761836+0000","last_undegraded":"2024-09-17T01:54:51.761836+0000","last_fullsized":"2024-09-17T01:54:51.761836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047807+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:54:52.047807+0000","last_peered":"2024-09-17T01:54:52.047807+0000","last_clean":"2024-09-17T01:54:52.047807+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:54:52.047807+0000","last_undegraded":"2024-09-17T01:54:52.047807+0000","last_fullsized":"2024-09-17T01:54:52.047807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086067+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:54:46.086067+0000","last_peered":"2024-09-17T01:54:46.086067+0000","last_clean":"2024-09-17T01:54:46.086067+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:54:46.086067+0000","last_undegraded":"2024-09-17T01:54:46.086067+0000","last_fullsized":"2024-09-17T01:54:46.086067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085634+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:54:46.085634+0000","last_peered":"2024-09-17T01:54:46.085634+0000","last_clean":"2024-09-17T01:54:46.085634+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:54:46.085634+0000","last_undegraded":"2024-09-17T01:54:46.085634+0000","last_fullsized":"2024-09-17T01:54:46.085634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760250+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:54:51.760250+0000","last_peered":"2024-09-17T01:54:51.760250+0000","last_clean":"2024-09-17T01:54:51.760250+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:54:51.760250+0000","last_undegraded":"2024-09-17T01:54:51.760250+0000","last_fullsized":"2024-09-17T01:54:51.760250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045717+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:54:52.045717+0000","last_peered":"2024-09-17T01:54:52.045717+0000","last_clean":"2024-09-17T01:54:52.045717+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:54:52.045717+0000","last_undegraded":"2024-09-17T01:54:52.045717+0000","last_fullsized":"2024-09-17T01:54:52.045717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759679+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:54:51.759679+0000","last_peered":"2024-09-17T01:54:51.759679+0000","last_clean":"2024-09-17T01:54:51.759679+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:54:51.759679+0000","last_undegraded":"2024-09-17T01:54:51.759679+0000","last_fullsized":"2024-09-17T01:54:51.759679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761971+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:54:51.761971+0000","last_peered":"2024-09-17T01:54:51.761971+0000","last_clean":"2024-09-17T01:54:51.761971+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:54:51.761971+0000","last_undegraded":"2024-09-17T01:54:51.761971+0000","last_fullsized":"2024-09-17T01:54:51.761971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047934+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:54:52.047934+0000","last_peered":"2024-09-17T01:54:52.047934+0000","last_clean":"2024-09-17T01:54:52.047934+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:54:52.047934+0000","last_undegraded":"2024-09-17T01:54:52.047934+0000","last_fullsized":"2024-09-17T01:54:52.047934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086599+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:54:46.086599+0000","last_peered":"2024-09-17T01:54:46.086599+0000","last_clean":"2024-09-17T01:54:46.086599+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:54:46.086599+0000","last_undegraded":"2024-09-17T01:54:46.086599+0000","last_fullsized":"2024-09-17T01:54:46.086599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761581+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:54:51.761581+0000","last_peered":"2024-09-17T01:54:51.761581+0000","last_clean":"2024-09-17T01:54:51.761581+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:54:51.761581+0000","last_undegraded":"2024-09-17T01:54:51.761581+0000","last_fullsized":"2024-09-17T01:54:51.761581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046926+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:54:52.046926+0000","last_peered":"2024-09-17T01:54:52.046926+0000","last_clean":"2024-09-17T01:54:52.046926+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:54:52.046926+0000","last_undegraded":"2024-09-17T01:54:52.046926+0000","last_fullsized":"2024-09-17T01:54:52.046926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760578+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:54:51.760578+0000","last_peered":"2024-09-17T01:54:51.760578+0000","last_clean":"2024-09-17T01:54:51.760578+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:54:51.760578+0000","last_undegraded":"2024-09-17T01:54:51.760578+0000","last_fullsized":"2024-09-17T01:54:51.760578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045825+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:54:52.045825+0000","last_peered":"2024-09-17T01:54:52.045825+0000","last_clean":"2024-09-17T01:54:52.045825+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:54:52.045825+0000","last_undegraded":"2024-09-17T01:54:52.045825+0000","last_fullsized":"2024-09-17T01:54:52.045825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084709+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:54:46.084709+0000","last_peered":"2024-09-17T01:54:46.084709+0000","last_clean":"2024-09-17T01:54:46.084709+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:54:46.084709+0000","last_undegraded":"2024-09-17T01:54:46.084709+0000","last_fullsized":"2024-09-17T01:54:46.084709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761358+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:54:51.761358+0000","last_peered":"2024-09-17T01:54:51.761358+0000","last_clean":"2024-09-17T01:54:51.761358+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:54:51.761358+0000","last_undegraded":"2024-09-17T01:54:51.761358+0000","last_fullsized":"2024-09-17T01:54:51.761358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086624+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:54:46.086624+0000","last_peered":"2024-09-17T01:54:46.086624+0000","last_clean":"2024-09-17T01:54:46.086624+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:54:46.086624+0000","last_undegraded":"2024-09-17T01:54:46.086624+0000","last_fullsized":"2024-09-17T01:54:46.086624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761256+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:54:51.761256+0000","last_peered":"2024-09-17T01:54:51.761256+0000","last_clean":"2024-09-17T01:54:51.761256+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:54:51.761256+0000","last_undegraded":"2024-09-17T01:54:51.761256+0000","last_fullsized":"2024-09-17T01:54:51.761256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046506+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:54:52.046506+0000","last_peered":"2024-09-17T01:54:52.046506+0000","last_clean":"2024-09-17T01:54:52.046506+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:54:52.046506+0000","last_undegraded":"2024-09-17T01:54:52.046506+0000","last_fullsized":"2024-09-17T01:54:52.046506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048381+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:54:52.048381+0000","last_peered":"2024-09-17T01:54:52.048381+0000","last_clean":"2024-09-17T01:54:52.048381+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:54:52.048381+0000","last_undegraded":"2024-09-17T01:54:52.048381+0000","last_fullsized":"2024-09-17T01:54:52.048381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760219+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:54:51.760219+0000","last_peered":"2024-09-17T01:54:51.760219+0000","last_clean":"2024-09-17T01:54:51.760219+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:54:51.760219+0000","last_undegraded":"2024-09-17T01:54:51.760219+0000","last_fullsized":"2024-09-17T01:54:51.760219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048104+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:54:52.048104+0000","last_peered":"2024-09-17T01:54:52.048104+0000","last_clean":"2024-09-17T01:54:52.048104+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:54:52.048104+0000","last_undegraded":"2024-09-17T01:54:52.048104+0000","last_fullsized":"2024-09-17T01:54:52.048104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.084599+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:54:46.084599+0000","last_peered":"2024-09-17T01:54:46.084599+0000","last_clean":"2024-09-17T01:54:46.084599+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:54:46.084599+0000","last_undegraded":"2024-09-17T01:54:46.084599+0000","last_fullsized":"2024-09-17T01:54:46.084599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085662+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:54:46.085662+0000","last_peered":"2024-09-17T01:54:46.085662+0000","last_clean":"2024-09-17T01:54:46.085662+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:54:46.085662+0000","last_undegraded":"2024-09-17T01:54:46.085662+0000","last_fullsized":"2024-09-17T01:54:46.085662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759780+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:54:51.759780+0000","last_peered":"2024-09-17T01:54:51.759780+0000","last_clean":"2024-09-17T01:54:51.759780+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:54:51.759780+0000","last_undegraded":"2024-09-17T01:54:51.759780+0000","last_fullsized":"2024-09-17T01:54:51.759780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761918+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:54:51.761918+0000","last_peered":"2024-09-17T01:54:51.761918+0000","last_clean":"2024-09-17T01:54:51.761918+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:54:51.761918+0000","last_undegraded":"2024-09-17T01:54:51.761918+0000","last_fullsized":"2024-09-17T01:54:51.761918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759924+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:54:51.759924+0000","last_peered":"2024-09-17T01:54:51.759924+0000","last_clean":"2024-09-17T01:54:51.759924+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:54:51.759924+0000","last_undegraded":"2024-09-17T01:54:51.759924+0000","last_fullsized":"2024-09-17T01:54:51.759924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087126+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:54:46.087126+0000","last_peered":"2024-09-17T01:54:46.087126+0000","last_clean":"2024-09-17T01:54:46.087126+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:54:46.087126+0000","last_undegraded":"2024-09-17T01:54:46.087126+0000","last_fullsized":"2024-09-17T01:54:46.087126+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086153+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:54:46.086153+0000","last_peered":"2024-09-17T01:54:46.086153+0000","last_clean":"2024-09-17T01:54:46.086153+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:54:46.086153+0000","last_undegraded":"2024-09-17T01:54:46.086153+0000","last_fullsized":"2024-09-17T01:54:46.086153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086752+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:54:46.086752+0000","last_peered":"2024-09-17T01:54:46.086752+0000","last_clean":"2024-09-17T01:54:46.086752+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:54:46.086752+0000","last_undegraded":"2024-09-17T01:54:46.086752+0000","last_fullsized":"2024-09-17T01:54:46.086752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046429+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:54:52.046429+0000","last_peered":"2024-09-17T01:54:52.046429+0000","last_clean":"2024-09-17T01:54:52.046429+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:54:52.046429+0000","last_undegraded":"2024-09-17T01:54:52.046429+0000","last_fullsized":"2024-09-17T01:54:52.046429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047307+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:54:52.047307+0000","last_peered":"2024-09-17T01:54:52.047307+0000","last_clean":"2024-09-17T01:54:52.047307+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:54:52.047307+0000","last_undegraded":"2024-09-17T01:54:52.047307+0000","last_fullsized":"2024-09-17T01:54:52.047307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086489+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:54:46.086489+0000","last_peered":"2024-09-17T01:54:46.086489+0000","last_clean":"2024-09-17T01:54:46.086489+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:54:46.086489+0000","last_undegraded":"2024-09-17T01:54:46.086489+0000","last_fullsized":"2024-09-17T01:54:46.086489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086282+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:54:46.086282+0000","last_peered":"2024-09-17T01:54:46.086282+0000","last_clean":"2024-09-17T01:54:46.086282+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:54:46.086282+0000","last_undegraded":"2024-09-17T01:54:46.086282+0000","last_fullsized":"2024-09-17T01:54:46.086282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086808+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:54:46.086808+0000","last_peered":"2024-09-17T01:54:46.086808+0000","last_clean":"2024-09-17T01:54:46.086808+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:54:46.086808+0000","last_undegraded":"2024-09-17T01:54:46.086808+0000","last_fullsized":"2024-09-17T01:54:46.086808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760302+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:54:51.760302+0000","last_peered":"2024-09-17T01:54:51.760302+0000","last_clean":"2024-09-17T01:54:51.760302+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:54:51.760302+0000","last_undegraded":"2024-09-17T01:54:51.760302+0000","last_fullsized":"2024-09-17T01:54:51.760302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085872+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:54:46.085872+0000","last_peered":"2024-09-17T01:54:46.085872+0000","last_clean":"2024-09-17T01:54:46.085872+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:54:46.085872+0000","last_undegraded":"2024-09-17T01:54:46.085872+0000","last_fullsized":"2024-09-17T01:54:46.085872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759889+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:54:51.759889+0000","last_peered":"2024-09-17T01:54:51.759889+0000","last_clean":"2024-09-17T01:54:51.759889+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:54:51.759889+0000","last_undegraded":"2024-09-17T01:54:51.759889+0000","last_fullsized":"2024-09-17T01:54:51.759889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048271+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:54:52.048271+0000","last_peered":"2024-09-17T01:54:52.048271+0000","last_clean":"2024-09-17T01:54:52.048271+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:54:52.048271+0000","last_undegraded":"2024-09-17T01:54:52.048271+0000","last_fullsized":"2024-09-17T01:54:52.048271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":224,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085728+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:54:46.085728+0000","last_peered":"2024-09-17T01:54:46.085728+0000","last_clean":"2024-09-17T01:54:46.085728+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:54:46.085728+0000","last_undegraded":"2024-09-17T01:54:46.085728+0000","last_fullsized":"2024-09-17T01:54:46.085728+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086866+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:54:46.086866+0000","last_peered":"2024-09-17T01:54:46.086866+0000","last_clean":"2024-09-17T01:54:46.086866+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:54:46.086866+0000","last_undegraded":"2024-09-17T01:54:46.086866+0000","last_fullsized":"2024-09-17T01:54:46.086866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046780+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:54:52.046780+0000","last_peered":"2024-09-17T01:54:52.046780+0000","last_clean":"2024-09-17T01:54:52.046780+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:54:52.046780+0000","last_undegraded":"2024-09-17T01:54:52.046780+0000","last_fullsized":"2024-09-17T01:54:52.046780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086868+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:54:46.086868+0000","last_peered":"2024-09-17T01:54:46.086868+0000","last_clean":"2024-09-17T01:54:46.086868+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:54:46.086868+0000","last_undegraded":"2024-09-17T01:54:46.086868+0000","last_fullsized":"2024-09-17T01:54:46.086868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085717+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:54:46.085717+0000","last_peered":"2024-09-17T01:54:46.085717+0000","last_clean":"2024-09-17T01:54:46.085717+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:54:46.085717+0000","last_undegraded":"2024-09-17T01:54:46.085717+0000","last_fullsized":"2024-09-17T01:54:46.085717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046329+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:54:52.046329+0000","last_peered":"2024-09-17T01:54:52.046329+0000","last_clean":"2024-09-17T01:54:52.046329+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:54:52.046329+0000","last_undegraded":"2024-09-17T01:54:52.046329+0000","last_fullsized":"2024-09-17T01:54:52.046329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761354+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:54:51.761354+0000","last_peered":"2024-09-17T01:54:51.761354+0000","last_clean":"2024-09-17T01:54:51.761354+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:54:51.761354+0000","last_undegraded":"2024-09-17T01:54:51.761354+0000","last_fullsized":"2024-09-17T01:54:51.761354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046881+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:54:52.046881+0000","last_peered":"2024-09-17T01:54:52.046881+0000","last_clean":"2024-09-17T01:54:52.046881+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:54:52.046881+0000","last_undegraded":"2024-09-17T01:54:52.046881+0000","last_fullsized":"2024-09-17T01:54:52.046881+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760073+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:54:51.760073+0000","last_peered":"2024-09-17T01:54:51.760073+0000","last_clean":"2024-09-17T01:54:51.760073+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:54:51.760073+0000","last_undegraded":"2024-09-17T01:54:51.760073+0000","last_fullsized":"2024-09-17T01:54:51.760073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048326+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:54:52.048326+0000","last_peered":"2024-09-17T01:54:52.048326+0000","last_clean":"2024-09-17T01:54:52.048326+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:54:52.048326+0000","last_undegraded":"2024-09-17T01:54:52.048326+0000","last_fullsized":"2024-09-17T01:54:52.048326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086322+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:54:46.086322+0000","last_peered":"2024-09-17T01:54:46.086322+0000","last_clean":"2024-09-17T01:54:46.086322+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:54:46.086322+0000","last_undegraded":"2024-09-17T01:54:46.086322+0000","last_fullsized":"2024-09-17T01:54:46.086322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086860+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:54:46.086860+0000","last_peered":"2024-09-17T01:54:46.086860+0000","last_clean":"2024-09-17T01:54:46.086860+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:54:46.086860+0000","last_undegraded":"2024-09-17T01:54:46.086860+0000","last_fullsized":"2024-09-17T01:54:46.086860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047575+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:54:52.047575+0000","last_peered":"2024-09-17T01:54:52.047575+0000","last_clean":"2024-09-17T01:54:52.047575+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:54:52.047575+0000","last_undegraded":"2024-09-17T01:54:52.047575+0000","last_fullsized":"2024-09-17T01:54:52.047575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.087036+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:54:46.087036+0000","last_peered":"2024-09-17T01:54:46.087036+0000","last_clean":"2024-09-17T01:54:46.087036+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:54:46.087036+0000","last_undegraded":"2024-09-17T01:54:46.087036+0000","last_fullsized":"2024-09-17T01:54:46.087036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048158+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:54:52.048158+0000","last_peered":"2024-09-17T01:54:52.048158+0000","last_clean":"2024-09-17T01:54:52.048158+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:54:52.048158+0000","last_undegraded":"2024-09-17T01:54:52.048158+0000","last_fullsized":"2024-09-17T01:54:52.048158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760247+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:54:51.760247+0000","last_peered":"2024-09-17T01:54:51.760247+0000","last_clean":"2024-09-17T01:54:51.760247+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:54:51.760247+0000","last_undegraded":"2024-09-17T01:54:51.760247+0000","last_fullsized":"2024-09-17T01:54:51.760247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048046+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:54:52.048046+0000","last_peered":"2024-09-17T01:54:52.048046+0000","last_clean":"2024-09-17T01:54:52.048046+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:54:52.048046+0000","last_undegraded":"2024-09-17T01:54:52.048046+0000","last_fullsized":"2024-09-17T01:54:52.048046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762206+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:54:51.762206+0000","last_peered":"2024-09-17T01:54:51.762206+0000","last_clean":"2024-09-17T01:54:51.762206+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:54:51.762206+0000","last_undegraded":"2024-09-17T01:54:51.762206+0000","last_fullsized":"2024-09-17T01:54:51.762206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761076+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:54:51.761076+0000","last_peered":"2024-09-17T01:54:51.761076+0000","last_clean":"2024-09-17T01:54:51.761076+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:54:51.761076+0000","last_undegraded":"2024-09-17T01:54:51.761076+0000","last_fullsized":"2024-09-17T01:54:51.761076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048881+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:54:52.048881+0000","last_peered":"2024-09-17T01:54:52.048881+0000","last_clean":"2024-09-17T01:54:52.048881+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:54:52.048881+0000","last_undegraded":"2024-09-17T01:54:52.048881+0000","last_fullsized":"2024-09-17T01:54:52.048881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048723+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:54:52.048723+0000","last_peered":"2024-09-17T01:54:52.048723+0000","last_clean":"2024-09-17T01:54:52.048723+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:54:52.048723+0000","last_undegraded":"2024-09-17T01:54:52.048723+0000","last_fullsized":"2024-09-17T01:54:52.048723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046260+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:54:52.046260+0000","last_peered":"2024-09-17T01:54:52.046260+0000","last_clean":"2024-09-17T01:54:52.046260+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:54:52.046260+0000","last_undegraded":"2024-09-17T01:54:52.046260+0000","last_fullsized":"2024-09-17T01:54:52.046260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048626+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:54:52.048626+0000","last_peered":"2024-09-17T01:54:52.048626+0000","last_clean":"2024-09-17T01:54:52.048626+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:54:52.048626+0000","last_undegraded":"2024-09-17T01:54:52.048626+0000","last_fullsized":"2024-09-17T01:54:52.048626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085617+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:54:46.085617+0000","last_peered":"2024-09-17T01:54:46.085617+0000","last_clean":"2024-09-17T01:54:46.085617+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:54:46.085617+0000","last_undegraded":"2024-09-17T01:54:46.085617+0000","last_fullsized":"2024-09-17T01:54:46.085617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759943+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:54:51.759943+0000","last_peered":"2024-09-17T01:54:51.759943+0000","last_clean":"2024-09-17T01:54:51.759943+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:54:51.759943+0000","last_undegraded":"2024-09-17T01:54:51.759943+0000","last_fullsized":"2024-09-17T01:54:51.759943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086658+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:54:46.086658+0000","last_peered":"2024-09-17T01:54:46.086658+0000","last_clean":"2024-09-17T01:54:46.086658+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:54:46.086658+0000","last_undegraded":"2024-09-17T01:54:46.086658+0000","last_fullsized":"2024-09-17T01:54:46.086658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086598+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:54:46.086598+0000","last_peered":"2024-09-17T01:54:46.086598+0000","last_clean":"2024-09-17T01:54:46.086598+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:54:46.086598+0000","last_undegraded":"2024-09-17T01:54:46.086598+0000","last_fullsized":"2024-09-17T01:54:46.086598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046124+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:54:52.046124+0000","last_peered":"2024-09-17T01:54:52.046124+0000","last_clean":"2024-09-17T01:54:52.046124+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:54:52.046124+0000","last_undegraded":"2024-09-17T01:54:52.046124+0000","last_fullsized":"2024-09-17T01:54:52.046124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761916+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:54:51.761916+0000","last_peered":"2024-09-17T01:54:51.761916+0000","last_clean":"2024-09-17T01:54:51.761916+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:54:51.761916+0000","last_undegraded":"2024-09-17T01:54:51.761916+0000","last_fullsized":"2024-09-17T01:54:51.761916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085763+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:54:46.085763+0000","last_peered":"2024-09-17T01:54:46.085763+0000","last_clean":"2024-09-17T01:54:46.085763+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:54:46.085763+0000","last_undegraded":"2024-09-17T01:54:46.085763+0000","last_fullsized":"2024-09-17T01:54:46.085763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045996+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:54:52.045996+0000","last_peered":"2024-09-17T01:54:52.045996+0000","last_clean":"2024-09-17T01:54:52.045996+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:54:52.045996+0000","last_undegraded":"2024-09-17T01:54:52.045996+0000","last_fullsized":"2024-09-17T01:54:52.045996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048711+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:54:52.048711+0000","last_peered":"2024-09-17T01:54:52.048711+0000","last_clean":"2024-09-17T01:54:52.048711+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:54:52.048711+0000","last_undegraded":"2024-09-17T01:54:52.048711+0000","last_fullsized":"2024-09-17T01:54:52.048711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046028+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:54:52.046028+0000","last_peered":"2024-09-17T01:54:52.046028+0000","last_clean":"2024-09-17T01:54:52.046028+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:54:52.046028+0000","last_undegraded":"2024-09-17T01:54:52.046028+0000","last_fullsized":"2024-09-17T01:54:52.046028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762090+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:54:51.762090+0000","last_peered":"2024-09-17T01:54:51.762090+0000","last_clean":"2024-09-17T01:54:51.762090+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:54:51.762090+0000","last_undegraded":"2024-09-17T01:54:51.762090+0000","last_fullsized":"2024-09-17T01:54:51.762090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046353+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:54:52.046353+0000","last_peered":"2024-09-17T01:54:52.046353+0000","last_clean":"2024-09-17T01:54:52.046353+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:54:52.046353+0000","last_undegraded":"2024-09-17T01:54:52.046353+0000","last_fullsized":"2024-09-17T01:54:52.046353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047872+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:54:52.047872+0000","last_peered":"2024-09-17T01:54:52.047872+0000","last_clean":"2024-09-17T01:54:52.047872+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:54:52.047872+0000","last_undegraded":"2024-09-17T01:54:52.047872+0000","last_fullsized":"2024-09-17T01:54:52.047872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046511+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:54:52.046511+0000","last_peered":"2024-09-17T01:54:52.046511+0000","last_clean":"2024-09-17T01:54:52.046511+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:54:52.046511+0000","last_undegraded":"2024-09-17T01:54:52.046511+0000","last_fullsized":"2024-09-17T01:54:52.046511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761094+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:54:51.761094+0000","last_peered":"2024-09-17T01:54:51.761094+0000","last_clean":"2024-09-17T01:54:51.761094+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:54:51.761094+0000","last_undegraded":"2024-09-17T01:54:51.761094+0000","last_fullsized":"2024-09-17T01:54:51.761094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760882+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:54:51.760882+0000","last_peered":"2024-09-17T01:54:51.760882+0000","last_clean":"2024-09-17T01:54:51.760882+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:54:51.760882+0000","last_undegraded":"2024-09-17T01:54:51.760882+0000","last_fullsized":"2024-09-17T01:54:51.760882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761252+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:54:51.761252+0000","last_peered":"2024-09-17T01:54:51.761252+0000","last_clean":"2024-09-17T01:54:51.761252+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:54:51.761252+0000","last_undegraded":"2024-09-17T01:54:51.761252+0000","last_fullsized":"2024-09-17T01:54:51.761252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761328+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:54:51.761328+0000","last_peered":"2024-09-17T01:54:51.761328+0000","last_clean":"2024-09-17T01:54:51.761328+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:54:51.761328+0000","last_undegraded":"2024-09-17T01:54:51.761328+0000","last_fullsized":"2024-09-17T01:54:51.761328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086178+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:54:46.086178+0000","last_peered":"2024-09-17T01:54:46.086178+0000","last_clean":"2024-09-17T01:54:46.086178+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:54:46.086178+0000","last_undegraded":"2024-09-17T01:54:46.086178+0000","last_fullsized":"2024-09-17T01:54:46.086178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.086385+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:54:46.086385+0000","last_peered":"2024-09-17T01:54:46.086385+0000","last_clean":"2024-09-17T01:54:46.086385+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:54:46.086385+0000","last_undegraded":"2024-09-17T01:54:46.086385+0000","last_fullsized":"2024-09-17T01:54:46.086385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085984+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:54:46.085984+0000","last_peered":"2024-09-17T01:54:46.085984+0000","last_clean":"2024-09-17T01:54:46.085984+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:54:46.085984+0000","last_undegraded":"2024-09-17T01:54:46.085984+0000","last_fullsized":"2024-09-17T01:54:46.085984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761513+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:54:51.761513+0000","last_peered":"2024-09-17T01:54:51.761513+0000","last_clean":"2024-09-17T01:54:51.761513+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:54:51.761513+0000","last_undegraded":"2024-09-17T01:54:51.761513+0000","last_fullsized":"2024-09-17T01:54:51.761513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760671+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:54:51.760671+0000","last_peered":"2024-09-17T01:54:51.760671+0000","last_clean":"2024-09-17T01:54:51.760671+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:54:51.760671+0000","last_undegraded":"2024-09-17T01:54:51.760671+0000","last_fullsized":"2024-09-17T01:54:51.760671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048319+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:54:52.048319+0000","last_peered":"2024-09-17T01:54:52.048319+0000","last_clean":"2024-09-17T01:54:52.048319+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:54:52.048319+0000","last_undegraded":"2024-09-17T01:54:52.048319+0000","last_fullsized":"2024-09-17T01:54:52.048319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T01:54:46.085228+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:54:46.085228+0000","last_peered":"2024-09-17T01:54:46.085228+0000","last_clean":"2024-09-17T01:54:46.085228+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:54:46.085228+0000","last_undegraded":"2024-09-17T01:54:46.085228+0000","last_fullsized":"2024-09-17T01:54:46.085228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048549+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:54:52.048549+0000","last_peered":"2024-09-17T01:54:52.048549+0000","last_clean":"2024-09-17T01:54:52.048549+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:54:52.048549+0000","last_undegraded":"2024-09-17T01:54:52.048549+0000","last_fullsized":"2024-09-17T01:54:52.048549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":258048,"data_stored":651803,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":245760,"data_stored":651168,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:54:54.538 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:54:54.538 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T01:54:54.538 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T01:54:54.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T01:54:54.912 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:54.912 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:54:54.930 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T01:54:54.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:54:55.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:55.253 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:54:44.555579+0000","modified":"2024-09-17T01:54:47.580458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4208,"qdb_cluster":[4208]},"id":1}]} 2024-09-17T01:54:55.253 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-17T01:54:55.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:54:55.589 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:55.589 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:54:44.555579+0000","modified":"2024-09-17T01:54:47.580458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4208,"qdb_cluster":[4208]},"id":1}]} 2024-09-17T01:54:55.589 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-17T01:54:55.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:54:55.898 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:55.899 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":20,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:54:51.748116+0000","last_up_change":"2024-09-17T01:54:31.869613+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6801","nonce":495067980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6803","nonce":495067980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6807","nonce":495067980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":495067980},{"type":"v1","addr":"172.21.15.154:6805","nonce":495067980}]},"public_addr":"172.21.15.154:6801/495067980","cluster_addr":"172.21.15.154:6803/495067980","heartbeat_back_addr":"172.21.15.154:6807/495067980","heartbeat_front_addr":"172.21.15.154:6805/495067980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:54:55.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:54:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:56.257 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:54:44.555579+0000","modified":"2024-09-17T01:54:47.580458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4208,"qdb_cluster":[4208]},"id":1}]} 2024-09-17T01:54:56.257 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-17T01:54:56.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:54:44.555579+0000', 'modified': '2024-09-17T01:54:47.580458+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4208': {'gid': 4208, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.63:6803/508169877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6802', 'nonce': 508169877}, {'type': 'v1', 'addr': '172.21.15.63:6803', 'nonce': 508169877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4208, 'qdb_cluster': [4208]} 2024-09-17T01:54:56.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:54:56.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:54:56.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:54:56.521+0000 7efdf6ffd640 0 client.4403 ms_handle_reset on v2:172.21.15.63:6802/508169877 2024-09-17T01:54:56.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:54:56.545+0000 7efdf6ffd640 0 client.4408 ms_handle_reset on v2:172.21.15.63:6802/508169877 2024-09-17T01:54:56.549 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:54:56.549 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4208, 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 11.353221402999999, 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 20, 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 19, 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 14.391865364999999 2024-09-17T01:54:56.550 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:54:56.566 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-17T01:54:56.577 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-17T01:54:56.577 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'}} 2024-09-17T01:54:56.578 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-17T01:54:56.578 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-17T01:54:56.578 DEBUG:teuthology.orchestra.run.smithi063:> sync 2024-09-17T01:54:56.847 DEBUG:teuthology.orchestra.run.smithi096:> sync 2024-09-17T01:54:56.976 DEBUG:teuthology.orchestra.run.smithi098:> sync 2024-09-17T01:54:57.200 DEBUG:teuthology.orchestra.run.smithi154:> sync 2024-09-17T01:54:57.300 DEBUG:tasks.thrashosds:checking console status of smithi063 2024-09-17T01:54:57.300 DEBUG:teuthology.orchestra.console.smithi063:Waiting for login prompt 2024-09-17T01:54:57.300 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi063 2024-09-17T01:54:57.407 DEBUG:teuthology.orchestra.console.smithi063:expect before: [Enter `^Ec?' for help] 2024-09-17T01:54:57.407 DEBUG:teuthology.orchestra.console.smithi063:expect after: smithi063 login: 2024-09-17T01:54:57.459 DEBUG:teuthology.orchestra.console.smithi063:console disconnect output: [Enter `^Ec?' for help] smithi063 login: [disconnect] 2024-09-17T01:54:57.560 DEBUG:tasks.thrashosds:checking console status of smithi096 2024-09-17T01:54:57.560 DEBUG:teuthology.orchestra.console.smithi096:Waiting for login prompt 2024-09-17T01:54:57.560 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi096 2024-09-17T01:54:57.680 DEBUG:teuthology.orchestra.console.smithi096:expect before: [Enter `^Ec?' for help] 2024-09-17T01:54:57.680 DEBUG:teuthology.orchestra.console.smithi096:expect after: smithi096 login: 2024-09-17T01:54:57.732 DEBUG:teuthology.orchestra.console.smithi096:console disconnect output: [Enter `^Ec?' for help] smithi096 login: [disconnect] 2024-09-17T01:54:57.833 DEBUG:tasks.thrashosds:checking console status of smithi098 2024-09-17T01:54:57.833 DEBUG:teuthology.orchestra.console.smithi098:Waiting for login prompt 2024-09-17T01:54:57.834 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi098 2024-09-17T01:54:57.936 DEBUG:teuthology.orchestra.console.smithi098:expect before: [Enter `^Ec?' for help] 2024-09-17T01:54:57.936 DEBUG:teuthology.orchestra.console.smithi098:expect after: smithi098 login: 2024-09-17T01:54:57.988 DEBUG:teuthology.orchestra.console.smithi098:console disconnect output: [Enter `^Ec?' for help] smithi098 login: [disconnect] 2024-09-17T01:54:58.089 DEBUG:tasks.thrashosds:checking console status of smithi154 2024-09-17T01:54:58.089 DEBUG:teuthology.orchestra.console.smithi154:Waiting for login prompt 2024-09-17T01:54:58.090 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi154 2024-09-17T01:54:58.170 DEBUG:teuthology.orchestra.console.smithi154:expect before: [Enter `^Ec?' for help] 2024-09-17T01:54:58.171 DEBUG:teuthology.orchestra.console.smithi154:expect after: smithi154 login: 2024-09-17T01:54:58.223 DEBUG:teuthology.orchestra.console.smithi154:console disconnect output: [Enter `^Ec?' for help] smithi154 login: [disconnect] 2024-09-17T01:54:58.324 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-17T01:54:58.666 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-17T01:54:58.666 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:54:58.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:54:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:54:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-17T01:54:57.976907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90092,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025428,"statfs":{"total":289910292480,"available":289818038272,"internally_reserved":0,"allocated":704512,"data_stored":1375416,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002738"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761800+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:54:51.761800+0000","last_peered":"2024-09-17T01:54:51.761800+0000","last_clean":"2024-09-17T01:54:51.761800+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:54:51.761800+0000","last_undegraded":"2024-09-17T01:54:51.761800+0000","last_fullsized":"2024-09-17T01:54:51.761800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760791+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:54:51.760791+0000","last_peered":"2024-09-17T01:54:51.760791+0000","last_clean":"2024-09-17T01:54:51.760791+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:54:51.760791+0000","last_undegraded":"2024-09-17T01:54:51.760791+0000","last_fullsized":"2024-09-17T01:54:51.760791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510371+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:54:52.510371+0000","last_peered":"2024-09-17T01:54:52.510371+0000","last_clean":"2024-09-17T01:54:52.510371+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:54:52.510371+0000","last_undegraded":"2024-09-17T01:54:52.510371+0000","last_fullsized":"2024-09-17T01:54:52.510371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510379+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:54:52.510379+0000","last_peered":"2024-09-17T01:54:52.510379+0000","last_clean":"2024-09-17T01:54:52.510379+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:54:52.510379+0000","last_undegraded":"2024-09-17T01:54:52.510379+0000","last_fullsized":"2024-09-17T01:54:52.510379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761214+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:54:51.761214+0000","last_peered":"2024-09-17T01:54:51.761214+0000","last_clean":"2024-09-17T01:54:51.761214+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:54:51.761214+0000","last_undegraded":"2024-09-17T01:54:51.761214+0000","last_fullsized":"2024-09-17T01:54:51.761214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510034+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:54:52.510034+0000","last_peered":"2024-09-17T01:54:52.510034+0000","last_clean":"2024-09-17T01:54:52.510034+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:54:52.510034+0000","last_undegraded":"2024-09-17T01:54:52.510034+0000","last_fullsized":"2024-09-17T01:54:52.510034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509514+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:54:52.509514+0000","last_peered":"2024-09-17T01:54:52.509514+0000","last_clean":"2024-09-17T01:54:52.509514+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:54:52.509514+0000","last_undegraded":"2024-09-17T01:54:52.509514+0000","last_fullsized":"2024-09-17T01:54:52.509514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509252+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:54:52.509252+0000","last_peered":"2024-09-17T01:54:52.509252+0000","last_clean":"2024-09-17T01:54:52.509252+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:54:52.509252+0000","last_undegraded":"2024-09-17T01:54:52.509252+0000","last_fullsized":"2024-09-17T01:54:52.509252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047987+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:54:52.047987+0000","last_peered":"2024-09-17T01:54:52.047987+0000","last_clean":"2024-09-17T01:54:52.047987+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:54:52.047987+0000","last_undegraded":"2024-09-17T01:54:52.047987+0000","last_fullsized":"2024-09-17T01:54:52.047987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761041+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:54:51.761041+0000","last_peered":"2024-09-17T01:54:51.761041+0000","last_clean":"2024-09-17T01:54:51.761041+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:54:51.761041+0000","last_undegraded":"2024-09-17T01:54:51.761041+0000","last_fullsized":"2024-09-17T01:54:51.761041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510647+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:54:52.510647+0000","last_peered":"2024-09-17T01:54:52.510647+0000","last_clean":"2024-09-17T01:54:52.510647+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:54:52.510647+0000","last_undegraded":"2024-09-17T01:54:52.510647+0000","last_fullsized":"2024-09-17T01:54:52.510647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761113+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:54:51.761113+0000","last_peered":"2024-09-17T01:54:51.761113+0000","last_clean":"2024-09-17T01:54:51.761113+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:54:51.761113+0000","last_undegraded":"2024-09-17T01:54:51.761113+0000","last_fullsized":"2024-09-17T01:54:51.761113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760839+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:54:51.760839+0000","last_peered":"2024-09-17T01:54:51.760839+0000","last_clean":"2024-09-17T01:54:51.760839+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:54:51.760839+0000","last_undegraded":"2024-09-17T01:54:51.760839+0000","last_fullsized":"2024-09-17T01:54:51.760839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510289+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:54:52.510289+0000","last_peered":"2024-09-17T01:54:52.510289+0000","last_clean":"2024-09-17T01:54:52.510289+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:54:52.510289+0000","last_undegraded":"2024-09-17T01:54:52.510289+0000","last_fullsized":"2024-09-17T01:54:52.510289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509575+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:54:52.509575+0000","last_peered":"2024-09-17T01:54:52.509575+0000","last_clean":"2024-09-17T01:54:52.509575+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:54:52.509575+0000","last_undegraded":"2024-09-17T01:54:52.509575+0000","last_fullsized":"2024-09-17T01:54:52.509575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509270+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:54:52.509270+0000","last_peered":"2024-09-17T01:54:52.509270+0000","last_clean":"2024-09-17T01:54:52.509270+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:54:52.509270+0000","last_undegraded":"2024-09-17T01:54:52.509270+0000","last_fullsized":"2024-09-17T01:54:52.509270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048707+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:54:52.048707+0000","last_peered":"2024-09-17T01:54:52.048707+0000","last_clean":"2024-09-17T01:54:52.048707+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:54:52.048707+0000","last_undegraded":"2024-09-17T01:54:52.048707+0000","last_fullsized":"2024-09-17T01:54:52.048707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761836+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:54:51.761836+0000","last_peered":"2024-09-17T01:54:51.761836+0000","last_clean":"2024-09-17T01:54:51.761836+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:54:51.761836+0000","last_undegraded":"2024-09-17T01:54:51.761836+0000","last_fullsized":"2024-09-17T01:54:51.761836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047807+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:54:52.047807+0000","last_peered":"2024-09-17T01:54:52.047807+0000","last_clean":"2024-09-17T01:54:52.047807+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:54:52.047807+0000","last_undegraded":"2024-09-17T01:54:52.047807+0000","last_fullsized":"2024-09-17T01:54:52.047807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511700+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:54:52.511700+0000","last_peered":"2024-09-17T01:54:52.511700+0000","last_clean":"2024-09-17T01:54:52.511700+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:54:52.511700+0000","last_undegraded":"2024-09-17T01:54:52.511700+0000","last_fullsized":"2024-09-17T01:54:52.511700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510771+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:54:52.510771+0000","last_peered":"2024-09-17T01:54:52.510771+0000","last_clean":"2024-09-17T01:54:52.510771+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:54:52.510771+0000","last_undegraded":"2024-09-17T01:54:52.510771+0000","last_fullsized":"2024-09-17T01:54:52.510771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760250+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:54:51.760250+0000","last_peered":"2024-09-17T01:54:51.760250+0000","last_clean":"2024-09-17T01:54:51.760250+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:54:51.760250+0000","last_undegraded":"2024-09-17T01:54:51.760250+0000","last_fullsized":"2024-09-17T01:54:51.760250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045717+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:54:52.045717+0000","last_peered":"2024-09-17T01:54:52.045717+0000","last_clean":"2024-09-17T01:54:52.045717+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:54:52.045717+0000","last_undegraded":"2024-09-17T01:54:52.045717+0000","last_fullsized":"2024-09-17T01:54:52.045717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759679+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:54:51.759679+0000","last_peered":"2024-09-17T01:54:51.759679+0000","last_clean":"2024-09-17T01:54:51.759679+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:54:51.759679+0000","last_undegraded":"2024-09-17T01:54:51.759679+0000","last_fullsized":"2024-09-17T01:54:51.759679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761971+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:54:51.761971+0000","last_peered":"2024-09-17T01:54:51.761971+0000","last_clean":"2024-09-17T01:54:51.761971+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:54:51.761971+0000","last_undegraded":"2024-09-17T01:54:51.761971+0000","last_fullsized":"2024-09-17T01:54:51.761971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047934+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:54:52.047934+0000","last_peered":"2024-09-17T01:54:52.047934+0000","last_clean":"2024-09-17T01:54:52.047934+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:54:52.047934+0000","last_undegraded":"2024-09-17T01:54:52.047934+0000","last_fullsized":"2024-09-17T01:54:52.047934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511392+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:54:52.511392+0000","last_peered":"2024-09-17T01:54:52.511392+0000","last_clean":"2024-09-17T01:54:52.511392+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:54:52.511392+0000","last_undegraded":"2024-09-17T01:54:52.511392+0000","last_fullsized":"2024-09-17T01:54:52.511392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761581+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:54:51.761581+0000","last_peered":"2024-09-17T01:54:51.761581+0000","last_clean":"2024-09-17T01:54:51.761581+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:54:51.761581+0000","last_undegraded":"2024-09-17T01:54:51.761581+0000","last_fullsized":"2024-09-17T01:54:51.761581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046926+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:54:52.046926+0000","last_peered":"2024-09-17T01:54:52.046926+0000","last_clean":"2024-09-17T01:54:52.046926+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:54:52.046926+0000","last_undegraded":"2024-09-17T01:54:52.046926+0000","last_fullsized":"2024-09-17T01:54:52.046926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760578+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:54:51.760578+0000","last_peered":"2024-09-17T01:54:51.760578+0000","last_clean":"2024-09-17T01:54:51.760578+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:54:51.760578+0000","last_undegraded":"2024-09-17T01:54:51.760578+0000","last_fullsized":"2024-09-17T01:54:51.760578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045825+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:54:52.045825+0000","last_peered":"2024-09-17T01:54:52.045825+0000","last_clean":"2024-09-17T01:54:52.045825+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:54:52.045825+0000","last_undegraded":"2024-09-17T01:54:52.045825+0000","last_fullsized":"2024-09-17T01:54:52.045825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509497+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:54:52.509497+0000","last_peered":"2024-09-17T01:54:52.509497+0000","last_clean":"2024-09-17T01:54:52.509497+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:54:52.509497+0000","last_undegraded":"2024-09-17T01:54:52.509497+0000","last_fullsized":"2024-09-17T01:54:52.509497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761358+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:54:51.761358+0000","last_peered":"2024-09-17T01:54:51.761358+0000","last_clean":"2024-09-17T01:54:51.761358+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:54:51.761358+0000","last_undegraded":"2024-09-17T01:54:51.761358+0000","last_fullsized":"2024-09-17T01:54:51.761358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508359+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:54:52.508359+0000","last_peered":"2024-09-17T01:54:52.508359+0000","last_clean":"2024-09-17T01:54:52.508359+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:54:52.508359+0000","last_undegraded":"2024-09-17T01:54:52.508359+0000","last_fullsized":"2024-09-17T01:54:52.508359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761256+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:54:51.761256+0000","last_peered":"2024-09-17T01:54:51.761256+0000","last_clean":"2024-09-17T01:54:51.761256+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:54:51.761256+0000","last_undegraded":"2024-09-17T01:54:51.761256+0000","last_fullsized":"2024-09-17T01:54:51.761256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046506+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:54:52.046506+0000","last_peered":"2024-09-17T01:54:52.046506+0000","last_clean":"2024-09-17T01:54:52.046506+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:54:52.046506+0000","last_undegraded":"2024-09-17T01:54:52.046506+0000","last_fullsized":"2024-09-17T01:54:52.046506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048381+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:54:52.048381+0000","last_peered":"2024-09-17T01:54:52.048381+0000","last_clean":"2024-09-17T01:54:52.048381+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:54:52.048381+0000","last_undegraded":"2024-09-17T01:54:52.048381+0000","last_fullsized":"2024-09-17T01:54:52.048381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760219+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:54:51.760219+0000","last_peered":"2024-09-17T01:54:51.760219+0000","last_clean":"2024-09-17T01:54:51.760219+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:54:51.760219+0000","last_undegraded":"2024-09-17T01:54:51.760219+0000","last_fullsized":"2024-09-17T01:54:51.760219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048104+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:54:52.048104+0000","last_peered":"2024-09-17T01:54:52.048104+0000","last_clean":"2024-09-17T01:54:52.048104+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:54:52.048104+0000","last_undegraded":"2024-09-17T01:54:52.048104+0000","last_fullsized":"2024-09-17T01:54:52.048104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.507759+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:54:52.507759+0000","last_peered":"2024-09-17T01:54:52.507759+0000","last_clean":"2024-09-17T01:54:52.507759+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:54:52.507759+0000","last_undegraded":"2024-09-17T01:54:52.507759+0000","last_fullsized":"2024-09-17T01:54:52.507759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508222+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:54:52.508222+0000","last_peered":"2024-09-17T01:54:52.508222+0000","last_clean":"2024-09-17T01:54:52.508222+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:54:52.508222+0000","last_undegraded":"2024-09-17T01:54:52.508222+0000","last_fullsized":"2024-09-17T01:54:52.508222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759780+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:54:51.759780+0000","last_peered":"2024-09-17T01:54:51.759780+0000","last_clean":"2024-09-17T01:54:51.759780+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:54:51.759780+0000","last_undegraded":"2024-09-17T01:54:51.759780+0000","last_fullsized":"2024-09-17T01:54:51.759780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761918+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:54:51.761918+0000","last_peered":"2024-09-17T01:54:51.761918+0000","last_clean":"2024-09-17T01:54:51.761918+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:54:51.761918+0000","last_undegraded":"2024-09-17T01:54:51.761918+0000","last_fullsized":"2024-09-17T01:54:51.761918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759924+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:54:51.759924+0000","last_peered":"2024-09-17T01:54:51.759924+0000","last_clean":"2024-09-17T01:54:51.759924+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:54:51.759924+0000","last_undegraded":"2024-09-17T01:54:51.759924+0000","last_fullsized":"2024-09-17T01:54:51.759924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508617+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:54:52.508617+0000","last_peered":"2024-09-17T01:54:52.508617+0000","last_clean":"2024-09-17T01:54:52.508617+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:54:52.508617+0000","last_undegraded":"2024-09-17T01:54:52.508617+0000","last_fullsized":"2024-09-17T01:54:52.508617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511137+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:54:52.511137+0000","last_peered":"2024-09-17T01:54:52.511137+0000","last_clean":"2024-09-17T01:54:52.511137+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:54:52.511137+0000","last_undegraded":"2024-09-17T01:54:52.511137+0000","last_fullsized":"2024-09-17T01:54:52.511137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508082+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:54:52.508082+0000","last_peered":"2024-09-17T01:54:52.508082+0000","last_clean":"2024-09-17T01:54:52.508082+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:54:52.508082+0000","last_undegraded":"2024-09-17T01:54:52.508082+0000","last_fullsized":"2024-09-17T01:54:52.508082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046429+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:54:52.046429+0000","last_peered":"2024-09-17T01:54:52.046429+0000","last_clean":"2024-09-17T01:54:52.046429+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:54:52.046429+0000","last_undegraded":"2024-09-17T01:54:52.046429+0000","last_fullsized":"2024-09-17T01:54:52.046429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047307+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:54:52.047307+0000","last_peered":"2024-09-17T01:54:52.047307+0000","last_clean":"2024-09-17T01:54:52.047307+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:54:52.047307+0000","last_undegraded":"2024-09-17T01:54:52.047307+0000","last_fullsized":"2024-09-17T01:54:52.047307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511506+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:54:52.511506+0000","last_peered":"2024-09-17T01:54:52.511506+0000","last_clean":"2024-09-17T01:54:52.511506+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:54:52.511506+0000","last_undegraded":"2024-09-17T01:54:52.511506+0000","last_fullsized":"2024-09-17T01:54:52.511506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.507950+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:54:52.507950+0000","last_peered":"2024-09-17T01:54:52.507950+0000","last_clean":"2024-09-17T01:54:52.507950+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:54:52.507950+0000","last_undegraded":"2024-09-17T01:54:52.507950+0000","last_fullsized":"2024-09-17T01:54:52.507950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511315+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:54:52.511315+0000","last_peered":"2024-09-17T01:54:52.511315+0000","last_clean":"2024-09-17T01:54:52.511315+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:54:52.511315+0000","last_undegraded":"2024-09-17T01:54:52.511315+0000","last_fullsized":"2024-09-17T01:54:52.511315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760302+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:54:51.760302+0000","last_peered":"2024-09-17T01:54:51.760302+0000","last_clean":"2024-09-17T01:54:51.760302+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:54:51.760302+0000","last_undegraded":"2024-09-17T01:54:51.760302+0000","last_fullsized":"2024-09-17T01:54:51.760302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510452+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:54:52.510452+0000","last_peered":"2024-09-17T01:54:52.510452+0000","last_clean":"2024-09-17T01:54:52.510452+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:54:52.510452+0000","last_undegraded":"2024-09-17T01:54:52.510452+0000","last_fullsized":"2024-09-17T01:54:52.510452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759889+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:54:51.759889+0000","last_peered":"2024-09-17T01:54:51.759889+0000","last_clean":"2024-09-17T01:54:51.759889+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:54:51.759889+0000","last_undegraded":"2024-09-17T01:54:51.759889+0000","last_fullsized":"2024-09-17T01:54:51.759889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048271+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:54:52.048271+0000","last_peered":"2024-09-17T01:54:52.048271+0000","last_clean":"2024-09-17T01:54:52.048271+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:54:52.048271+0000","last_undegraded":"2024-09-17T01:54:52.048271+0000","last_fullsized":"2024-09-17T01:54:52.048271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510011+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:54:52.510011+0000","last_peered":"2024-09-17T01:54:52.510011+0000","last_clean":"2024-09-17T01:54:52.510011+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:54:52.510011+0000","last_undegraded":"2024-09-17T01:54:52.510011+0000","last_fullsized":"2024-09-17T01:54:52.510011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.512036+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:54:52.512036+0000","last_peered":"2024-09-17T01:54:52.512036+0000","last_clean":"2024-09-17T01:54:52.512036+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:54:52.512036+0000","last_undegraded":"2024-09-17T01:54:52.512036+0000","last_fullsized":"2024-09-17T01:54:52.512036+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046780+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:54:52.046780+0000","last_peered":"2024-09-17T01:54:52.046780+0000","last_clean":"2024-09-17T01:54:52.046780+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:54:52.046780+0000","last_undegraded":"2024-09-17T01:54:52.046780+0000","last_fullsized":"2024-09-17T01:54:52.046780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511557+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:54:52.511557+0000","last_peered":"2024-09-17T01:54:52.511557+0000","last_clean":"2024-09-17T01:54:52.511557+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:54:52.511557+0000","last_undegraded":"2024-09-17T01:54:52.511557+0000","last_fullsized":"2024-09-17T01:54:52.511557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510016+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:54:52.510016+0000","last_peered":"2024-09-17T01:54:52.510016+0000","last_clean":"2024-09-17T01:54:52.510016+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:54:52.510016+0000","last_undegraded":"2024-09-17T01:54:52.510016+0000","last_fullsized":"2024-09-17T01:54:52.510016+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046329+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:54:52.046329+0000","last_peered":"2024-09-17T01:54:52.046329+0000","last_clean":"2024-09-17T01:54:52.046329+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:54:52.046329+0000","last_undegraded":"2024-09-17T01:54:52.046329+0000","last_fullsized":"2024-09-17T01:54:52.046329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761354+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:54:51.761354+0000","last_peered":"2024-09-17T01:54:51.761354+0000","last_clean":"2024-09-17T01:54:51.761354+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:54:51.761354+0000","last_undegraded":"2024-09-17T01:54:51.761354+0000","last_fullsized":"2024-09-17T01:54:51.761354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046881+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:54:52.046881+0000","last_peered":"2024-09-17T01:54:52.046881+0000","last_clean":"2024-09-17T01:54:52.046881+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:54:52.046881+0000","last_undegraded":"2024-09-17T01:54:52.046881+0000","last_fullsized":"2024-09-17T01:54:52.046881+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760073+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:54:51.760073+0000","last_peered":"2024-09-17T01:54:51.760073+0000","last_clean":"2024-09-17T01:54:51.760073+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:54:51.760073+0000","last_undegraded":"2024-09-17T01:54:51.760073+0000","last_fullsized":"2024-09-17T01:54:51.760073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048326+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:54:52.048326+0000","last_peered":"2024-09-17T01:54:52.048326+0000","last_clean":"2024-09-17T01:54:52.048326+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:54:52.048326+0000","last_undegraded":"2024-09-17T01:54:52.048326+0000","last_fullsized":"2024-09-17T01:54:52.048326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511447+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:54:52.511447+0000","last_peered":"2024-09-17T01:54:52.511447+0000","last_clean":"2024-09-17T01:54:52.511447+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:54:52.511447+0000","last_undegraded":"2024-09-17T01:54:52.511447+0000","last_fullsized":"2024-09-17T01:54:52.511447+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.507949+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:54:52.507949+0000","last_peered":"2024-09-17T01:54:52.507949+0000","last_clean":"2024-09-17T01:54:52.507949+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:54:52.507949+0000","last_undegraded":"2024-09-17T01:54:52.507949+0000","last_fullsized":"2024-09-17T01:54:52.507949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047575+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:54:52.047575+0000","last_peered":"2024-09-17T01:54:52.047575+0000","last_clean":"2024-09-17T01:54:52.047575+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:54:52.047575+0000","last_undegraded":"2024-09-17T01:54:52.047575+0000","last_fullsized":"2024-09-17T01:54:52.047575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508237+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:54:52.508237+0000","last_peered":"2024-09-17T01:54:52.508237+0000","last_clean":"2024-09-17T01:54:52.508237+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:54:52.508237+0000","last_undegraded":"2024-09-17T01:54:52.508237+0000","last_fullsized":"2024-09-17T01:54:52.508237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048158+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:54:52.048158+0000","last_peered":"2024-09-17T01:54:52.048158+0000","last_clean":"2024-09-17T01:54:52.048158+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:54:52.048158+0000","last_undegraded":"2024-09-17T01:54:52.048158+0000","last_fullsized":"2024-09-17T01:54:52.048158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760247+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:54:51.760247+0000","last_peered":"2024-09-17T01:54:51.760247+0000","last_clean":"2024-09-17T01:54:51.760247+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:54:51.760247+0000","last_undegraded":"2024-09-17T01:54:51.760247+0000","last_fullsized":"2024-09-17T01:54:51.760247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048046+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:54:52.048046+0000","last_peered":"2024-09-17T01:54:52.048046+0000","last_clean":"2024-09-17T01:54:52.048046+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:54:52.048046+0000","last_undegraded":"2024-09-17T01:54:52.048046+0000","last_fullsized":"2024-09-17T01:54:52.048046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762206+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:54:51.762206+0000","last_peered":"2024-09-17T01:54:51.762206+0000","last_clean":"2024-09-17T01:54:51.762206+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:54:51.762206+0000","last_undegraded":"2024-09-17T01:54:51.762206+0000","last_fullsized":"2024-09-17T01:54:51.762206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761076+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:54:51.761076+0000","last_peered":"2024-09-17T01:54:51.761076+0000","last_clean":"2024-09-17T01:54:51.761076+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:54:51.761076+0000","last_undegraded":"2024-09-17T01:54:51.761076+0000","last_fullsized":"2024-09-17T01:54:51.761076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048881+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:54:52.048881+0000","last_peered":"2024-09-17T01:54:52.048881+0000","last_clean":"2024-09-17T01:54:52.048881+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:54:52.048881+0000","last_undegraded":"2024-09-17T01:54:52.048881+0000","last_fullsized":"2024-09-17T01:54:52.048881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048723+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:54:52.048723+0000","last_peered":"2024-09-17T01:54:52.048723+0000","last_clean":"2024-09-17T01:54:52.048723+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:54:52.048723+0000","last_undegraded":"2024-09-17T01:54:52.048723+0000","last_fullsized":"2024-09-17T01:54:52.048723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046260+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:54:52.046260+0000","last_peered":"2024-09-17T01:54:52.046260+0000","last_clean":"2024-09-17T01:54:52.046260+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:54:52.046260+0000","last_undegraded":"2024-09-17T01:54:52.046260+0000","last_fullsized":"2024-09-17T01:54:52.046260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048626+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:54:52.048626+0000","last_peered":"2024-09-17T01:54:52.048626+0000","last_clean":"2024-09-17T01:54:52.048626+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:54:52.048626+0000","last_undegraded":"2024-09-17T01:54:52.048626+0000","last_fullsized":"2024-09-17T01:54:52.048626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511221+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:54:52.511221+0000","last_peered":"2024-09-17T01:54:52.511221+0000","last_clean":"2024-09-17T01:54:52.511221+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:54:52.511221+0000","last_undegraded":"2024-09-17T01:54:52.511221+0000","last_fullsized":"2024-09-17T01:54:52.511221+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759943+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:54:51.759943+0000","last_peered":"2024-09-17T01:54:51.759943+0000","last_clean":"2024-09-17T01:54:51.759943+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:54:51.759943+0000","last_undegraded":"2024-09-17T01:54:51.759943+0000","last_fullsized":"2024-09-17T01:54:51.759943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511436+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:54:52.511436+0000","last_peered":"2024-09-17T01:54:52.511436+0000","last_clean":"2024-09-17T01:54:52.511436+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:54:52.511436+0000","last_undegraded":"2024-09-17T01:54:52.511436+0000","last_fullsized":"2024-09-17T01:54:52.511436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508398+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:54:52.508398+0000","last_peered":"2024-09-17T01:54:52.508398+0000","last_clean":"2024-09-17T01:54:52.508398+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:54:52.508398+0000","last_undegraded":"2024-09-17T01:54:52.508398+0000","last_fullsized":"2024-09-17T01:54:52.508398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046124+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:54:52.046124+0000","last_peered":"2024-09-17T01:54:52.046124+0000","last_clean":"2024-09-17T01:54:52.046124+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:54:52.046124+0000","last_undegraded":"2024-09-17T01:54:52.046124+0000","last_fullsized":"2024-09-17T01:54:52.046124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761916+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:54:51.761916+0000","last_peered":"2024-09-17T01:54:51.761916+0000","last_clean":"2024-09-17T01:54:51.761916+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:54:51.761916+0000","last_undegraded":"2024-09-17T01:54:51.761916+0000","last_fullsized":"2024-09-17T01:54:51.761916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508229+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:54:52.508229+0000","last_peered":"2024-09-17T01:54:52.508229+0000","last_clean":"2024-09-17T01:54:52.508229+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:54:52.508229+0000","last_undegraded":"2024-09-17T01:54:52.508229+0000","last_fullsized":"2024-09-17T01:54:52.508229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045996+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:54:52.045996+0000","last_peered":"2024-09-17T01:54:52.045996+0000","last_clean":"2024-09-17T01:54:52.045996+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:54:52.045996+0000","last_undegraded":"2024-09-17T01:54:52.045996+0000","last_fullsized":"2024-09-17T01:54:52.045996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048711+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:54:52.048711+0000","last_peered":"2024-09-17T01:54:52.048711+0000","last_clean":"2024-09-17T01:54:52.048711+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:54:52.048711+0000","last_undegraded":"2024-09-17T01:54:52.048711+0000","last_fullsized":"2024-09-17T01:54:52.048711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046028+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:54:52.046028+0000","last_peered":"2024-09-17T01:54:52.046028+0000","last_clean":"2024-09-17T01:54:52.046028+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:54:52.046028+0000","last_undegraded":"2024-09-17T01:54:52.046028+0000","last_fullsized":"2024-09-17T01:54:52.046028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762090+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:54:51.762090+0000","last_peered":"2024-09-17T01:54:51.762090+0000","last_clean":"2024-09-17T01:54:51.762090+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:54:51.762090+0000","last_undegraded":"2024-09-17T01:54:51.762090+0000","last_fullsized":"2024-09-17T01:54:51.762090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046353+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:54:52.046353+0000","last_peered":"2024-09-17T01:54:52.046353+0000","last_clean":"2024-09-17T01:54:52.046353+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:54:52.046353+0000","last_undegraded":"2024-09-17T01:54:52.046353+0000","last_fullsized":"2024-09-17T01:54:52.046353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047872+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:54:52.047872+0000","last_peered":"2024-09-17T01:54:52.047872+0000","last_clean":"2024-09-17T01:54:52.047872+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:54:52.047872+0000","last_undegraded":"2024-09-17T01:54:52.047872+0000","last_fullsized":"2024-09-17T01:54:52.047872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046511+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:54:52.046511+0000","last_peered":"2024-09-17T01:54:52.046511+0000","last_clean":"2024-09-17T01:54:52.046511+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:54:52.046511+0000","last_undegraded":"2024-09-17T01:54:52.046511+0000","last_fullsized":"2024-09-17T01:54:52.046511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761094+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:54:51.761094+0000","last_peered":"2024-09-17T01:54:51.761094+0000","last_clean":"2024-09-17T01:54:51.761094+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:54:51.761094+0000","last_undegraded":"2024-09-17T01:54:51.761094+0000","last_fullsized":"2024-09-17T01:54:51.761094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760882+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:54:51.760882+0000","last_peered":"2024-09-17T01:54:51.760882+0000","last_clean":"2024-09-17T01:54:51.760882+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:54:51.760882+0000","last_undegraded":"2024-09-17T01:54:51.760882+0000","last_fullsized":"2024-09-17T01:54:51.760882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761252+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:54:51.761252+0000","last_peered":"2024-09-17T01:54:51.761252+0000","last_clean":"2024-09-17T01:54:51.761252+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:54:51.761252+0000","last_undegraded":"2024-09-17T01:54:51.761252+0000","last_fullsized":"2024-09-17T01:54:51.761252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761328+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:54:51.761328+0000","last_peered":"2024-09-17T01:54:51.761328+0000","last_clean":"2024-09-17T01:54:51.761328+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:54:51.761328+0000","last_undegraded":"2024-09-17T01:54:51.761328+0000","last_fullsized":"2024-09-17T01:54:51.761328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511656+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:54:52.511656+0000","last_peered":"2024-09-17T01:54:52.511656+0000","last_clean":"2024-09-17T01:54:52.511656+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:54:52.511656+0000","last_undegraded":"2024-09-17T01:54:52.511656+0000","last_fullsized":"2024-09-17T01:54:52.511656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508816+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:54:52.508816+0000","last_peered":"2024-09-17T01:54:52.508816+0000","last_clean":"2024-09-17T01:54:52.508816+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:54:52.508816+0000","last_undegraded":"2024-09-17T01:54:52.508816+0000","last_fullsized":"2024-09-17T01:54:52.508816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510576+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:54:52.510576+0000","last_peered":"2024-09-17T01:54:52.510576+0000","last_clean":"2024-09-17T01:54:52.510576+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:54:52.510576+0000","last_undegraded":"2024-09-17T01:54:52.510576+0000","last_fullsized":"2024-09-17T01:54:52.510576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761513+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:54:51.761513+0000","last_peered":"2024-09-17T01:54:51.761513+0000","last_clean":"2024-09-17T01:54:51.761513+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:54:51.761513+0000","last_undegraded":"2024-09-17T01:54:51.761513+0000","last_fullsized":"2024-09-17T01:54:51.761513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760671+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:54:51.760671+0000","last_peered":"2024-09-17T01:54:51.760671+0000","last_clean":"2024-09-17T01:54:51.760671+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:54:51.760671+0000","last_undegraded":"2024-09-17T01:54:51.760671+0000","last_fullsized":"2024-09-17T01:54:51.760671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048319+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:54:52.048319+0000","last_peered":"2024-09-17T01:54:52.048319+0000","last_clean":"2024-09-17T01:54:52.048319+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:54:52.048319+0000","last_undegraded":"2024-09-17T01:54:52.048319+0000","last_fullsized":"2024-09-17T01:54:52.048319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509595+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:54:52.509595+0000","last_peered":"2024-09-17T01:54:52.509595+0000","last_clean":"2024-09-17T01:54:52.509595+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:54:52.509595+0000","last_undegraded":"2024-09-17T01:54:52.509595+0000","last_fullsized":"2024-09-17T01:54:52.509595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048549+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:54:52.048549+0000","last_peered":"2024-09-17T01:54:52.048549+0000","last_clean":"2024-09-17T01:54:52.048549+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:54:52.048549+0000","last_undegraded":"2024-09-17T01:54:52.048549+0000","last_fullsized":"2024-09-17T01:54:52.048549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":656071,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":655436,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:54:58.986 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:54:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:54:59.327 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:54:59.344 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-17T01:54:57.976907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90092,"kb_used_data":688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025428,"statfs":{"total":289910292480,"available":289818038272,"internally_reserved":0,"allocated":704512,"data_stored":1375416,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002738"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761800+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:54:51.761800+0000","last_peered":"2024-09-17T01:54:51.761800+0000","last_clean":"2024-09-17T01:54:51.761800+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:54:51.761800+0000","last_undegraded":"2024-09-17T01:54:51.761800+0000","last_fullsized":"2024-09-17T01:54:51.761800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760791+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:54:51.760791+0000","last_peered":"2024-09-17T01:54:51.760791+0000","last_clean":"2024-09-17T01:54:51.760791+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:54:51.760791+0000","last_undegraded":"2024-09-17T01:54:51.760791+0000","last_fullsized":"2024-09-17T01:54:51.760791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510371+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:54:52.510371+0000","last_peered":"2024-09-17T01:54:52.510371+0000","last_clean":"2024-09-17T01:54:52.510371+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:54:52.510371+0000","last_undegraded":"2024-09-17T01:54:52.510371+0000","last_fullsized":"2024-09-17T01:54:52.510371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510379+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:54:52.510379+0000","last_peered":"2024-09-17T01:54:52.510379+0000","last_clean":"2024-09-17T01:54:52.510379+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:54:52.510379+0000","last_undegraded":"2024-09-17T01:54:52.510379+0000","last_fullsized":"2024-09-17T01:54:52.510379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761214+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:54:51.761214+0000","last_peered":"2024-09-17T01:54:51.761214+0000","last_clean":"2024-09-17T01:54:51.761214+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:54:51.761214+0000","last_undegraded":"2024-09-17T01:54:51.761214+0000","last_fullsized":"2024-09-17T01:54:51.761214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510034+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:54:52.510034+0000","last_peered":"2024-09-17T01:54:52.510034+0000","last_clean":"2024-09-17T01:54:52.510034+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:54:52.510034+0000","last_undegraded":"2024-09-17T01:54:52.510034+0000","last_fullsized":"2024-09-17T01:54:52.510034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509514+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:54:52.509514+0000","last_peered":"2024-09-17T01:54:52.509514+0000","last_clean":"2024-09-17T01:54:52.509514+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:54:52.509514+0000","last_undegraded":"2024-09-17T01:54:52.509514+0000","last_fullsized":"2024-09-17T01:54:52.509514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509252+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:54:52.509252+0000","last_peered":"2024-09-17T01:54:52.509252+0000","last_clean":"2024-09-17T01:54:52.509252+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:54:52.509252+0000","last_undegraded":"2024-09-17T01:54:52.509252+0000","last_fullsized":"2024-09-17T01:54:52.509252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047987+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:54:52.047987+0000","last_peered":"2024-09-17T01:54:52.047987+0000","last_clean":"2024-09-17T01:54:52.047987+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:54:52.047987+0000","last_undegraded":"2024-09-17T01:54:52.047987+0000","last_fullsized":"2024-09-17T01:54:52.047987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761041+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:54:51.761041+0000","last_peered":"2024-09-17T01:54:51.761041+0000","last_clean":"2024-09-17T01:54:51.761041+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:54:51.761041+0000","last_undegraded":"2024-09-17T01:54:51.761041+0000","last_fullsized":"2024-09-17T01:54:51.761041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510647+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:54:52.510647+0000","last_peered":"2024-09-17T01:54:52.510647+0000","last_clean":"2024-09-17T01:54:52.510647+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:54:52.510647+0000","last_undegraded":"2024-09-17T01:54:52.510647+0000","last_fullsized":"2024-09-17T01:54:52.510647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761113+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:54:51.761113+0000","last_peered":"2024-09-17T01:54:51.761113+0000","last_clean":"2024-09-17T01:54:51.761113+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:54:51.761113+0000","last_undegraded":"2024-09-17T01:54:51.761113+0000","last_fullsized":"2024-09-17T01:54:51.761113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760839+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:54:51.760839+0000","last_peered":"2024-09-17T01:54:51.760839+0000","last_clean":"2024-09-17T01:54:51.760839+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:54:51.760839+0000","last_undegraded":"2024-09-17T01:54:51.760839+0000","last_fullsized":"2024-09-17T01:54:51.760839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510289+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:54:52.510289+0000","last_peered":"2024-09-17T01:54:52.510289+0000","last_clean":"2024-09-17T01:54:52.510289+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:54:52.510289+0000","last_undegraded":"2024-09-17T01:54:52.510289+0000","last_fullsized":"2024-09-17T01:54:52.510289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509575+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:54:52.509575+0000","last_peered":"2024-09-17T01:54:52.509575+0000","last_clean":"2024-09-17T01:54:52.509575+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:54:52.509575+0000","last_undegraded":"2024-09-17T01:54:52.509575+0000","last_fullsized":"2024-09-17T01:54:52.509575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509270+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:54:52.509270+0000","last_peered":"2024-09-17T01:54:52.509270+0000","last_clean":"2024-09-17T01:54:52.509270+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:54:52.509270+0000","last_undegraded":"2024-09-17T01:54:52.509270+0000","last_fullsized":"2024-09-17T01:54:52.509270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048707+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:54:52.048707+0000","last_peered":"2024-09-17T01:54:52.048707+0000","last_clean":"2024-09-17T01:54:52.048707+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:54:52.048707+0000","last_undegraded":"2024-09-17T01:54:52.048707+0000","last_fullsized":"2024-09-17T01:54:52.048707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761836+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:54:51.761836+0000","last_peered":"2024-09-17T01:54:51.761836+0000","last_clean":"2024-09-17T01:54:51.761836+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:54:51.761836+0000","last_undegraded":"2024-09-17T01:54:51.761836+0000","last_fullsized":"2024-09-17T01:54:51.761836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047807+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:54:52.047807+0000","last_peered":"2024-09-17T01:54:52.047807+0000","last_clean":"2024-09-17T01:54:52.047807+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:54:52.047807+0000","last_undegraded":"2024-09-17T01:54:52.047807+0000","last_fullsized":"2024-09-17T01:54:52.047807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511700+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:54:52.511700+0000","last_peered":"2024-09-17T01:54:52.511700+0000","last_clean":"2024-09-17T01:54:52.511700+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:54:52.511700+0000","last_undegraded":"2024-09-17T01:54:52.511700+0000","last_fullsized":"2024-09-17T01:54:52.511700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510771+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:54:52.510771+0000","last_peered":"2024-09-17T01:54:52.510771+0000","last_clean":"2024-09-17T01:54:52.510771+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:54:52.510771+0000","last_undegraded":"2024-09-17T01:54:52.510771+0000","last_fullsized":"2024-09-17T01:54:52.510771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760250+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:54:51.760250+0000","last_peered":"2024-09-17T01:54:51.760250+0000","last_clean":"2024-09-17T01:54:51.760250+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:54:51.760250+0000","last_undegraded":"2024-09-17T01:54:51.760250+0000","last_fullsized":"2024-09-17T01:54:51.760250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045717+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:54:52.045717+0000","last_peered":"2024-09-17T01:54:52.045717+0000","last_clean":"2024-09-17T01:54:52.045717+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:54:52.045717+0000","last_undegraded":"2024-09-17T01:54:52.045717+0000","last_fullsized":"2024-09-17T01:54:52.045717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759679+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:54:51.759679+0000","last_peered":"2024-09-17T01:54:51.759679+0000","last_clean":"2024-09-17T01:54:51.759679+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:54:51.759679+0000","last_undegraded":"2024-09-17T01:54:51.759679+0000","last_fullsized":"2024-09-17T01:54:51.759679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761971+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:54:51.761971+0000","last_peered":"2024-09-17T01:54:51.761971+0000","last_clean":"2024-09-17T01:54:51.761971+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:54:51.761971+0000","last_undegraded":"2024-09-17T01:54:51.761971+0000","last_fullsized":"2024-09-17T01:54:51.761971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047934+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:54:52.047934+0000","last_peered":"2024-09-17T01:54:52.047934+0000","last_clean":"2024-09-17T01:54:52.047934+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:54:52.047934+0000","last_undegraded":"2024-09-17T01:54:52.047934+0000","last_fullsized":"2024-09-17T01:54:52.047934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511392+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:54:52.511392+0000","last_peered":"2024-09-17T01:54:52.511392+0000","last_clean":"2024-09-17T01:54:52.511392+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:54:52.511392+0000","last_undegraded":"2024-09-17T01:54:52.511392+0000","last_fullsized":"2024-09-17T01:54:52.511392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761581+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:54:51.761581+0000","last_peered":"2024-09-17T01:54:51.761581+0000","last_clean":"2024-09-17T01:54:51.761581+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:54:51.761581+0000","last_undegraded":"2024-09-17T01:54:51.761581+0000","last_fullsized":"2024-09-17T01:54:51.761581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046926+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:54:52.046926+0000","last_peered":"2024-09-17T01:54:52.046926+0000","last_clean":"2024-09-17T01:54:52.046926+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:54:52.046926+0000","last_undegraded":"2024-09-17T01:54:52.046926+0000","last_fullsized":"2024-09-17T01:54:52.046926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760578+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:54:51.760578+0000","last_peered":"2024-09-17T01:54:51.760578+0000","last_clean":"2024-09-17T01:54:51.760578+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:54:51.760578+0000","last_undegraded":"2024-09-17T01:54:51.760578+0000","last_fullsized":"2024-09-17T01:54:51.760578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045825+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:54:52.045825+0000","last_peered":"2024-09-17T01:54:52.045825+0000","last_clean":"2024-09-17T01:54:52.045825+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:54:52.045825+0000","last_undegraded":"2024-09-17T01:54:52.045825+0000","last_fullsized":"2024-09-17T01:54:52.045825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509497+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:54:52.509497+0000","last_peered":"2024-09-17T01:54:52.509497+0000","last_clean":"2024-09-17T01:54:52.509497+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:54:52.509497+0000","last_undegraded":"2024-09-17T01:54:52.509497+0000","last_fullsized":"2024-09-17T01:54:52.509497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761358+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:54:51.761358+0000","last_peered":"2024-09-17T01:54:51.761358+0000","last_clean":"2024-09-17T01:54:51.761358+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:54:51.761358+0000","last_undegraded":"2024-09-17T01:54:51.761358+0000","last_fullsized":"2024-09-17T01:54:51.761358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508359+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:54:52.508359+0000","last_peered":"2024-09-17T01:54:52.508359+0000","last_clean":"2024-09-17T01:54:52.508359+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:54:52.508359+0000","last_undegraded":"2024-09-17T01:54:52.508359+0000","last_fullsized":"2024-09-17T01:54:52.508359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761256+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:54:51.761256+0000","last_peered":"2024-09-17T01:54:51.761256+0000","last_clean":"2024-09-17T01:54:51.761256+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:54:51.761256+0000","last_undegraded":"2024-09-17T01:54:51.761256+0000","last_fullsized":"2024-09-17T01:54:51.761256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046506+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:54:52.046506+0000","last_peered":"2024-09-17T01:54:52.046506+0000","last_clean":"2024-09-17T01:54:52.046506+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:54:52.046506+0000","last_undegraded":"2024-09-17T01:54:52.046506+0000","last_fullsized":"2024-09-17T01:54:52.046506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048381+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:54:52.048381+0000","last_peered":"2024-09-17T01:54:52.048381+0000","last_clean":"2024-09-17T01:54:52.048381+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:54:52.048381+0000","last_undegraded":"2024-09-17T01:54:52.048381+0000","last_fullsized":"2024-09-17T01:54:52.048381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760219+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:54:51.760219+0000","last_peered":"2024-09-17T01:54:51.760219+0000","last_clean":"2024-09-17T01:54:51.760219+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:54:51.760219+0000","last_undegraded":"2024-09-17T01:54:51.760219+0000","last_fullsized":"2024-09-17T01:54:51.760219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048104+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:54:52.048104+0000","last_peered":"2024-09-17T01:54:52.048104+0000","last_clean":"2024-09-17T01:54:52.048104+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:54:52.048104+0000","last_undegraded":"2024-09-17T01:54:52.048104+0000","last_fullsized":"2024-09-17T01:54:52.048104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.507759+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:54:52.507759+0000","last_peered":"2024-09-17T01:54:52.507759+0000","last_clean":"2024-09-17T01:54:52.507759+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:54:52.507759+0000","last_undegraded":"2024-09-17T01:54:52.507759+0000","last_fullsized":"2024-09-17T01:54:52.507759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508222+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:54:52.508222+0000","last_peered":"2024-09-17T01:54:52.508222+0000","last_clean":"2024-09-17T01:54:52.508222+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:54:52.508222+0000","last_undegraded":"2024-09-17T01:54:52.508222+0000","last_fullsized":"2024-09-17T01:54:52.508222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759780+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:54:51.759780+0000","last_peered":"2024-09-17T01:54:51.759780+0000","last_clean":"2024-09-17T01:54:51.759780+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:54:51.759780+0000","last_undegraded":"2024-09-17T01:54:51.759780+0000","last_fullsized":"2024-09-17T01:54:51.759780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761918+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:54:51.761918+0000","last_peered":"2024-09-17T01:54:51.761918+0000","last_clean":"2024-09-17T01:54:51.761918+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:54:51.761918+0000","last_undegraded":"2024-09-17T01:54:51.761918+0000","last_fullsized":"2024-09-17T01:54:51.761918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759924+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:54:51.759924+0000","last_peered":"2024-09-17T01:54:51.759924+0000","last_clean":"2024-09-17T01:54:51.759924+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:54:51.759924+0000","last_undegraded":"2024-09-17T01:54:51.759924+0000","last_fullsized":"2024-09-17T01:54:51.759924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508617+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:54:52.508617+0000","last_peered":"2024-09-17T01:54:52.508617+0000","last_clean":"2024-09-17T01:54:52.508617+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:54:52.508617+0000","last_undegraded":"2024-09-17T01:54:52.508617+0000","last_fullsized":"2024-09-17T01:54:52.508617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511137+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:54:52.511137+0000","last_peered":"2024-09-17T01:54:52.511137+0000","last_clean":"2024-09-17T01:54:52.511137+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:54:52.511137+0000","last_undegraded":"2024-09-17T01:54:52.511137+0000","last_fullsized":"2024-09-17T01:54:52.511137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508082+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:54:52.508082+0000","last_peered":"2024-09-17T01:54:52.508082+0000","last_clean":"2024-09-17T01:54:52.508082+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:54:52.508082+0000","last_undegraded":"2024-09-17T01:54:52.508082+0000","last_fullsized":"2024-09-17T01:54:52.508082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046429+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:54:52.046429+0000","last_peered":"2024-09-17T01:54:52.046429+0000","last_clean":"2024-09-17T01:54:52.046429+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:54:52.046429+0000","last_undegraded":"2024-09-17T01:54:52.046429+0000","last_fullsized":"2024-09-17T01:54:52.046429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047307+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:54:52.047307+0000","last_peered":"2024-09-17T01:54:52.047307+0000","last_clean":"2024-09-17T01:54:52.047307+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:54:52.047307+0000","last_undegraded":"2024-09-17T01:54:52.047307+0000","last_fullsized":"2024-09-17T01:54:52.047307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511506+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:54:52.511506+0000","last_peered":"2024-09-17T01:54:52.511506+0000","last_clean":"2024-09-17T01:54:52.511506+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:54:52.511506+0000","last_undegraded":"2024-09-17T01:54:52.511506+0000","last_fullsized":"2024-09-17T01:54:52.511506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.507950+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:54:52.507950+0000","last_peered":"2024-09-17T01:54:52.507950+0000","last_clean":"2024-09-17T01:54:52.507950+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:54:52.507950+0000","last_undegraded":"2024-09-17T01:54:52.507950+0000","last_fullsized":"2024-09-17T01:54:52.507950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511315+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:54:52.511315+0000","last_peered":"2024-09-17T01:54:52.511315+0000","last_clean":"2024-09-17T01:54:52.511315+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:54:52.511315+0000","last_undegraded":"2024-09-17T01:54:52.511315+0000","last_fullsized":"2024-09-17T01:54:52.511315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760302+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:54:51.760302+0000","last_peered":"2024-09-17T01:54:51.760302+0000","last_clean":"2024-09-17T01:54:51.760302+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:54:51.760302+0000","last_undegraded":"2024-09-17T01:54:51.760302+0000","last_fullsized":"2024-09-17T01:54:51.760302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510452+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:54:52.510452+0000","last_peered":"2024-09-17T01:54:52.510452+0000","last_clean":"2024-09-17T01:54:52.510452+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:54:52.510452+0000","last_undegraded":"2024-09-17T01:54:52.510452+0000","last_fullsized":"2024-09-17T01:54:52.510452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759889+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:54:51.759889+0000","last_peered":"2024-09-17T01:54:51.759889+0000","last_clean":"2024-09-17T01:54:51.759889+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:54:51.759889+0000","last_undegraded":"2024-09-17T01:54:51.759889+0000","last_fullsized":"2024-09-17T01:54:51.759889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048271+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:54:52.048271+0000","last_peered":"2024-09-17T01:54:52.048271+0000","last_clean":"2024-09-17T01:54:52.048271+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:54:52.048271+0000","last_undegraded":"2024-09-17T01:54:52.048271+0000","last_fullsized":"2024-09-17T01:54:52.048271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510011+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:54:52.510011+0000","last_peered":"2024-09-17T01:54:52.510011+0000","last_clean":"2024-09-17T01:54:52.510011+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:54:52.510011+0000","last_undegraded":"2024-09-17T01:54:52.510011+0000","last_fullsized":"2024-09-17T01:54:52.510011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.512036+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:54:52.512036+0000","last_peered":"2024-09-17T01:54:52.512036+0000","last_clean":"2024-09-17T01:54:52.512036+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:54:52.512036+0000","last_undegraded":"2024-09-17T01:54:52.512036+0000","last_fullsized":"2024-09-17T01:54:52.512036+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046780+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:54:52.046780+0000","last_peered":"2024-09-17T01:54:52.046780+0000","last_clean":"2024-09-17T01:54:52.046780+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:54:52.046780+0000","last_undegraded":"2024-09-17T01:54:52.046780+0000","last_fullsized":"2024-09-17T01:54:52.046780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511557+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:54:52.511557+0000","last_peered":"2024-09-17T01:54:52.511557+0000","last_clean":"2024-09-17T01:54:52.511557+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:54:52.511557+0000","last_undegraded":"2024-09-17T01:54:52.511557+0000","last_fullsized":"2024-09-17T01:54:52.511557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510016+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:54:52.510016+0000","last_peered":"2024-09-17T01:54:52.510016+0000","last_clean":"2024-09-17T01:54:52.510016+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:54:52.510016+0000","last_undegraded":"2024-09-17T01:54:52.510016+0000","last_fullsized":"2024-09-17T01:54:52.510016+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046329+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:54:52.046329+0000","last_peered":"2024-09-17T01:54:52.046329+0000","last_clean":"2024-09-17T01:54:52.046329+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:54:52.046329+0000","last_undegraded":"2024-09-17T01:54:52.046329+0000","last_fullsized":"2024-09-17T01:54:52.046329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761354+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:54:51.761354+0000","last_peered":"2024-09-17T01:54:51.761354+0000","last_clean":"2024-09-17T01:54:51.761354+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:54:51.761354+0000","last_undegraded":"2024-09-17T01:54:51.761354+0000","last_fullsized":"2024-09-17T01:54:51.761354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046881+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:54:52.046881+0000","last_peered":"2024-09-17T01:54:52.046881+0000","last_clean":"2024-09-17T01:54:52.046881+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:54:52.046881+0000","last_undegraded":"2024-09-17T01:54:52.046881+0000","last_fullsized":"2024-09-17T01:54:52.046881+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760073+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:54:51.760073+0000","last_peered":"2024-09-17T01:54:51.760073+0000","last_clean":"2024-09-17T01:54:51.760073+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:54:51.760073+0000","last_undegraded":"2024-09-17T01:54:51.760073+0000","last_fullsized":"2024-09-17T01:54:51.760073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048326+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:54:52.048326+0000","last_peered":"2024-09-17T01:54:52.048326+0000","last_clean":"2024-09-17T01:54:52.048326+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:54:52.048326+0000","last_undegraded":"2024-09-17T01:54:52.048326+0000","last_fullsized":"2024-09-17T01:54:52.048326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511447+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:54:52.511447+0000","last_peered":"2024-09-17T01:54:52.511447+0000","last_clean":"2024-09-17T01:54:52.511447+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:54:52.511447+0000","last_undegraded":"2024-09-17T01:54:52.511447+0000","last_fullsized":"2024-09-17T01:54:52.511447+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.507949+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:54:52.507949+0000","last_peered":"2024-09-17T01:54:52.507949+0000","last_clean":"2024-09-17T01:54:52.507949+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:54:52.507949+0000","last_undegraded":"2024-09-17T01:54:52.507949+0000","last_fullsized":"2024-09-17T01:54:52.507949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047575+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:54:52.047575+0000","last_peered":"2024-09-17T01:54:52.047575+0000","last_clean":"2024-09-17T01:54:52.047575+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:54:52.047575+0000","last_undegraded":"2024-09-17T01:54:52.047575+0000","last_fullsized":"2024-09-17T01:54:52.047575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508237+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:54:52.508237+0000","last_peered":"2024-09-17T01:54:52.508237+0000","last_clean":"2024-09-17T01:54:52.508237+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:54:52.508237+0000","last_undegraded":"2024-09-17T01:54:52.508237+0000","last_fullsized":"2024-09-17T01:54:52.508237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048158+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:54:52.048158+0000","last_peered":"2024-09-17T01:54:52.048158+0000","last_clean":"2024-09-17T01:54:52.048158+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:54:52.048158+0000","last_undegraded":"2024-09-17T01:54:52.048158+0000","last_fullsized":"2024-09-17T01:54:52.048158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760247+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:54:51.760247+0000","last_peered":"2024-09-17T01:54:51.760247+0000","last_clean":"2024-09-17T01:54:51.760247+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:54:51.760247+0000","last_undegraded":"2024-09-17T01:54:51.760247+0000","last_fullsized":"2024-09-17T01:54:51.760247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048046+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:54:52.048046+0000","last_peered":"2024-09-17T01:54:52.048046+0000","last_clean":"2024-09-17T01:54:52.048046+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:54:52.048046+0000","last_undegraded":"2024-09-17T01:54:52.048046+0000","last_fullsized":"2024-09-17T01:54:52.048046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762206+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:54:51.762206+0000","last_peered":"2024-09-17T01:54:51.762206+0000","last_clean":"2024-09-17T01:54:51.762206+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:54:51.762206+0000","last_undegraded":"2024-09-17T01:54:51.762206+0000","last_fullsized":"2024-09-17T01:54:51.762206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761076+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:54:51.761076+0000","last_peered":"2024-09-17T01:54:51.761076+0000","last_clean":"2024-09-17T01:54:51.761076+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:54:51.761076+0000","last_undegraded":"2024-09-17T01:54:51.761076+0000","last_fullsized":"2024-09-17T01:54:51.761076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048881+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:54:52.048881+0000","last_peered":"2024-09-17T01:54:52.048881+0000","last_clean":"2024-09-17T01:54:52.048881+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:54:52.048881+0000","last_undegraded":"2024-09-17T01:54:52.048881+0000","last_fullsized":"2024-09-17T01:54:52.048881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048723+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:54:52.048723+0000","last_peered":"2024-09-17T01:54:52.048723+0000","last_clean":"2024-09-17T01:54:52.048723+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:54:52.048723+0000","last_undegraded":"2024-09-17T01:54:52.048723+0000","last_fullsized":"2024-09-17T01:54:52.048723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046260+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:54:52.046260+0000","last_peered":"2024-09-17T01:54:52.046260+0000","last_clean":"2024-09-17T01:54:52.046260+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:54:52.046260+0000","last_undegraded":"2024-09-17T01:54:52.046260+0000","last_fullsized":"2024-09-17T01:54:52.046260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048626+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:54:52.048626+0000","last_peered":"2024-09-17T01:54:52.048626+0000","last_clean":"2024-09-17T01:54:52.048626+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:54:52.048626+0000","last_undegraded":"2024-09-17T01:54:52.048626+0000","last_fullsized":"2024-09-17T01:54:52.048626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511221+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:54:52.511221+0000","last_peered":"2024-09-17T01:54:52.511221+0000","last_clean":"2024-09-17T01:54:52.511221+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:54:52.511221+0000","last_undegraded":"2024-09-17T01:54:52.511221+0000","last_fullsized":"2024-09-17T01:54:52.511221+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.759943+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:54:51.759943+0000","last_peered":"2024-09-17T01:54:51.759943+0000","last_clean":"2024-09-17T01:54:51.759943+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:54:51.759943+0000","last_undegraded":"2024-09-17T01:54:51.759943+0000","last_fullsized":"2024-09-17T01:54:51.759943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511436+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:54:52.511436+0000","last_peered":"2024-09-17T01:54:52.511436+0000","last_clean":"2024-09-17T01:54:52.511436+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:54:52.511436+0000","last_undegraded":"2024-09-17T01:54:52.511436+0000","last_fullsized":"2024-09-17T01:54:52.511436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508398+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:54:52.508398+0000","last_peered":"2024-09-17T01:54:52.508398+0000","last_clean":"2024-09-17T01:54:52.508398+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:54:52.508398+0000","last_undegraded":"2024-09-17T01:54:52.508398+0000","last_fullsized":"2024-09-17T01:54:52.508398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046124+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:54:52.046124+0000","last_peered":"2024-09-17T01:54:52.046124+0000","last_clean":"2024-09-17T01:54:52.046124+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:54:52.046124+0000","last_undegraded":"2024-09-17T01:54:52.046124+0000","last_fullsized":"2024-09-17T01:54:52.046124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761916+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:54:51.761916+0000","last_peered":"2024-09-17T01:54:51.761916+0000","last_clean":"2024-09-17T01:54:51.761916+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:54:51.761916+0000","last_undegraded":"2024-09-17T01:54:51.761916+0000","last_fullsized":"2024-09-17T01:54:51.761916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508229+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:54:52.508229+0000","last_peered":"2024-09-17T01:54:52.508229+0000","last_clean":"2024-09-17T01:54:52.508229+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:54:52.508229+0000","last_undegraded":"2024-09-17T01:54:52.508229+0000","last_fullsized":"2024-09-17T01:54:52.508229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.045996+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:54:52.045996+0000","last_peered":"2024-09-17T01:54:52.045996+0000","last_clean":"2024-09-17T01:54:52.045996+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:54:52.045996+0000","last_undegraded":"2024-09-17T01:54:52.045996+0000","last_fullsized":"2024-09-17T01:54:52.045996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048711+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:54:52.048711+0000","last_peered":"2024-09-17T01:54:52.048711+0000","last_clean":"2024-09-17T01:54:52.048711+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:54:52.048711+0000","last_undegraded":"2024-09-17T01:54:52.048711+0000","last_fullsized":"2024-09-17T01:54:52.048711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046028+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:54:52.046028+0000","last_peered":"2024-09-17T01:54:52.046028+0000","last_clean":"2024-09-17T01:54:52.046028+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:54:52.046028+0000","last_undegraded":"2024-09-17T01:54:52.046028+0000","last_fullsized":"2024-09-17T01:54:52.046028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.762090+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:54:51.762090+0000","last_peered":"2024-09-17T01:54:51.762090+0000","last_clean":"2024-09-17T01:54:51.762090+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:54:51.762090+0000","last_undegraded":"2024-09-17T01:54:51.762090+0000","last_fullsized":"2024-09-17T01:54:51.762090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046353+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:54:52.046353+0000","last_peered":"2024-09-17T01:54:52.046353+0000","last_clean":"2024-09-17T01:54:52.046353+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:54:52.046353+0000","last_undegraded":"2024-09-17T01:54:52.046353+0000","last_fullsized":"2024-09-17T01:54:52.046353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.047872+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:54:52.047872+0000","last_peered":"2024-09-17T01:54:52.047872+0000","last_clean":"2024-09-17T01:54:52.047872+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:54:52.047872+0000","last_undegraded":"2024-09-17T01:54:52.047872+0000","last_fullsized":"2024-09-17T01:54:52.047872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.046511+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:54:52.046511+0000","last_peered":"2024-09-17T01:54:52.046511+0000","last_clean":"2024-09-17T01:54:52.046511+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:54:52.046511+0000","last_undegraded":"2024-09-17T01:54:52.046511+0000","last_fullsized":"2024-09-17T01:54:52.046511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761094+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:54:51.761094+0000","last_peered":"2024-09-17T01:54:51.761094+0000","last_clean":"2024-09-17T01:54:51.761094+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:54:51.761094+0000","last_undegraded":"2024-09-17T01:54:51.761094+0000","last_fullsized":"2024-09-17T01:54:51.761094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760882+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:54:51.760882+0000","last_peered":"2024-09-17T01:54:51.760882+0000","last_clean":"2024-09-17T01:54:51.760882+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:54:51.760882+0000","last_undegraded":"2024-09-17T01:54:51.760882+0000","last_fullsized":"2024-09-17T01:54:51.760882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761252+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:54:51.761252+0000","last_peered":"2024-09-17T01:54:51.761252+0000","last_clean":"2024-09-17T01:54:51.761252+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:54:51.761252+0000","last_undegraded":"2024-09-17T01:54:51.761252+0000","last_fullsized":"2024-09-17T01:54:51.761252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761328+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:54:51.761328+0000","last_peered":"2024-09-17T01:54:51.761328+0000","last_clean":"2024-09-17T01:54:51.761328+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:54:51.761328+0000","last_undegraded":"2024-09-17T01:54:51.761328+0000","last_fullsized":"2024-09-17T01:54:51.761328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.511656+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:54:52.511656+0000","last_peered":"2024-09-17T01:54:52.511656+0000","last_clean":"2024-09-17T01:54:52.511656+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:54:52.511656+0000","last_undegraded":"2024-09-17T01:54:52.511656+0000","last_fullsized":"2024-09-17T01:54:52.511656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.508816+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:54:52.508816+0000","last_peered":"2024-09-17T01:54:52.508816+0000","last_clean":"2024-09-17T01:54:52.508816+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:54:52.508816+0000","last_undegraded":"2024-09-17T01:54:52.508816+0000","last_fullsized":"2024-09-17T01:54:52.508816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.510576+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:54:52.510576+0000","last_peered":"2024-09-17T01:54:52.510576+0000","last_clean":"2024-09-17T01:54:52.510576+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:54:52.510576+0000","last_undegraded":"2024-09-17T01:54:52.510576+0000","last_fullsized":"2024-09-17T01:54:52.510576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.761513+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:54:51.761513+0000","last_peered":"2024-09-17T01:54:51.761513+0000","last_clean":"2024-09-17T01:54:51.761513+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:54:51.761513+0000","last_undegraded":"2024-09-17T01:54:51.761513+0000","last_fullsized":"2024-09-17T01:54:51.761513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:51.760671+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:54:51.760671+0000","last_peered":"2024-09-17T01:54:51.760671+0000","last_clean":"2024-09-17T01:54:51.760671+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:54:51.760671+0000","last_undegraded":"2024-09-17T01:54:51.760671+0000","last_fullsized":"2024-09-17T01:54:51.760671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048319+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:54:52.048319+0000","last_peered":"2024-09-17T01:54:52.048319+0000","last_clean":"2024-09-17T01:54:52.048319+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:54:52.048319+0000","last_undegraded":"2024-09-17T01:54:52.048319+0000","last_fullsized":"2024-09-17T01:54:52.048319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.509595+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:54:52.509595+0000","last_peered":"2024-09-17T01:54:52.509595+0000","last_clean":"2024-09-17T01:54:52.509595+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:54:52.509595+0000","last_undegraded":"2024-09-17T01:54:52.509595+0000","last_fullsized":"2024-09-17T01:54:52.509595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-17T01:54:52.048549+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:54:52.048549+0000","last_peered":"2024-09-17T01:54:52.048549+0000","last_clean":"2024-09-17T01:54:52.048549+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:54:52.048549+0000","last_undegraded":"2024-09-17T01:54:52.048549+0000","last_fullsized":"2024-09-17T01:54:52.048549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":656071,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":655436,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:54:59.348 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:54:59.348 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-17T01:54:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 20 2024-09-17T01:54:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 7af2c608-be6c-4ac4-a462-cff6aa13e357 2024-09-17T01:54:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-17T01:54:21.836260+0000 2024-09-17T01:54:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-17T01:54:51.748116+0000 2024-09-17T01:54:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-17T01:54:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:crush_version 4 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:full_ratio 0.95 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:backfillfull_ratio 0.9 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:nearfull_ratio 0.85 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:require_min_compat_client luminous 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:min_compat_client jewel 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:require_osd_release squid 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:stretch_mode_enabled false 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-17T01:54:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:max_osd 3 2024-09-17T01:54:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6800/1783419646,v1:172.21.15.96:6801/1783419646] [v2:172.21.15.96:6802/1783419646,v1:172.21.15.96:6803/1783419646] exists,up 321981a6-5caa-44f3-b6ae-aa4e97947db6 2024-09-17T01:54:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/3191117572,v1:172.21.15.98:6801/3191117572] [v2:172.21.15.98:6802/3191117572,v1:172.21.15.98:6803/3191117572] exists,up 36930e57-781c-48b6-a499-40cb00df2f38 2024-09-17T01:54:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/495067980,v1:172.21.15.154:6801/495067980] [v2:172.21.15.154:6802/495067980,v1:172.21.15.154:6803/495067980] exists,up 5a5a5a07-1fcd-4160-a4b1-e8431052e44c 2024-09-17T01:54:59.717 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6800/1783419646,v1:172.21.15.96:6801/1783419646] [v2:172.21.15.96:6802/1783419646,v1:172.21.15.96:6803/1783419646] exists,up 321981a6-5caa-44f3-b6ae-aa4e97947db6', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/3191117572,v1:172.21.15.98:6801/3191117572] [v2:172.21.15.98:6802/3191117572,v1:172.21.15.98:6803/3191117572] exists,up 36930e57-781c-48b6-a499-40cb00df2f38', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/495067980,v1:172.21.15.154:6801/495067980] [v2:172.21.15.154:6802/495067980,v1:172.21.15.154:6803/495067980] exists,up 5a5a5a07-1fcd-4160-a4b1-e8431052e44c'] 2024-09-17T01:54:59.718 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-17T01:54:59.839 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mon.a", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster": "ceph", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "admin_socket_mode": "", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_client_required": "cephx, none", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_cluster_required": "cephx", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_debug": "true", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-17T01:54:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_service_required": "cephx", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_supported": "cephx", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio": "true", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_poll_ms": "250", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_reap_max": "16", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_async_discard": "false", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_block_size": "4096", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio": "false", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-17T01:54:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_inflight_ios": "false", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_enable_discard": "false", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_flock_retry": "3", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_inject_crash": "0", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring": "false", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring_hipri": "false", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-17T01:54:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_type": "", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_alloc_size": "1048576", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_allocator": "hybrid", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_buffered_io": "true", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_for_zeros": "false", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_compact_log_sync": "false", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-17T01:54:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_max_log_runway": "4194304", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_max_prefetch": "1048576", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_min_flush_size": "524288", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_min_log_runway": "1048576", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_replay_recovery": "false", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_sync_write": "false", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_allocation_from_file": "true", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_allocator": "hybrid", 2024-09-17T01:54:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bdev_label_multi": "true", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_create": "true", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_create": "false", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_path": "", 2024-09-17T01:54:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_size": "0", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_path": "", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_preallocate_file": "false", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_size": "107374182400", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_create": "false", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_path": "", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_size": "100663296", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs": "true", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-17T01:54:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_autotune": "true", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size": "0", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-17T01:54:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_type": "2q", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_clone_cow": "true", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_mode": "none", 2024-09-17T01:54:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_csum_type": "crc32c", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_freelist": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-17T01:54:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_small_allocations": "0", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_default_buffered_read": "true", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_default_buffered_write": "false", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-17T01:54:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fail_eio": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mount": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_umount": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-17T01:54:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_ignore_data_csum": "false", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_op_age": "5.000000", 2024-09-17T01:54:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_alloc_size": "0", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size": "0", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_deferred_txc": "32", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size": "0", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_nid_prealloc": "1024", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-17T01:54:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_retry_disk_reads": "3", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_cf": "true", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_mem": "512", 2024-09-17T01:54:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_tracing": "false", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-17T01:54:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_zero_block_detection": "false", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-17T01:54:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_cluster_require_signatures": "false", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_cluster_require_version": "2", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_require_signatures": "false", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_require_version": "2", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_service_require_signatures": "false", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_service_require_version": "2", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_sign_messages": "true", 2024-09-17T01:54:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: "chdir": "", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_acl_type": "", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_asio_thread_count": "2", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_cache_mid": "0.750000", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_cache_size": "16384", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps_release_delay": "5", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_check_pool_perm": "true", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_force_sync_read": "false", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_getattr_caps": "false", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_inject_features": "", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_inject_tick_delay": "0", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-17T01:54:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_die_on_failed_remount": "false", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_dirsize_rbytes": "true", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_force_lazyio": "false", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_fs": "", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_inject_release_failure": "false", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_max_inline_size": "4096", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mds_namespace": "", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": "", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_gid": "-1", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_timeout": "300", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_uid": "-1", 2024-09-17T01:54:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mountpoint": "/", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_notify_timeout": "10", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc": "true", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_dirty": "104857600", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_objects": "1000", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_size": "209715200", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_target_dirty": "8388608", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_permissions": "true", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_quota": "true", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_quota_df": "true", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_max_bytes": "0", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_max_periods": "4", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_min": "131072", 2024-09-17T01:54:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: "client_reconnect_stale": "false", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_shutdown_timeout": "30", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_snapdir": ".snap", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_tick_interval": "1", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_trace": "", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_try_dentry_invalidate": "false", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_use_faked_inos": "false", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "client_use_random_mds": "false", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog": "false", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog_port": "12201", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_monitors": "default=true", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog": "false", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-17T01:54:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog_level": "info", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "-", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_network": "", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_network_interface": "", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_isal": "false", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_level": "5", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_winsize": "-15", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zstd_level": "1", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_alien_op_num_threads": "6", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_stat_interval": "0", 2024-09-17T01:54:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_seastar_cpu_cores": "", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_seastar_num_threads": "0", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location": "", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location_hook": "", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location_hook_timeout": "10", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "daemonize": "false", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "daos_pool": "tank", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_alienstore": "0/5", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_allow_any_pool_priority": "false", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asok": "1/5", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asok_assert_abort": "false", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asserts_on_shutdown": "true", 2024-09-17T01:54:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_auth": "20/20", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bdev": "1/3", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bluefs": "1/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bluestore": "1/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_buffer": "0/1", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_ceph_exporter": "1/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cephfs_mirror": "0/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cephsqlite": "0/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_client": "0/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_compressor": "1/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_context": "0/1", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crimson_interrupt": "0/5", 2024-09-17T01:54:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crush": "1/1", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crypto": "1/5", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cyanstore": "0/5", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_deliberately_leak_memory": "false", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_disable_randomized_ping": "false", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_dpdk": "1/5", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_eventtrace": "1/5", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_filer": "0/1", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_filestore": "1/3", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_finisher": "1/1", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_fuse": "1/5", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_heartbeat_testing_span": "0", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_heartbeatmap": "1/5", 2024-09-17T01:54:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_javaclient": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_journal": "1/3", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_journaler": "0/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_kstore": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_lockdep": "0/1", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mclock": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_balancer": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_locker": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_log": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_log_expire": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_migrator": "1/5", 2024-09-17T01:54:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_quiesce": "3/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_memstore": "1/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mgr": "2/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mgrc": "1/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mon": "20/20", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_monc": "0/10", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_ms": "1/1", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_none": "0/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objclass": "0/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objectcacher": "0/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objecter": "0/1", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_optracker": "0/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_osd": "1/5", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_paxos": "20/20", 2024-09-17T01:54:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_perfcounter": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_prioritycache": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rados": "0/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd": "0/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_mirror": "0/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_pwl": "0/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_replay": "0/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_refs": "0/0", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_reserver": "1/1", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_access": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_datacache": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_dbstore": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_flight": "1/5", 2024-09-17T01:54:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_sync": "1/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rocksdb": "4/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_backref": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_cache": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_cleaner": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_device": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_epm": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_journal": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_lba": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_odata": "0/5", 2024-09-17T01:54:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_omap": "0/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_onode": "0/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_t": "0/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_tm": "0/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_striper": "0/1", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_test": "0/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_throttle": "1/1", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_timer": "0/1", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_tp": "0/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_trace": "1/5", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "device_failure_prediction_mode": "none", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-17T01:54:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_graylog": "false", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_journald": "false", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_stderr": "true", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_syslog": "false", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event_tracing": "false", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_addr": "0.0.0.0", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_http_port": "9926", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_prio_limit": "5", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_sort_metrics": "true", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_stats_period": "5", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "fake_statfs_for_testing": "0", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "fatal_signal_handlers": "true", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "filer_max_purge_ops": "10", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "filer_max_truncate_ops": "128", 2024-09-17T01:54:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_apply_finisher_threads": "1", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_blackhole": "false", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_btrfs_clone_range": "true", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_btrfs_snap": "true", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_caller_concurrency": "10", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_collect_device_partition_information": "true", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_commit_timeout": "600.000000", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_inject_read_err": "false", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_omap_check": "false", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_verify_split": "false", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_dump_file": "", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fadvise": "true", 2024-09-17T01:54:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fail_eio": "true", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fd_cache_shards": "16", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fd_cache_size": "128", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fiemap": "false", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fiemap_threshold": "4096", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_inject_stall": "0", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_parallel": "false", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_trailing": "false", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_writeahead": "false", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_kill_at": "0", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-17T01:54:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs": "0", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size": "0", 2024-09-17T01:54:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_merge_threshold": "-10", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_odsync_write": "false", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_backend": "rocksdb", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_backend_path": "", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_thread_timeout": "60", 2024-09-17T01:54:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_threads": "2", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_punch_hole": "false", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_ops": "50", 2024-09-17T01:54:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_seek_data_hole": "false", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_sloppy_crc": "false", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_splice": "false", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_split_multiple": "2", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_split_rand_factor": "20", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_update_to": "1000", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-17T01:54:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_enable": "true", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_xfs_extsize": "false", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_zfs_snap": "false", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "fio_dir": "/tmp/fio", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:54:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_allow_other": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_atomic_o_trunc": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_big_writes": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_debug": "false", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_default_permissions": "false", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_disable_pagecache": "false", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_max_write": "0", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_multithreaded": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_require_active_mds": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_set_user_groups": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_move": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_read": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_write": "true", 2024-09-17T01:54:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_use_invalidate_cb": "true", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "gss_target_name": "ceph", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_file": "", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_inject_failure": "0", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_interval": "5", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "host": "smithi063", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-17T01:54:59.880 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "inject_early_sigterm": "false", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "jaeger_agent_port": "6799", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "jaeger_tracing_enable": "false", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_aio": "true", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_align_min_size": "65536", 2024-09-17T01:54:59.881 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_block_align": "true", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_block_size": "4096", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_dio": "true", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_discard": "false", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_force_aio": "false", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_ignore_corruption": "false", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_max_write_bytes": "10485760", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_max_write_entries": "100", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_replay_from": "0", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-17T01:54:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_write_header_frequency": "0", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_zero_on_create": "false", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_prefetch_periods": "10", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_prezero_periods": "5", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_write_head_interval": "15", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "keyfile": "", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_backend": "rocksdb", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_default_stripe_size": "65536", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_fsck_on_mount": "false", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-17T01:54:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_max_bytes": "67108864", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_max_ops": "512", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_nid_prealloc": "1024", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_onode_map_size": "1024", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_sync_submit_transaction": "false", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_sync_transaction": "false", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "librados_thread_count": "2", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "lockdep": "false", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "lockdep_force_backtrace": "false", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "log_coarse_timestamps": "true", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-17T01:54:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: "log_flush_on_exit": "false", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_graylog_host": "127.0.0.1", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_graylog_port": "12201", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_max_new": "1000", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_max_recent": "10000", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_stderr_prefix": "", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_stop_at_utilization": "0.970000", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": "true", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_graylog": "false", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_journald": "false", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_stderr": "false", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_syslog": "false", 2024-09-17T01:54:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: "max_rotating_auth_attempts": "10", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_action_on_write_error": "1", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_alternate_name_max": "8192", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_asio_thread_count": "2", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_export_pin": "true", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_dirs": "true", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_interval": "5", 2024-09-17T01:54:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_interval": "10", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_max": "-1", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_max_until": "-1", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_merge_size": "50", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_midchunk": "0.300000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_min_start": "0.200000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_minchunk": "0.001000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_mode": "0", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_need_max": "1.200000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_need_min": "0.800000", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_overload_epochs": "2", 2024-09-17T01:54:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_bits": "3", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_size": "10000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_target_decay": "10.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_grace": "15.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_interval": "4.000000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_mid": "0.700000", 2024-09-17T01:54:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_delay": "0", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_release_free_interval": "10", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_reservation": "0.050000", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_interval": "1", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_threshold": "262144", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-17T01:54:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_prealloc_inos": "1000", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_connect_bootstrapping": "false", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_damage_table_max_entries": "10000", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_auth_pins": "false", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_frag": "false", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_scatterstat": "false", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_subtrees": "false", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_decay_halflife": "5.000000", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_default_dir_hash": "2", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_defer_session_stale": "true", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_deny_all_reconnect": "false", 2024-09-17T01:54:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_keys_per_op": "16384", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_max_commit_size": "10", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_max_entries": "0", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_prefetch": "true", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_on_map": "false", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_early_reply": "true", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_enable_op_tracker": "true", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_enforce_unique_name": "true", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-17T01:54:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_random": "true", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_health_summarize_threshold": "10", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-17T01:54:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_health_dummy": "false", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_migrator_session_race": "false", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_join_fs": "", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_journal_format": "1", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_create_at": "0", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_export_at": "0", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_import_at": "0", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_at": "0", 2024-09-17T01:54:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_expire_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_replay_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_link_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_mdstable_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_openc_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_rename_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_shutdown_at": "0", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_event_large_threshold": "524288", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_events_per_segment": "1024", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_max_events": "-1", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_max_segments": "128", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_pause": "false", 2024-09-17T01:54:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_segment_size": "0", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_trim_threshold": "128", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_warn_factor": "2.000000", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_caps_per_client": "1048576", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_completed_flushes": "100000", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_completed_requests": "100000", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_export_size": "20971520", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_file_recover": "32", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_files": "64", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops": "8192", 2024-09-17T01:54:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_snaps_per_dir": "100", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_metrics_update_interval": "2", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_min_caps_per_client": "100", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_min_caps_working_set": "10000", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_numa_node": "-1", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_complaint_time": "30.000000", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_duration": "600", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_size": "20", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_slow_op_size": "20", 2024-09-17T01:54:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_log_threshold": "5", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_ping_grace": "15", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_ping_interval": "5", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_caps": "30000", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_warning_threshold": "262144", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_replay_interval": "1.000000", 2024-09-17T01:54:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_root_ino_gid": "0", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_root_ino_uid": "0", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-17T01:54:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_shutdown_check": "0", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_skip_ino": "0", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_max_uid": "4294967294", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_min_uid": "0", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_rstat": "false", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_standby_replay_damaged": "false", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_symlink_recovery": "true", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_thrash_exports": "0", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_thrash_fragments": "0", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_tick_interval": "5.000000", 2024-09-17T01:54:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_valgrind_exit": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_verify_backtrace": "1", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_verify_scatter": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_wipe_sessions": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool_debug": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_device_bytes": "1073741824", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_page_set": "false", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_page_size": "65536", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_bytes": "134217728", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_messages": "512", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-17T01:54:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_disabled_modules": "", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_enable_op_tracker": "true", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_max_pg_num_change": "128", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mds_bytes": "134217728", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mds_messages": "128", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mon_bytes": "134217728", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mon_messages": "128", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-17T01:54:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_duration": "600", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_size": "20", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_log_threshold": "5", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_osd_bytes": "536870912", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_osd_messages": "8192", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_pool": "true", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_standby_modules": "true", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_stats_period": "5", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_stats_threshold": "5", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_tick_period": "2", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-17T01:54:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_allow_pool_delete": "true", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_allow_pool_size_one": "true", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_auth_validate_all_caps": "true", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_bytes": "104857600", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_directed_command_retry": "2", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_parallel": "3", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_log_interval": "1.000000", 2024-09-17T01:54:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_ping_interval": "10.000000", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_target_rank": "-1", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_file_level": "debug", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_file": "true", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-17T01:54:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_journald": "false", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_bootstrap": "false", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_start": "false", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_trim": "true", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cpu_threads": "4", 2024-09-17T01:54:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_crush_min_required_version": "hammer", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_daemon_bytes": "419430400", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_avail_crit": "5", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_avail_warn": "5", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_size_warn": "16106127360", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_json": "false", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_transactions": "false", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_extra_checks": "false", 2024-09-17T01:54:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_reef": "false", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_squid": "false", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_down_mkfs_grace": "120", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_down_uptime_grace": "60", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_election_default_strategy": "1", 2024-09-17T01:54:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_election_timeout": "5.000000", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ping_divisor": "2", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_enable_op_tracker": "true", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_fake_pool_delete": "false", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_force_quorum_join": "false", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_globalid_prealloc": "10000", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_detail_to_clog": "false", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_log_update_period": "5", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_max_detail": "50", 2024-09-17T01:54:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog": "true", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog_interval": "600", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_host": "172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791]", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_host_override": "", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_initial_members": "", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease": "5.000000", 2024-09-17T01:54:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_full_interval": "50", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_max": "10000", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_max_summary": "50", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_log_epochs": "500", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_osd": "10000", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_pg_per_osd": "10000", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_pool_pg_num": "65536", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-17T01:54:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_force_trim_to": "0", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_skip_sanity": "false", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_memory_autotune": "true", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_memory_target": "2147483648", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_beacon_grace": "30", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_digest_period": "5", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_inactive_grace": "60", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_min_osdmap_epochs": "500", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_complaint_time": "30", 2024-09-17T01:54:59.911 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_duration": "600", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_size": "20", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_slow_op_size": "20", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_log_threshold": "5", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_in": "false", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_cache_size": "500", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-17T01:54:59.912 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_down_out_interval": "600", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_force_trim_to": "0", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-17T01:54:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_down_reporters": "2", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_report_timeout": "900", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-17T01:54:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_stuck_threshold": "60", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_probe_timeout": "2.000000", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_max_change": "0.050000", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_max_osds": "4", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-17T01:54:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_interval": "86400", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_max_keys": "100", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_timeout": "300", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_session_timeout": "300", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_smart_report_timeout": "5", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stat_smooth_intervals": "6", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_pool_min_size": "2", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_pool_size": "4", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_debug": "false", 2024-09-17T01:54:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_provider_kill_at": "0", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_requester_kill_at": "0", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_timeout": "60.000000", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_target_pg_per_osd": "100", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_tick_interval": "5", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_timecheck_interval": "300.000000", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_use_min_delay_socket": "false", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_older_version_delay": "604800", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-17T01:54:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_misplaced": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_older_version": "true", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-17T01:54:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "monmap": "", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_tracing_enabled": "false", 2024-09-17T01:54:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_op_threads": "3", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_cm": "false", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_device_name": "", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_dscp": "96", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_local_gid": "", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_port_num": "1", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-17T01:54:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_sl": "3", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_support_srq": "true", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_type": "ib", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_reap_threshold": "5", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_before_connect": "false", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_ipv4": "true", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_ipv6": "false", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_msgr1": "true", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_msgr2": "true", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_port_max": "7568", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_port_min": "6800", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_retry_count": "3", 2024-09-17T01:54:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_retry_delay": "5", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_client": "false", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mds": "false", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mgr": "false", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mon": "false", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_osd": "false", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_client_mode": "crc secure", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_cluster_mode": "crc secure", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_cluster_type": "", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_compress_secure": "false", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_connection_idle_timeout": "900", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_connection_ready_timeout": "10", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_crc_data": "true", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_crc_header": "true", 2024-09-17T01:54:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_bad_msg": "false", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_bug": "true", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_old_message": "true", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_skipped_message": "false", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_coremask": "0xF", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_enable_tso": "true", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hugepages": "", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-17T01:54:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_lro": "true", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_memory_channel": "4", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_pmd": "", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_port_id": "0", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dump_on_send": "false", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_initial_backoff": "0.200000", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_max": "1.000000", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_type": "", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-17T01:54:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_network_congestion": "0", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_socket_failures": "0", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_learn_addr_from_peer": "true", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_max_accept_failures": "4", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_max_backoff": "15.000000", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_client_mode": "secure crc", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_service_mode": "secure crc", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compress_min_size": "1024", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compress_mode": "none", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_pq_min_cost": "65536", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_public_type": "", 2024-09-17T01:54:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_service_mode": "crc secure", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_listen_backlog": "512", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_nodelay": "true", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_rcvbuf": "0", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_type": "async+posix", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "no_config_file": "false", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_completion_locks_per_session": "32", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inflight_ops": "1024", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-17T01:54:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_tick_interval": "5.000000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_timeout": "10.000000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "objectstore_blackhole": "false", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "openssl_engine_opts": "", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_delay_time": "5.000000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_hist_halflife": "1000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_max_low_ops": "2", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_max_ops": "4", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_slop": "0.020000", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-17T01:54:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_asio_thread_count": "2", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_async_recovery_min_cost": "100", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_scan_max": "512", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_scan_min": "64", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_degraded": "false", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_peering": "false", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_unfound": "true", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_beacon_report_interval": "300", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_duration": "30", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_max_block_size": "67108864", 2024-09-17T01:54:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_blkin_trace_all": "false", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_check_for_log_corruption": "false", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_update_on_start": "true", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_message_cap": "256", 2024-09-17T01:54:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_message_size_cap": "524288000", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_op_priority": "63", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_watch_timeout": "30", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_command_max_records": "256", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_compact_on_start": "false", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_update_on_start": "true", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_update_weight_set": "true", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-17T01:54:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_feed_pullee": "-1", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_misdirected_ops": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_no_acting_change": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_no_purge_strays": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_op_order": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-17T01:54:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_shutdown": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_trim_objects": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_snaps": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_keys": "1024", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_stride": "524288", 2024-09-17T01:54:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_default_notify_timeout": "30", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep": "0.000000", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_discard_disconnected_ops": "true", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_enable_op_tracker": "true", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-17T01:54:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_info": "true", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown": "true", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_function_tracing": "false", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_grace": "20", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_interval": "6", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_peers": "10", 2024-09-17T01:54:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_size": "2000", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_stale": "600", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_max_size": "100000", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_min_size": "1000", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal_size": "5120", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_kill_backfill_at": "0", 2024-09-17T01:54:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_cache_size": "50", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_dedup": "true", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_message_max": "40", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_share_max_epochs": "40", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_attr_name_len": "100", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_attr_size": "0", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_backfills": "1", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_markdown_count": "5", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_markdown_period": "600", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_name_len": "2048", 2024-09-17T01:54:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_namespace_len": "256", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_size": "134217728", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_blocked_by": "16", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_log_entries": "10000", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pgls": "1024", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_push_cost": "8388608", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_push_objects": "10", 2024-09-17T01:54:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_scrubs": "3", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_trimming_pgs": "2", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_write_op_reply_len": "64", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_write_size": "90", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-17T01:54:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_profile": "balanced", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_base": "805306368", 2024-09-17T01:54:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_cache_min": "134217728", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target": "4294967296", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target_autotune": "false", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_min_pg_log_entries": "250", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_min_recovery_priority": "0", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_report_interval": "5", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-17T01:54:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_num_cache_shards": "32", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_num_op_tracker_shard": "32", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_auto_affinity": "true", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_node": "-1", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_prefer_iface": "true", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objecter_finishers": "1", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore": "bluestore", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore_fuse": "false", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore_tracing": "false", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_complaint_time": "30.000000", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_duration": "600", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_size": "20", 2024-09-17T01:54:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_slow_op_size": "20", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_log_threshold": "5", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards": "0", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards_hdd": "5", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards_ssd": "8", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_pq_min_cost": "65536", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_queue_cut_off": "high", 2024-09-17T01:54:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_thread_timeout": "15", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_open_classes_on_start": "true", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_os_flags": "0", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_peering_op_priority": "255", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_delete_cost": "1048576", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_delete_priority": "5", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_trim_max": "10000", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_trim_min": "100", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-17T01:54:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_crimson": "false", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-17T01:54:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flags": "0", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_min_size": "0", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pg_num": "32", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pgp_num": "0", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_read_ratio": "70", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_size": "2", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_type": "replicated", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_push_per_object_cost": "1000", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-17T01:54:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recover_clone_overlap": "true", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_cost": "20971520", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active": "0", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_single_start": "1", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_op_priority": "3", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_priority": "5", 2024-09-17T01:54:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep": "0.000000", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_repair_during_recovery": "false", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_requested_scrub_priority": "120", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_auto_repair": "false", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_begin_hour": "0", 2024-09-17T01:54:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_begin_week_day": "0", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_chunk_max": "25", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_chunk_min": "5", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_cost": "52428800", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_during_recovery": "false", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_end_hour": "0", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_end_week_day": "0", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_event_cost": "4096", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_invalid_stats": "true", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-17T01:54:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_max_preemptions": "5", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_priority": "5", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_sleep": "0.000000", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_skip_data_digest": "false", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_smart_report_timeout": "5", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_cost": "1048576", 2024-09-17T01:54:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_priority": "5", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_target_transaction_size": "30", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-17T01:54:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tracing": "false", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_use_stale_snap": "false", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "osdc_blkin_trace_all": "false", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_kill_at": "0", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_max_join_drift": "10", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_min": "500", 2024-09-17T01:54:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_min_wait": "0.050000", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_propose_interval": "1.000000", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_max": "500", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_min": "250", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_stash_full_interval": "25", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_trim_max": "500", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_trim_min": "250", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "perf": "true", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-17T01:54:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "-", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrv": "", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "public_bind_addr": "-", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "public_network": "", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "public_network_interface": "", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_busy_polling": "false", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_enabled": "false", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_session_max_number": "256", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_mon_op_timeout": "0", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_osd_op_timeout": "0", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_tracing": "false", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_atime_update_interval": "60", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-17T01:54:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_balance_parent_reads": "false", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_balance_snap_reads": "false", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blkin_trace_all": "false", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache": "true", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_policy": "writearound", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_size": "33554432", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-17T01:54:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_clone_copy_on_read": "false", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_compression_hint": "none", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_concurrent_management_ops": "10", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_clone_format": "auto", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_data_pool": "", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_features": "61", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_format": "2", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_map_options": "", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_order": "22", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_pool": "rbd", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_stripe_count": "0", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_stripe_unit": "0", 2024-09-17T01:54:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_enable_alloc_hint": "true", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_io_scheduler": "simple", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-17T01:54:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_order": "24", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_pool": "", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_splay_width": "4", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_localize_parent_reads": "false", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_localize_snap_reads": "false", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-17T01:54:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-17T01:54:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mtime_update_interval": "60", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_non_blocking_aio": "true", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_op_thread_timeout": "60", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_op_threads": "1", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_parent_cache_enabled": "false", 2024-09-17T01:54:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_plugins": "", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_burst": "0", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_limit": "0", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_exclude_ops": "0", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_burst": "0", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_limit": "0", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-17T01:54:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-17T01:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_read_from_replica_policy": "default", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_skip_partial_discard": "true", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_tracing": "false", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_validate_names": "true", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_validate_pool": "true", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "restapi_base_url": "", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "restapi_log_level": "", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-17T01:54:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_acl_grants_max_num": "100", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_admin_entry": "admin", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_backend_store": "rados", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_barbican_url": "", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_beast_enable_async": "true", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_counters_cache": "false", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-17T01:54:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_enabled": "true", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_expiry_interval": "900", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_lru_size": "25000", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_config_store": "rados", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_content_length_compat": "false", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_copy_obj_progress": "true", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cors_rules_max_num": "100", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cross_domain_policy": "", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_addr": "", 2024-09-17T01:54:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_password": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_username": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_require_ssl": "true", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-17T01:54:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-17T01:54:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_addr": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_auth": "token", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_namespace": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_prefix": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_token_file": "", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_buffersize": "524288", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_low_speed_time": "300", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-17T01:54:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d4n_port": "6379", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_changes_size": "1000", 2024-09-17T01:54:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_num_shards": "128", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_window": "30", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-17T01:54:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-17T01:54:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dns_name": "", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dns_s3website_name": "", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dynamic_resharding": "true", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_gc_threads": "true", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_lc_threads": "true", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_ops_log": "false", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_quota_threads": "true", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_static_website": "false", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_usage_log": "false", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enforce_swift_acls": "true", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_exit_timeout_secs": "120", 2024-09-17T01:54:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_expose_bucket": "false", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_extended_http_attrs": "", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_filter": "none", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_frontends": "beast port=7480", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_deferred": "50", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_objs": "32", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_processor_period": "3600", 2024-09-17T01:54:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_init_timeout": "300", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_connection_idle": "300", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-17T01:54:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_domain": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_password": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_password_path": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_project": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_tenant": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_token": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_token_path": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_user": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_api_version": "2", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_domain": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_password": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_project": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-17T01:54:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_user": "", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_url": "", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-17T01:54:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_debug_interval": "-1", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_lock_max_time": "90", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_objs": "32", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_rules": "1000", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_worker": "3", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_thread_delay": "0", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_dnattr": "uid", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_searchfilter": "", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_uri": "", 2024-09-17T01:54:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_http_headers": "", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_object_name_utc": "false", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attr_name_len": "0", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attr_size": "0", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-17T01:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_chunk_size": "4194304", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_listing_results": "1000", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_notify_retries": "10", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_put_param_size": "1048576", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_put_size": "5368709120", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_slo_entries": "1000", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_md_log_max_shards": "64", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-17T01:54:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_mp_lock_max_time": "600", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_max_gc": "300", 2024-09-17T01:54:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_num_async_rados_threads": "32", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_num_control_oids": "8", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_numa_node": "-1", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-17T01:54:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_chunk_size": "100", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_gc_interval": "600", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_thread_timeout": "600", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_tracing": "false", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_token": "", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_url": "", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_verify_ssl": "true", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_rados": "false", 2024-09-17T01:54:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_socket_path": "", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_push_interval": "2.000000", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_lanes": "3", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_partitions": "3", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-17T01:54:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_print_continue": "true", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_tracing": "false", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm": "", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm_id": "", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_region": "", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-17T01:54:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_request_uri": "", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_batch_size": "64", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_max_aio": "128", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_num_logs": "16", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_thread_interval": "600", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_resolve_cname": "false", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_run_sync_thread": "true", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-17T01:54:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_scheduler_type": "throttler", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_script_uri": "", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_service_provider_name": "", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_client_id": "", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_client_secret": "", 2024-09-17T01:54:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_entry": "sts", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_key": "sts", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_min_session_duration": "900", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_token_introspection_url": "", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_account_in_url": "false", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_auth_entry": "auth", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_auth_url": "", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_custom_header": "", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_need_stats": "true", 2024-09-17T01:54:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_tenant_name": "", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_token_expiration": "86400", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_url": "", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_url_prefix": "swift", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_lease_period": "120", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-17T01:54:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_thread_pool_size": "512", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_comment": "", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_createby": "", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_encoding": "", 2024-09-17T01:54:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_flag": "false", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_origin": "", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_tracker": "", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_trust_forwarded_https": "false", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_max_shards": "32", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_max_user_shards": "1", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_use_opa_authz": "false", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_counters_cache": "false", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-17T01:54:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_max_buckets": "1000", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_policies_max_num": "100", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_unique_email": "true", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_verify_ssl": "true", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone": "", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone_id": "", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup": "", 2024-09-17T01:54:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup_id": "", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rgwlc_auto_session_clear": "true", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_block_size": "4096", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_size": "536870912", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-17T01:54:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_index_type": "binary_search", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_partition_filters": "false", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_perf": "false", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-17T01:54:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: "run_dir": "/var/run/ceph", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_block_create": "true", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_cache_lru_size": "67108864", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_default_max_object_size": "16777216", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_device_size": "53687091200", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_full_integrity_check": "false", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_capacity": "16", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-17T01:54:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_main_device_type": "SSD", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_segment_size": "67108864", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "set_keepcaps": "false", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "setgroup": "", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "setuser": "", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "setuser_match_path": "", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-17T01:54:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: "thp": "false", 2024-09-17T01:54:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: "threadpool_default_timeout": "60", 2024-09-17T01:54:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-17T01:54:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: "throttler_perf_counter": "true" 2024-09-17T01:54:59.995 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:55:00.000 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-17T01:55:00.138 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a: {} 2024-09-17T01:55:00.138 INFO:teuthology.orchestra.run.smithi063.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T01:55:00.147 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b: {} 2024-09-17T01:55:00.147 INFO:teuthology.orchestra.run.smithi063.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T01:55:00.156 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c: {} 2024-09-17T01:55:00.156 INFO:teuthology.orchestra.run.smithi063.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T01:55:00.173 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-17T01:55:00.174 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T01:55:00.209 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T01:55:00.209 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-17T01:55:00.209 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T01:55:00.209 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:55:00.210 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:00.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:00.210 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T01:55:00.210 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-17T01:55:00.210 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:00.211 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:00.211 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-17T01:55:00.211 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T01:55:00.211 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T01:55:00.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-17T01:55:00.211 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-17T01:55:00.212 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-17T01:55:00.212 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:00.213 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-17T01:55:00.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:00.213 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-17T01:55:00.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:55:00.215 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:00.211+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:00.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:00.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-17T01:55:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-17T01:55:00.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:55:00.275 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T01:55:00.275 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:55:00.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:55:00.314 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:00.311+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:00.340 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:00.341 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:00.341 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:00.341 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:00.341 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:00.342 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T01:55:00.342 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:00.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:00.366 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:00.388 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:00.408 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:00.409 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:00.415 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:00.421+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:00.516 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:00.521+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:00.521 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:00.521 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:00.536 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:00.617 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:00.625+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:00.647 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:55:00.654 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:55:00.658 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:00.658 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:55:00.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:55:00.672 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:55:00.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:00.672 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-17T01:55:00.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:00.679 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:55:00.679 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:55:00.679 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:55:00.679 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:55:00.679 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-17T01:55:00.679 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42502sec preferred_lft 42502sec 2024-09-17T01:55:00.680 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-09-17T01:55:00.681 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:55:00.681 INFO:teuthology.orchestra.run.smithi063.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T01:55:00.681 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:42:06:28:65:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:55:00.681 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T01:55:00.681 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:55:00.681 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:55:00.681 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:55:00.681 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T01:55:00.682 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:55:00.682 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-17T01:55:00.682 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-17T01:55:00.682 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:55:00.682 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T01:55:00.721 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:00.719+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:00.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:55:00.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:55:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:00.802 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:55:00.805 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:00.805 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:00.819 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:00.826+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:00.820 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:00.854 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-17T01:55:00.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:00.855 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-17T01:55:00.920 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:00.926+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:00.992 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:00.992 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:01.021 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:01.026+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:01.122 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:01.119+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T01:55:01.125 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T01:55:01.126 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T01:55:01.126 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:55:01.126 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:55:01.126 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T01:55:01.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:55:01.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:55:01.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:55:01.126 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T01:55:01.129 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:01.129 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:55:01.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:55:01.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:01.212 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T01:55:01.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:01.218 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-17T01:55:01.223 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:01.230+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:01.267 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:55:01.267 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T01:55:01.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:01.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T01:55:01.267 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T01:55:01.276 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:01.276 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:01.338 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:01.345+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:01.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:55:01.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:55:01.387 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T01:55:01.388 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T01:55:01.413 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:01.413 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.428 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:01.430+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:01.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:55:01.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:01.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:55:01.480 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:55:01.481 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T01:55:01.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-17T01:55:01.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:55:01.481 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T01:55:01.526 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:01.523+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:01.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:55:01.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:55:01.578 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T01:55:01.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:55:01.578 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:01.598 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:01.598 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.614 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:01.626 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:55:01.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:55:01.626 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:01.658 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:01.666+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:01.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-17T01:55:01.727 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:01.734+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:01.736 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:55:01.747 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:01.747 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.763 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-17T01:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-17T01:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-17T01:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-17T01:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-17T01:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-17T01:55:01.785 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:01.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:01.787 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-17T01:55:01.827 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:01.833+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:01.831 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:55:01.831 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T01:55:01.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-17T01:55:01.890 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:55:01.927 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:01.927 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:01.928 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:01.934+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:01.939 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-17T01:55:01.939 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-17T01:55:01.939 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-17T01:55:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:01.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:01.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:01.943 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-17T01:55:01.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2024-09-17T01:55:01.977+0000 7f7cf8f11580 -1 init, newargv = 0x55c23bf16ae0 newargc=15 2024-09-17T01:55:01.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[23719]: starting ceph client 2024-09-17T01:55:01.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[23719]: starting fuse 2024-09-17T01:55:02.029 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:02.037+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:02.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:02.130 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:02.138+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:02.231 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:02.238+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:02.254 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:02.254 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:02.268 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:02.333 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:02.337+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:02.390 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:02.390 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:02.405 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:02.427 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:02.434 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:02.442+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:02.525 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:02.526 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:02.534 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:02.531+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:02.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:02.590 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:02.590 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:02.607 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:02.626 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:02.627 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:02.635 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:02.641+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:02.672 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:02.672 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:02.672 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:02.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:55:02.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:02.736 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:02.741+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:02.837 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:02.841+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:02.858 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:02.858 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:02.858 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:02.858 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:02.859 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:02.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:02.962 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:02.969+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:03.038 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:03.039+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.041 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.767186806000002, 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:03.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:03.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.767148187, 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.048 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:03.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:03.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.767110599999999, 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.054 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:03.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:03.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.766959081, 2024-09-17T01:55:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:03.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.766922762, 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.066 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:03.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:03.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.595772155999999, 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:03.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:03.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.595706409999998, 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:03.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:03.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:03.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.595586731000001, 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.595549461000001, 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.090 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.595486737999998, 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-17T01:55:03.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:03.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:03.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:03.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.595369842, 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.104 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:03.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:03.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:03.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.255467753000001, 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.110 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:03.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.255314950999999, 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.116 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:03.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.255093005999999, 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:03.122 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:03.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.255017543000001, 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.254935197000002, 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:03.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.139 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.254648413000002, 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:03.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.254558815999999, 2024-09-17T01:55:03.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:03.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:03.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:03.151 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.254446284, 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:03.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:03.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.254189319000002, 2024-09-17T01:55:03.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:03.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:03.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:03.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:03.163 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:03.164 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:03.166 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:55:03.166 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:03.163+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:03.222 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-17T01:55:03.222 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-17T01:55:03.223 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run.smithi063.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:03.225 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-17T01:55:03.266 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:03.273+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:03.271 INFO:teuthology.orchestra.run.smithi063.stdout:45 2024-09-17T01:55:03.271 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> import glob 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> import re 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> import os 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> import subprocess 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-17T01:55:03.271 DEBUG:teuthology.orchestra.run.smithi063:> def _find_admin_socket(client_name): 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> return files[0] 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-17T01:55:03.272 DEBUG:teuthology.orchestra.run.smithi063:> for f in files: 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> contents = proc_f.read() 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> if mountpoint in contents: 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> return f 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> print(_find_admin_socket("client.0")) 2024-09-17T01:55:03.273 DEBUG:teuthology.orchestra.run.smithi063:> ' 2024-09-17T01:55:03.295 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:03.295 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:03.295 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:03.295 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:03.309 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:03.367 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:03.374+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:03.398 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.23719.asok 2024-09-17T01:55:03.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T01:55:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:55:03.410 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.23719.asok 2024-09-17T01:55:03.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:03.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.23719.asok status 2024-09-17T01:55:03.427 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:03.427 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:03.427 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:03.427 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:03.427 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:03.440 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:03.468 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:03.463+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:03.570 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:03.578+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "c2ddf9721ef254645201cdbabd9c8f49c30a586f", 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "23719", 2024-09-17T01:55:03.571 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4468, 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4468 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:55:03.572 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3923785698 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3923785698 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4468 192.168.0.1:0/3923785698", 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/3923785698", 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 6, 2024-09-17T01:55:03.573 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 21, 2024-09-17T01:55:03.574 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:55:03.574 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklisted": false, 2024-09-17T01:55:03.574 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs" 2024-09-17T01:55:03.574 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:55:03.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:03.586 DEBUG:teuthology.orchestra.run.smithi063:> stat --file-system '--printf=%T 2024-09-17T01:55:03.586 DEBUG:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.592 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2024-09-17T01:55:03.593 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:55:03.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.581947452000001, 2024-09-17T01:55:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:03.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:03.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:03.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.569862165, 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:03.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:03.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:03.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:03.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.615 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:03.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:03.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.558996081, 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:03.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.400227138999998, 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.621 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:03.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:03.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:03.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:03.627 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.400127373, 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:03.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.400083577, 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.633 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:03.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.638 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.400005661000002, 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.639 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:03.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.399923794999999, 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.645 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:03.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:03.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.399873045, 2024-09-17T01:55:03.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:03.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:03.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:03.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.399812238999999, 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.657 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:03.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.399722306000001, 2024-09-17T01:55:03.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:03.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:03.665 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.39966265, 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:03.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:03.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:03.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.398151217999999, 2024-09-17T01:55:03.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:03.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:03.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:03.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.397244642, 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:03.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.677 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.397099600000001, 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:03.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:03.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.395337260000002, 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.682 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:03.686 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.395228608, 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:03.690 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e18/16 ondisk, result = 0)", 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.392018830000001, 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00060859499999999997, 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8400000000000005e-07 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218422+0000", 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4460000000000001e-06 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218433+0000", 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0214000000000001e-05 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218482+0000", 2024-09-17T01:55:03.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.9332999999999997e-05 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218847+0000", 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036495000000000001 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218857+0000", 2024-09-17T01:55:03.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0407e-05 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219027+0000", 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016976099999999999 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.218648+0000", 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.391789738, 2024-09-17T01:55:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00058786899999999998, 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218648+0000", 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218648+0000", 2024-09-17T01:55:03.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218649+0000", 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1930000000000001e-06 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218655+0000", 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.913e-06 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218671+0000", 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6354e-05 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218679+0000", 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2660000000000001e-06 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219096+0000", 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00041644400000000003 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219235+0000", 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013969899999999999 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:03.699 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 16.400866819000001, 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:03.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:03.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.705 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:03.705 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:03.705 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:03.707 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:55:03.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:03.709 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:03.713+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:03.717 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T01:55:03.731 INFO:tasks.workunit:Pulling workunits from ref e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:55:03.731 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T01:55:03.731 INFO:tasks.workunit:timeout=3h 2024-09-17T01:55:03.731 INFO:tasks.workunit:cleanup=True 2024-09-17T01:55:03.732 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-17 01:54:45.197839647 +0000 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-17 01:55:03.716844933 +0000 2024-09-17T01:55:03.763 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-09-17T01:55:03.763 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T01:55:03.764 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T01:55:03.807 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:03.813+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:03.834 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:55:03.841 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:03.841 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:03.841 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:03.855 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:03.880 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T01:55:03.908 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:03.913+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:03.980 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:03.980 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:03.994 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:04.041 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:04.039+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:04.110 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:04.118+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:04.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.022931411999998, 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:04.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.667025709000001, 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.127 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.497362136, 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:04.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.496564929000002, 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:04.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:04.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.496007605999999, 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:04.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:04.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:04.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:04.141 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.495465629999998, 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:04.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.494472425000001, 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:04.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.493912008999999, 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:04.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:04.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.493430436000001, 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:04.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.323527237, 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:04.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:04.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:04.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.322456839000001, 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:04.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.168 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.318648362000001, 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:04.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.912230693000001, 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:04.173 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:04.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:04.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.912126688000001, 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:04.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:04.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:04.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:04.183 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.912025628999999, 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:04.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.911918516, 2024-09-17T01:55:04.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:04.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.911855450000001, 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.911797066999998, 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:04.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.911729310999998, 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:04.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:04.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:04.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.911663381, 2024-09-17T01:55:04.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:04.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:04.215 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:04.216 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:04.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:04.218 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:04.222+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:04.318 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:04.325+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:04.348 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:04.348 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:04.348 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:04.348 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:04.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:04.418 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:04.426+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:04.520 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:04.526+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:04.526 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:04.527 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:04.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:04.620 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:04.625+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:04.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:04.663 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.392376000999999, 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:04.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:04.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.392337382000001, 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:04.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:04.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.392299795, 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:04.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.681 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.392148276, 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:04.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:04.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.392111957000001, 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.688 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.220961351, 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.694 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:04.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:04.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.220895604999999, 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:04.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:04.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.220775926000002, 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.711 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.220738656000002, 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:04.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.718 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.220675932999999, 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:04.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:04.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:04.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.220559037000001, 2024-09-17T01:55:04.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:04.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:04.732 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.880656947999999, 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:04.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:04.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.880504146, 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:04.738 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:04.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.880282201, 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.880206737999998, 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.750 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:04.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:04.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.756 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.880124391999999, 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:04.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.762 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.879837607999999, 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:04.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:04.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:04.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:04.768 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.879748011, 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:04.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:04.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:04.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.879635479000001, 2024-09-17T01:55:04.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:04.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:04.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:04.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.879378513999999, 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:04.780 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:04.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:04.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:04.786 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:04.787 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:04.787 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:04.719+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:04.797 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:04.798 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:04.818 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:04.818 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:04.822 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:04.819+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:04.842 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:04.920 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:04.921 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:04.923 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:04.929+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:04.931 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:05.024 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:05.030+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:05.053 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:05.054 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:05.068 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:05.125 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:05.123+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:05.226 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:05.223+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:05.236 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:05.236 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:05.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:05.329 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:05.327+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:05.360 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:05.360 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:05.360 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-17T01:55:05.360 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T01:55:05.360 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T01:55:05.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-17T01:55:05.385 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:05.385 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:05.398 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:05.430 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:05.437+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:05.487 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:05.488 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "" 2024-09-17T01:55:05.488 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:05.533 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:05.541+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:05.563 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:05.563 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:05.577 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:05.634 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:05.642+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:05.695 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:05.696 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:05.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:55:05.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:05.737 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:05.735+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:05.837 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:05.845+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:05.842 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:05.843 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:05.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:05.940 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:05.935+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:06.023 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.023 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:06.041 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:06.046+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:06.144 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:06.149+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:06.157 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.157 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.171 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:06.243 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:06.249+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:06.302 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.302 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:06.345 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:06.349+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:06.436 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.437 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.446 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:06.453+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:06.452 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:06.546 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:06.547+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:06.571 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.571 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.585 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:06.647 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:06.643+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:06.683 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:55:06.717 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.717 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:06.773 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:06.771+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:06.849 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:06.847+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:06.862 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:06.889 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:06.889 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:06.903 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:06.993 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:06.991+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:07.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:07.025 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:07.044 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:07.045 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:07.051 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:07.058+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:07.068 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:07.069 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.978308691000002, 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.622402987999997, 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.452739415000003, 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.451942207999998, 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.451384885000003, 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.450842909000002, 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.449849704000002, 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.449289288000003, 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.448807715000001, 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.278904515999997, 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.277834118000001, 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.274025641000001, 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867607971999998, 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867503967000001, 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867402907999999, 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867295795, 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867232729000001, 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867174345999999, 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867106589999999, 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.867040660000001, 2024-09-17T01:55:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:07.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:07.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:07.172 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:07.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:07.175 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:07.171+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:07.275 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:07.282+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:07.306 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:07.306 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:07.306 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:07.306 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:07.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:07.375 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:07.371+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:07.443 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:07.444 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:07.444 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:07.444 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:07.444 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:07.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:07.476 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:07.475+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:07.577 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:07.575+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.312082375000003, 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:07.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:07.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:07.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.312043756000001, 2024-09-17T01:55:07.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:07.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.601 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.312006169, 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:07.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:07.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.311854650000001, 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:07.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:07.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.614 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.311818330999998, 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.615 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:07.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.140667725, 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:07.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:07.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.140601979000003, 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.628 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:07.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.140482300000002, 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:07.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:07.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.140445030000002, 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:07.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:07.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:07.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.646 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.140382307000003, 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:07.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.140265411000001, 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:07.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:07.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.800363322000003, 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.659 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:07.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:07.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:07.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:07.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:07.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:07.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:07.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:07.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:07.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:07.667 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.80021052, 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:07.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799988575, 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.674 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:07.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:07.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799913111999999, 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:07.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.685 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799830765999999, 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:07.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:07.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799543982000003, 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:07.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799454384999997, 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:07.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:07.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:07.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799341853000001, 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:07.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:07.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:07.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.799084888000003, 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:07.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:07.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:07.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:07.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:07.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:07.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:07.717 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:07.719 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:07.719 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:07.715+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:07.820 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:07.826+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:07.850 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:07.851 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:07.851 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:07.851 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:07.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:07.950 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:07.958+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:08.022 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:08.030+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:08.026 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:08.026 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:08.026 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:08.026 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:08.026 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:08.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:08.130 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:08.138+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:08.208 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:08.208 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.185347580999998, 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:08.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:08.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.173262294000001, 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.214 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:08.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:08.218 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 26.162396210000001, 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:08.224 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003627267999999, 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:08.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:08.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:08.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003527502000001, 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:08.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.236 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003483706000001, 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:08.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003405789999999, 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.242 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:08.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:08.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003323924, 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:08.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:08.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:08.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:08.254 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003273174, 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:08.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:08.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:08.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:08.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003212368, 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.261 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:08.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003122435000002, 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:08.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:08.270 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.003062779, 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:08.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:08.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:08.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:08.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:08.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:08.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:08.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.276 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.277 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:08.277 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:08.277 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.001551346999999, 2024-09-17T01:55:08.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:08.278 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.278 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.278 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:08.278 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:08.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:08.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:08.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:08.283 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.000644771000001, 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:08.288 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.000499729000001, 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:08.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:08.293 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.998737388999999, 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:08.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:08.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:08.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:08.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:08.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:08.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.299 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.998628737000001, 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:08.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop_reply(mds.0.3:20 3.1f e18/16 ondisk, result = 0)", 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.995418958999998, 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00060859499999999997, 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218419+0000", 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8400000000000005e-07 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218422+0000", 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4460000000000001e-06 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218433+0000", 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0214000000000001e-05 2024-09-17T01:55:08.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218482+0000", 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.9332999999999997e-05 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218847+0000", 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036495000000000001 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218857+0000", 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0407e-05 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219027+0000", 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016976099999999999 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.004266948000001, 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:08.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:08.315 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.0020984180000001, 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:08.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:08.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:08.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:08.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:08.322 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:08.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:08.324 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:08.329+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:08.425 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:08.429+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:08.454 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:08.454 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:08.454 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:08.468 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:08.526 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:08.533+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:08.589 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:08.589 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:08.590 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:08.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:08.627 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:08.634+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:08.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:55:08.728 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.634118137000002, 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.278212433999997, 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.108548861000003, 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.107751653999998, 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.107194331000002, 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.106652355000001, 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:08.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:08.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:08.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:08.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:08.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.761 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:08.761 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:08.761 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.105659150000001, 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:08.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:08.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:08.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:08.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:08.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:08.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:08.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:08.768 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.105098734000002, 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:08.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:08.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:08.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:08.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:08.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:08.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:08.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:08.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.104617161, 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:08.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:08.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:08.781 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.934713962000004, 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:08.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:08.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:08.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:08.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.933643564, 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.789 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:08.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:08.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:08.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.929835087000001, 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.795 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:08.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:08.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:08.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.523417418000001, 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:08.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:08.806 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.523313413, 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:08.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:08.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:08.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:08.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:08.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.523212354000002, 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:08.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:08.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:08.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.819 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.523105241, 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:08.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:08.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.523042175, 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:08.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.832 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.522983792000002, 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:08.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.838 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.522916036000002, 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:08.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.522850106, 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:08.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:08.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.849 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:08.849 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:08.849 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:08.850 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:08.734+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:08.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:08.851 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:08.847+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:08.951 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:08.958+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:08.981 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:08.982 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:08.995 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:09.052 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:09.058+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:09.119 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:09.119 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:09.119 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:09.120 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:09.120 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:09.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:09.175 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:09.177 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:09.185+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:09.255 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:09.251+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:09.256 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:09.256 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:09.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:09.256 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.984765881999998, 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.257 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:09.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.262 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.984727263000003, 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.263 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:09.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:09.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.984689676000002, 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.984538157000003, 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.984501838, 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.813351232000002, 2024-09-17T01:55:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.813285485999998, 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.813165806999997, 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.813128536999997, 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:09.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.813065813999998, 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:09.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.812948918000004, 2024-09-17T01:55:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.473046828999998, 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472894027000002, 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472672082000003, 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472596619000001, 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472514273000002, 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472227488999998, 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472137891999999, 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.472025360000004, 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.471768394999998, 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:09.378 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:09.379 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:09.380 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:09.380 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:09.381 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:09.381 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:09.382 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:09.382 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:09.382 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:09.386+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:09.481 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:09.479+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:09.512 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:09.512 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:09.528 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:09.581 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:09.586+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:09.651 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:09.651 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:09.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:09.681 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:55:09.682 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:09.689+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:09.783 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:09.783+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:09.828 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:09.828 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:09.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:09.884 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:09.889+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:09.974 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:09.974 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:09.984 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:09.990+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:09.988 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:10.086 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:10.089+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:10.109 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.109 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:10.186 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:10.183+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:10.244 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.245 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:10.287 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:10.294+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:10.388 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:10.383+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:10.392 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.392 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:10.488 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:10.487+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:10.502 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:10.502 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:10.502 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T01:55:10.502 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-09-17T01:55:10.502 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T01:55:10.526 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.527 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:10.589 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:10.593+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:10.665 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.666 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:10.730 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:10.738+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:10.790 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:10.798+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:10.910 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:10.918+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:10.989 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:10.989 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:10.992 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:10.997+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:11.004 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:11.093 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:11.091+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:11.163 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:11.163 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:11.177 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:11.225 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:11.223+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:11.294 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:11.302+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:11.308 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:11.309 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:11.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:11.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:11.395 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:11.402+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:11.485 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:11.486 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:11.495 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:11.501+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:11.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:11.551 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:11.551 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:11.569 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:11.593 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:11.593 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:11.593 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:11.596 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:11.602+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.524441373999998, 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.168535671000001, 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.998872098, 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.998074891000002, 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.997517567999999, 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.996975591999998, 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.995982386999998, 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.995421970999999, 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.994940397999997, 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.825037199, 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.823966800999997, 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.820158323999998, 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413740655000002, 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413636650000001, 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413535590999999, 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413428478, 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:11.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:11.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.696 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413365412000001, 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:11.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:11.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413307028999998, 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:11.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:11.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:11.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413239272999999, 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:11.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:11.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.413173343, 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:11.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:11.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:11.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:11.717 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:11.718 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:55:11.719 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T01:55:11.719 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:11.726+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:11.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:11.820 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:11.825+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:11.854 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:11.854 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:11.854 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:11.854 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:11.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:11.920 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:11.926+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:12.022 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:12.030+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:12.034 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:12.035 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:12.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:12.122 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:12.119+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:12.183 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.909567985000002, 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.909529366000001, 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.909491779, 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.90934026, 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.909303940999997, 2024-09-17T01:55:12.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:12.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:12.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.738153335, 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:12.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:12.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.738087589000003, 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:12.226 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:12.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.737967910000002, 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:12.233 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:12.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:12.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.737930640000002, 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.240 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:12.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:12.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.737867917000003, 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:12.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:12.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.253 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.737751021000001, 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:12.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:12.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:12.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.397848932000002, 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.39769613, 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.397474185, 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.275 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:12.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.397398721999998, 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:12.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:12.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:12.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.288 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.397316375999999, 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.289 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:12.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:12.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.295 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.397029592000003, 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.296 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:12.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.396939994999997, 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.303 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:12.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:12.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.396827463000001, 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:12.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:12.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.396570498000003, 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:12.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:12.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:12.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:12.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:12.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:12.323 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:12.324 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:12.325 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:12.326 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:12.330+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:12.426 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:12.434+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:12.457 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:12.458 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:12.458 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:12.458 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:12.472 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:12.527 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:12.533+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:12.628 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:12.627+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:12.637 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:12.637 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:12.638 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:12.638 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:12.638 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:12.652 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:55:12.729 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:12.734+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:12.773 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:12.773 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:12.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:12.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.749688519000003, 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:12.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.778 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.737603232000001, 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.779 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:12.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:12.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.783 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.726737148000002, 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:12.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567968206, 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.789 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567868440000002, 2024-09-17T01:55:12.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:12.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:12.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567824644000002, 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.802 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:12.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567746727999999, 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.808 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:12.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.813 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567664862000001, 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:12.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:12.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:12.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:12.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567614112000001, 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.820 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:12.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:12.825 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567553306000001, 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:12.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:12.830 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567463372999999, 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:12.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:12.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.834 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.567403717000001, 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:12.835 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.839 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.565892285, 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:12.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:12.843 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.564985708999998, 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.844 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:12.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:12.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.848 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.564840666999999, 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.849 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:12.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.563078326999999, 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:12.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:12.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:12.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:12.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:12.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:12.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:12.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:12.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:12.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:12.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:12.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:12.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.862 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.862 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:12.863 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:12.863 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.562969675000002, 2024-09-17T01:55:12.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:12.863 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.863 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.863 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.864 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:12.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:12.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:12.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:12.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:12.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:12.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:12.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:12.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:12.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:12.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:12.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:12.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:12.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.872 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.873 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.873 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:12.873 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:12.873 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 25.568607885999999, 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:12.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:12.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.880 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.881 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:12.881 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:12.881 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.5664393560000001, 2024-09-17T01:55:12.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:12.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:12.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:12.888 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.5657659559999999, 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:12.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:12.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:12.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:12.894 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:12.896 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:12.897 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:12.901+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:12.997 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:13.002+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:13.027 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:13.027 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:13.027 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:13.027 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:13.041 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:13.098 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:13.105+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:13.160 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:13.160 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:13.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:13.221 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:13.219+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:13.295 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.200708761999998, 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.296 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:13.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.300 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.844803059, 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:13.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:13.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.675139485999999, 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:13.305 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:13.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:13.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.674342279000001, 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.310 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:13.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.673784955999999, 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:13.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.673242979999998, 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.319 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:13.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.672249774999997, 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:13.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.671689358999998, 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:13.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.671207785999997, 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:13.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.337 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.501304587, 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.342 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.500234188999997, 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:13.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.496425711999997, 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:13.347 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:13.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:13.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.090008043000001, 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:13.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:13.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.357 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.089904038, 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:13.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.089802979000002, 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:13.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:13.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.369 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.089695866, 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:13.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:13.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.375 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.0896328, 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:13.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:13.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.089574417000001, 2024-09-17T01:55:13.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:13.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:13.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:13.387 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.089506661000001, 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:13.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:13.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.089440731, 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:13.393 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:13.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:13.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:13.397 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:13.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:13.399 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:13.406+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:13.499 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:13.495+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:13.531 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:13.531 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:13.531 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:13.531 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:13.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:13.600 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:13.605+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:13.610 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:13.668 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:13.668 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:13.668 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:13.669 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:13.669 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:13.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:13.702 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:13.710+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:13.773 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:13.773 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:13.794 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:13.794 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:13.804 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:13.809+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:13.814 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:13.815 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:13.851 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:13.851 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:13.866 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:13.909 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:13.918+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:13.996 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.005 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:14.003+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:14.010 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:14.106 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:14.113+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:14.180 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:14.180 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.194 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:14.206 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:14.213+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:14.308 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:14.313+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:14.319 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:14.319 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.335 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:14.409 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:14.414+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:14.466 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:14.466 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.480 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:14.525 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:14.523+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:14.597 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:14.597 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.611 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:14.612 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:14.617+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:14.712 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:14.707+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:14.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:55:14.774 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:14.775 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:14.813 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:14.818+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:14.914 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:14.922+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:14.923 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:14.923 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:14.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:15.015 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:15.022+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:15.059 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.059 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:15.116 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:15.122+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:15.197 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.197 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:15.217 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:15.225+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:15.319 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:15.325+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.343 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:15.419 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:15.425+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:15.482 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.482 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.496 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:15.521 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:15.525+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:15.613 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.613 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.622 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:15.629+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:15.627 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:15.723 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:15.730+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:15.741 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:55:15.760 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.760 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.777 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:15.825 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:15.823+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:15.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:15.894 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:15.894 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:15.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:15.949 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:15.947+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:15.988 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:15.989 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:16.010 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:16.010 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:16.026 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:16.033+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:16.033 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:16.033 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:16.077 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.984201702999997, 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.628295999999999, 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.458632426999998, 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.45783522, 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.457277896999997, 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.456735921000003, 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.455742716000003, 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.455182299999997, 2024-09-17T01:55:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.454700727000002, 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.284797527999999, 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.283727130000003, 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.279918653000003, 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.873500984, 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.873396978999999, 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.87329592, 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.873188806999998, 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:16.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:16.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.873125740999999, 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:16.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.160 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.873067358, 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.872999602, 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.872933671999998, 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:16.175 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:16.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:16.178 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:16.182+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:16.278 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:16.275+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:16.309 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:16.310 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:16.310 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:16.310 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:16.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:16.379 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:16.385+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:16.441 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:16.441 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:16.441 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:16.441 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:16.441 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:16.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:16.498 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:16.505+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:16.581 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:16.590+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:16.630 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:16.630 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.357201562, 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:16.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:16.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:16.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.357162942999999, 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:16.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:16.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.357125355999997, 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:16.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.356973836999998, 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:16.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:16.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.356937518000002, 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:16.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:16.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.185786911999998, 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:16.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.185721166, 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:16.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:16.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.185601487, 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.674 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:16.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.679 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.185564217, 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:16.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:16.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:16.685 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.185501494, 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:16.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.185384597999999, 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:16.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.845482509, 2024-09-17T01:55:16.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:16.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:16.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:16.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.845329706999998, 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.704 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:16.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:16.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.845107761999998, 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.710 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:16.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:16.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:16.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.845032299000003, 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.716 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:16.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:16.721 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.844949952999997, 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:16.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.844663169, 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.727 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:16.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:16.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:16.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.844573572000002, 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:16.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:16.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.844461039999999, 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:16.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:16.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.844204075, 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:16.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:16.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:16.751 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:16.751 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:16.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:16.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T01:55:16.753 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:16.747+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:16.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:16.854 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:16.861+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:16.883 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:16.883 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:16.884 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:16.884 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:16.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:16.954 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:16.962+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:17.016 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:17.017 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:17.032 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:17.056 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:17.055+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:17.157 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.161+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.201 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:17.201 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:17.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 37.178082060000001, 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:17.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.165996773000003, 2024-09-17T01:55:17.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 35.155130689000003, 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:17.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.996361747000002, 2024-09-17T01:55:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:17.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:17.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.996261981, 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:17.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:17.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:17.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.996218185, 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:17.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:17.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:17.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.996140269000001, 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.232 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:17.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:17.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:17.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.237 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.996058402999999, 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:17.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.996007652999999, 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.243 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:17.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:17.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.995946846999999, 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:17.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:17.253 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.995856914000001, 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:17.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:17.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:17.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.995797258, 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.258 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:17.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:17.262 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.994285825999999, 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:17.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.99337925, 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:17.266 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.270 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.993234208000001, 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:17.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:17.275 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.991471868000001, 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:17.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:17.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.991363216, 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.280 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 29.997001427000001, 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:17.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:17.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:17.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 12.994832897, 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:17.290 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:17.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:17.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:17.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 7.9941594970000001, 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:17.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:17.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:17.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:17.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:17.302 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:17.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:17.304 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.309+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.405 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.413+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.434 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:17.435 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:17.448 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:17.506 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:17.503+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:17.567 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:17.567 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:17.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:17.607 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.613+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.708 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.713+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.751 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:17.751 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:17.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:17.751 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:17.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.656181683, 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:17.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:17.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:17.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.300275980000002, 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:17.757 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:17.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:17.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:17.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.130612407000001, 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:17.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:17.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:17.767 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.129815200000003, 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:17.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.129257877000001, 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.128715901, 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.127722695999999, 2024-09-17T01:55:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:17.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.12716228, 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:17.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.126680706999998, 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:17.795 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.956777508000002, 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:17.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:17.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.955707109999999, 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:17.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:17.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:17.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.951898632999999, 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.805 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.545480963999999, 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:17.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:17.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:17.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.545376959000002, 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.816 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:17.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.5452759, 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:17.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:17.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:17.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.827 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.545168787000001, 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:17.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:17.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.545105720999999, 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:17.833 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:17.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:17.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:17.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.545047338000003, 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:17.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:17.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.544979582000003, 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:17.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:17.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.544913651999998, 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:17.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:17.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:17.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:17.855 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:17.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:55:17.859 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T01:55:17.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:17.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T01:55:17.860 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.865+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.958 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:17.965+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:17.992 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:17.992 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:17.992 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:17.992 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:18.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:18.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:18.060 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:18.066+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:18.161 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:18.166+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:18.168 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:18.168 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:18.168 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:18.168 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:18.168 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:18.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:18.195 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:18.195 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:18.216 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:18.234 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:18.234 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:18.262 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:18.270+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:18.305 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:18.305 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:18.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:18.363 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:18.363+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:18.450 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:18.451 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:18.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:18.465 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:18.470+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:18.565 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:18.563+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:18.629 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:18.629 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:18.643 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:18.666 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:18.673+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:18.759 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:18.759 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:18.767 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:18.773+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:18.773 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:18.783 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:55:18.784 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T01:55:18.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T01:55:18.868 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:18.873+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:18.906 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:18.906 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:18.919 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:18.969 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:18.974+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:19.042 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.042 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.057 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:19.069 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:19.074+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:19.170 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:19.177+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:19.178 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.178 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:19.271 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:19.267+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:19.326 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.326 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:19.372 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:19.378+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:19.456 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.456 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:19.473 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:19.477+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:19.573 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:19.578+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:19.588 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.588 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.601 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:19.674 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:19.681+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:19.734 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.734 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.747 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:19.775 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:19.781+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:19.785 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T01:55:19.811 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T01:55:19.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:55:19.864 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.865 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:19.876 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:19.871+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:19.878 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:19.977 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:19.981+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:19.995 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:19.995 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:20.009 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:20.077 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:20.081+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:20.139 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:20.140 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:20.153 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:20.158 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:20.160 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:55:20.176 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T01:55:19.983339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90260,"kb_used_data":856,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025260,"statfs":{"total":289910292480,"available":289817866240,"internally_reserved":0,"allocated":876544,"data_stored":1469662,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.246406"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453178+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:55:16.453178+0000","last_peered":"2024-09-17T01:55:16.453178+0000","last_clean":"2024-09-17T01:55:16.453178+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:55:16.453178+0000","last_undegraded":"2024-09-17T01:55:16.453178+0000","last_fullsized":"2024-09-17T01:55:16.453178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452443+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:55:16.452443+0000","last_peered":"2024-09-17T01:55:16.452443+0000","last_clean":"2024-09-17T01:55:16.452443+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:55:16.452443+0000","last_undegraded":"2024-09-17T01:55:16.452443+0000","last_fullsized":"2024-09-17T01:55:16.452443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749954+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:55:15.749954+0000","last_peered":"2024-09-17T01:55:15.749954+0000","last_clean":"2024-09-17T01:55:15.749954+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:55:15.749954+0000","last_undegraded":"2024-09-17T01:55:15.749954+0000","last_fullsized":"2024-09-17T01:55:15.749954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749722+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:55:15.749722+0000","last_peered":"2024-09-17T01:55:15.749722+0000","last_clean":"2024-09-17T01:55:15.749722+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:55:15.749722+0000","last_undegraded":"2024-09-17T01:55:15.749722+0000","last_fullsized":"2024-09-17T01:55:15.749722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451928+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:55:16.451928+0000","last_peered":"2024-09-17T01:55:16.451928+0000","last_clean":"2024-09-17T01:55:16.451928+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:55:16.451928+0000","last_undegraded":"2024-09-17T01:55:16.451928+0000","last_fullsized":"2024-09-17T01:55:16.451928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749098+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:55:15.749098+0000","last_peered":"2024-09-17T01:55:15.749098+0000","last_clean":"2024-09-17T01:55:15.749098+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:55:15.749098+0000","last_undegraded":"2024-09-17T01:55:15.749098+0000","last_fullsized":"2024-09-17T01:55:15.749098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749219+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:55:15.749219+0000","last_peered":"2024-09-17T01:55:15.749219+0000","last_clean":"2024-09-17T01:55:15.749219+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:55:15.749219+0000","last_undegraded":"2024-09-17T01:55:15.749219+0000","last_fullsized":"2024-09-17T01:55:15.749219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748655+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:55:15.748655+0000","last_peered":"2024-09-17T01:55:15.748655+0000","last_clean":"2024-09-17T01:55:15.748655+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:55:15.748655+0000","last_undegraded":"2024-09-17T01:55:15.748655+0000","last_fullsized":"2024-09-17T01:55:15.748655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450382+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:55:16.450382+0000","last_peered":"2024-09-17T01:55:16.450382+0000","last_clean":"2024-09-17T01:55:16.450382+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:55:16.450382+0000","last_undegraded":"2024-09-17T01:55:16.450382+0000","last_fullsized":"2024-09-17T01:55:16.450382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452559+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:55:16.452559+0000","last_peered":"2024-09-17T01:55:16.452559+0000","last_clean":"2024-09-17T01:55:16.452559+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:55:16.452559+0000","last_undegraded":"2024-09-17T01:55:16.452559+0000","last_fullsized":"2024-09-17T01:55:16.452559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750167+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:55:15.750167+0000","last_peered":"2024-09-17T01:55:15.750167+0000","last_clean":"2024-09-17T01:55:15.750167+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:55:15.750167+0000","last_undegraded":"2024-09-17T01:55:15.750167+0000","last_fullsized":"2024-09-17T01:55:15.750167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452099+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:55:16.452099+0000","last_peered":"2024-09-17T01:55:16.452099+0000","last_clean":"2024-09-17T01:55:16.452099+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:55:16.452099+0000","last_undegraded":"2024-09-17T01:55:16.452099+0000","last_fullsized":"2024-09-17T01:55:16.452099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451684+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:55:16.451684+0000","last_peered":"2024-09-17T01:55:16.451684+0000","last_clean":"2024-09-17T01:55:16.451684+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:55:16.451684+0000","last_undegraded":"2024-09-17T01:55:16.451684+0000","last_fullsized":"2024-09-17T01:55:16.451684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749997+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:55:15.749997+0000","last_peered":"2024-09-17T01:55:15.749997+0000","last_clean":"2024-09-17T01:55:15.749997+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:55:15.749997+0000","last_undegraded":"2024-09-17T01:55:15.749997+0000","last_fullsized":"2024-09-17T01:55:15.749997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749274+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:55:15.749274+0000","last_peered":"2024-09-17T01:55:15.749274+0000","last_clean":"2024-09-17T01:55:15.749274+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:55:15.749274+0000","last_undegraded":"2024-09-17T01:55:15.749274+0000","last_fullsized":"2024-09-17T01:55:15.749274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748656+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:55:15.748656+0000","last_peered":"2024-09-17T01:55:15.748656+0000","last_clean":"2024-09-17T01:55:15.748656+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:55:15.748656+0000","last_undegraded":"2024-09-17T01:55:15.748656+0000","last_fullsized":"2024-09-17T01:55:15.748656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451114+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:55:16.451114+0000","last_peered":"2024-09-17T01:55:16.451114+0000","last_clean":"2024-09-17T01:55:16.451114+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:55:16.451114+0000","last_undegraded":"2024-09-17T01:55:16.451114+0000","last_fullsized":"2024-09-17T01:55:16.451114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453011+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:55:16.453011+0000","last_peered":"2024-09-17T01:55:16.453011+0000","last_clean":"2024-09-17T01:55:16.453011+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:55:16.453011+0000","last_undegraded":"2024-09-17T01:55:16.453011+0000","last_fullsized":"2024-09-17T01:55:16.453011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450068+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:55:16.450068+0000","last_peered":"2024-09-17T01:55:16.450068+0000","last_clean":"2024-09-17T01:55:16.450068+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:55:16.450068+0000","last_undegraded":"2024-09-17T01:55:16.450068+0000","last_fullsized":"2024-09-17T01:55:16.450068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750057+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:55:15.750057+0000","last_peered":"2024-09-17T01:55:15.750057+0000","last_clean":"2024-09-17T01:55:15.750057+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:55:15.750057+0000","last_undegraded":"2024-09-17T01:55:15.750057+0000","last_fullsized":"2024-09-17T01:55:15.750057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749489+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:55:15.749489+0000","last_peered":"2024-09-17T01:55:15.749489+0000","last_clean":"2024-09-17T01:55:15.749489+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:55:15.749489+0000","last_undegraded":"2024-09-17T01:55:15.749489+0000","last_fullsized":"2024-09-17T01:55:15.749489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451371+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:55:16.451371+0000","last_peered":"2024-09-17T01:55:16.451371+0000","last_clean":"2024-09-17T01:55:16.451371+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:55:16.451371+0000","last_undegraded":"2024-09-17T01:55:16.451371+0000","last_fullsized":"2024-09-17T01:55:16.451371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448523+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:55:16.448523+0000","last_peered":"2024-09-17T01:55:16.448523+0000","last_clean":"2024-09-17T01:55:16.448523+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:55:16.448523+0000","last_undegraded":"2024-09-17T01:55:16.448523+0000","last_fullsized":"2024-09-17T01:55:16.448523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450726+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:55:16.450726+0000","last_peered":"2024-09-17T01:55:16.450726+0000","last_clean":"2024-09-17T01:55:16.450726+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:55:16.450726+0000","last_undegraded":"2024-09-17T01:55:16.450726+0000","last_fullsized":"2024-09-17T01:55:16.450726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453189+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:55:16.453189+0000","last_peered":"2024-09-17T01:55:16.453189+0000","last_clean":"2024-09-17T01:55:16.453189+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:55:16.453189+0000","last_undegraded":"2024-09-17T01:55:16.453189+0000","last_fullsized":"2024-09-17T01:55:16.453189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450512+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:55:16.450512+0000","last_peered":"2024-09-17T01:55:16.450512+0000","last_clean":"2024-09-17T01:55:16.450512+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:55:16.450512+0000","last_undegraded":"2024-09-17T01:55:16.450512+0000","last_fullsized":"2024-09-17T01:55:16.450512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750214+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:55:15.750214+0000","last_peered":"2024-09-17T01:55:15.750214+0000","last_clean":"2024-09-17T01:55:15.750214+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:55:15.750214+0000","last_undegraded":"2024-09-17T01:55:15.750214+0000","last_fullsized":"2024-09-17T01:55:15.750214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452386+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:55:16.452386+0000","last_peered":"2024-09-17T01:55:16.452386+0000","last_clean":"2024-09-17T01:55:16.452386+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:55:16.452386+0000","last_undegraded":"2024-09-17T01:55:16.452386+0000","last_fullsized":"2024-09-17T01:55:16.452386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449563+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:55:16.449563+0000","last_peered":"2024-09-17T01:55:16.449563+0000","last_clean":"2024-09-17T01:55:16.449563+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:55:16.449563+0000","last_undegraded":"2024-09-17T01:55:16.449563+0000","last_fullsized":"2024-09-17T01:55:16.449563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451655+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:55:16.451655+0000","last_peered":"2024-09-17T01:55:16.451655+0000","last_clean":"2024-09-17T01:55:16.451655+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:55:16.451655+0000","last_undegraded":"2024-09-17T01:55:16.451655+0000","last_fullsized":"2024-09-17T01:55:16.451655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448587+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:55:16.448587+0000","last_peered":"2024-09-17T01:55:16.448587+0000","last_clean":"2024-09-17T01:55:16.448587+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:55:16.448587+0000","last_undegraded":"2024-09-17T01:55:16.448587+0000","last_fullsized":"2024-09-17T01:55:16.448587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748955+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:55:15.748955+0000","last_peered":"2024-09-17T01:55:15.748955+0000","last_clean":"2024-09-17T01:55:15.748955+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:55:15.748955+0000","last_undegraded":"2024-09-17T01:55:15.748955+0000","last_fullsized":"2024-09-17T01:55:15.748955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452354+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:55:16.452354+0000","last_peered":"2024-09-17T01:55:16.452354+0000","last_clean":"2024-09-17T01:55:16.452354+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:55:16.452354+0000","last_undegraded":"2024-09-17T01:55:16.452354+0000","last_fullsized":"2024-09-17T01:55:16.452354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749870+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:55:15.749870+0000","last_peered":"2024-09-17T01:55:15.749870+0000","last_clean":"2024-09-17T01:55:15.749870+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:55:15.749870+0000","last_undegraded":"2024-09-17T01:55:15.749870+0000","last_fullsized":"2024-09-17T01:55:15.749870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452441+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:55:16.452441+0000","last_peered":"2024-09-17T01:55:16.452441+0000","last_clean":"2024-09-17T01:55:16.452441+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:55:16.452441+0000","last_undegraded":"2024-09-17T01:55:16.452441+0000","last_fullsized":"2024-09-17T01:55:16.452441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447784+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:55:16.447784+0000","last_peered":"2024-09-17T01:55:16.447784+0000","last_clean":"2024-09-17T01:55:16.447784+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:55:16.447784+0000","last_undegraded":"2024-09-17T01:55:16.447784+0000","last_fullsized":"2024-09-17T01:55:16.447784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450810+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:55:16.450810+0000","last_peered":"2024-09-17T01:55:16.450810+0000","last_clean":"2024-09-17T01:55:16.450810+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:55:16.450810+0000","last_undegraded":"2024-09-17T01:55:16.450810+0000","last_fullsized":"2024-09-17T01:55:16.450810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450176+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:55:16.450176+0000","last_peered":"2024-09-17T01:55:16.450176+0000","last_clean":"2024-09-17T01:55:16.450176+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:55:16.450176+0000","last_undegraded":"2024-09-17T01:55:16.450176+0000","last_fullsized":"2024-09-17T01:55:16.450176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450475+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:55:16.450475+0000","last_peered":"2024-09-17T01:55:16.450475+0000","last_clean":"2024-09-17T01:55:16.450475+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:55:16.450475+0000","last_undegraded":"2024-09-17T01:55:16.450475+0000","last_fullsized":"2024-09-17T01:55:16.450475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748961+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:55:15.748961+0000","last_peered":"2024-09-17T01:55:15.748961+0000","last_clean":"2024-09-17T01:55:15.748961+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:55:15.748961+0000","last_undegraded":"2024-09-17T01:55:15.748961+0000","last_fullsized":"2024-09-17T01:55:15.748961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750860+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:55:15.750860+0000","last_peered":"2024-09-17T01:55:15.750860+0000","last_clean":"2024-09-17T01:55:15.750860+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:55:15.750860+0000","last_undegraded":"2024-09-17T01:55:15.750860+0000","last_fullsized":"2024-09-17T01:55:15.750860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450922+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:55:16.450922+0000","last_peered":"2024-09-17T01:55:16.450922+0000","last_clean":"2024-09-17T01:55:16.450922+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:55:16.450922+0000","last_undegraded":"2024-09-17T01:55:16.450922+0000","last_fullsized":"2024-09-17T01:55:16.450922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450511+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:55:16.450511+0000","last_peered":"2024-09-17T01:55:16.450511+0000","last_clean":"2024-09-17T01:55:16.450511+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:55:16.450511+0000","last_undegraded":"2024-09-17T01:55:16.450511+0000","last_fullsized":"2024-09-17T01:55:16.450511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451213+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:55:16.451213+0000","last_peered":"2024-09-17T01:55:16.451213+0000","last_clean":"2024-09-17T01:55:16.451213+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:55:16.451213+0000","last_undegraded":"2024-09-17T01:55:16.451213+0000","last_fullsized":"2024-09-17T01:55:16.451213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751164+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:55:15.751164+0000","last_peered":"2024-09-17T01:55:15.751164+0000","last_clean":"2024-09-17T01:55:15.751164+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:55:15.751164+0000","last_undegraded":"2024-09-17T01:55:15.751164+0000","last_fullsized":"2024-09-17T01:55:15.751164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750788+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:55:15.750788+0000","last_peered":"2024-09-17T01:55:15.750788+0000","last_clean":"2024-09-17T01:55:15.750788+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:55:15.750788+0000","last_undegraded":"2024-09-17T01:55:15.750788+0000","last_fullsized":"2024-09-17T01:55:15.750788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750707+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:55:15.750707+0000","last_peered":"2024-09-17T01:55:15.750707+0000","last_clean":"2024-09-17T01:55:15.750707+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:55:15.750707+0000","last_undegraded":"2024-09-17T01:55:15.750707+0000","last_fullsized":"2024-09-17T01:55:15.750707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449332+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:55:16.449332+0000","last_peered":"2024-09-17T01:55:16.449332+0000","last_clean":"2024-09-17T01:55:16.449332+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:55:16.449332+0000","last_undegraded":"2024-09-17T01:55:16.449332+0000","last_fullsized":"2024-09-17T01:55:16.449332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447756+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:55:16.447756+0000","last_peered":"2024-09-17T01:55:16.447756+0000","last_clean":"2024-09-17T01:55:16.447756+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:55:16.447756+0000","last_undegraded":"2024-09-17T01:55:16.447756+0000","last_fullsized":"2024-09-17T01:55:16.447756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750266+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:55:15.750266+0000","last_peered":"2024-09-17T01:55:15.750266+0000","last_clean":"2024-09-17T01:55:15.750266+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:55:15.750266+0000","last_undegraded":"2024-09-17T01:55:15.750266+0000","last_fullsized":"2024-09-17T01:55:15.750266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751083+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:55:15.751083+0000","last_peered":"2024-09-17T01:55:15.751083+0000","last_clean":"2024-09-17T01:55:15.751083+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:55:15.751083+0000","last_undegraded":"2024-09-17T01:55:15.751083+0000","last_fullsized":"2024-09-17T01:55:15.751083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750618+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:55:15.750618+0000","last_peered":"2024-09-17T01:55:15.750618+0000","last_clean":"2024-09-17T01:55:15.750618+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:55:15.750618+0000","last_undegraded":"2024-09-17T01:55:15.750618+0000","last_fullsized":"2024-09-17T01:55:15.750618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450147+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:55:16.450147+0000","last_peered":"2024-09-17T01:55:16.450147+0000","last_clean":"2024-09-17T01:55:16.450147+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:55:16.450147+0000","last_undegraded":"2024-09-17T01:55:16.450147+0000","last_fullsized":"2024-09-17T01:55:16.450147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750840+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:55:15.750840+0000","last_peered":"2024-09-17T01:55:15.750840+0000","last_clean":"2024-09-17T01:55:15.750840+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:55:15.750840+0000","last_undegraded":"2024-09-17T01:55:15.750840+0000","last_fullsized":"2024-09-17T01:55:15.750840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450969+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:55:16.450969+0000","last_peered":"2024-09-17T01:55:16.450969+0000","last_clean":"2024-09-17T01:55:16.450969+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:55:16.450969+0000","last_undegraded":"2024-09-17T01:55:16.450969+0000","last_fullsized":"2024-09-17T01:55:16.450969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450799+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:55:16.450799+0000","last_peered":"2024-09-17T01:55:16.450799+0000","last_clean":"2024-09-17T01:55:16.450799+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:55:16.450799+0000","last_undegraded":"2024-09-17T01:55:16.450799+0000","last_fullsized":"2024-09-17T01:55:16.450799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749906+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:55:15.749906+0000","last_peered":"2024-09-17T01:55:15.749906+0000","last_clean":"2024-09-17T01:55:15.749906+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:55:15.749906+0000","last_undegraded":"2024-09-17T01:55:15.749906+0000","last_fullsized":"2024-09-17T01:55:15.749906+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750183+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:55:15.750183+0000","last_peered":"2024-09-17T01:55:15.750183+0000","last_clean":"2024-09-17T01:55:15.750183+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:55:15.750183+0000","last_undegraded":"2024-09-17T01:55:15.750183+0000","last_fullsized":"2024-09-17T01:55:15.750183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449926+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:55:16.449926+0000","last_peered":"2024-09-17T01:55:16.449926+0000","last_clean":"2024-09-17T01:55:16.449926+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:55:16.449926+0000","last_undegraded":"2024-09-17T01:55:16.449926+0000","last_fullsized":"2024-09-17T01:55:16.449926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750880+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:55:15.750880+0000","last_peered":"2024-09-17T01:55:15.750880+0000","last_clean":"2024-09-17T01:55:15.750880+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:55:15.750880+0000","last_undegraded":"2024-09-17T01:55:15.750880+0000","last_fullsized":"2024-09-17T01:55:15.750880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749636+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:55:15.749636+0000","last_peered":"2024-09-17T01:55:15.749636+0000","last_clean":"2024-09-17T01:55:15.749636+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:55:15.749636+0000","last_undegraded":"2024-09-17T01:55:15.749636+0000","last_fullsized":"2024-09-17T01:55:15.749636+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447683+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:55:16.447683+0000","last_peered":"2024-09-17T01:55:16.447683+0000","last_clean":"2024-09-17T01:55:16.447683+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:55:16.447683+0000","last_undegraded":"2024-09-17T01:55:16.447683+0000","last_fullsized":"2024-09-17T01:55:16.447683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452738+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:55:16.452738+0000","last_peered":"2024-09-17T01:55:16.452738+0000","last_clean":"2024-09-17T01:55:16.452738+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:55:16.452738+0000","last_undegraded":"2024-09-17T01:55:16.452738+0000","last_fullsized":"2024-09-17T01:55:16.452738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449280+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:55:16.449280+0000","last_peered":"2024-09-17T01:55:16.449280+0000","last_clean":"2024-09-17T01:55:16.449280+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:55:16.449280+0000","last_undegraded":"2024-09-17T01:55:16.449280+0000","last_fullsized":"2024-09-17T01:55:16.449280+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450120+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:55:16.450120+0000","last_peered":"2024-09-17T01:55:16.450120+0000","last_clean":"2024-09-17T01:55:16.450120+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:55:16.450120+0000","last_undegraded":"2024-09-17T01:55:16.450120+0000","last_fullsized":"2024-09-17T01:55:16.450120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450809+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:55:16.450809+0000","last_peered":"2024-09-17T01:55:16.450809+0000","last_clean":"2024-09-17T01:55:16.450809+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:55:16.450809+0000","last_undegraded":"2024-09-17T01:55:16.450809+0000","last_fullsized":"2024-09-17T01:55:16.450809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751206+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:55:15.751206+0000","last_peered":"2024-09-17T01:55:15.751206+0000","last_clean":"2024-09-17T01:55:15.751206+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:55:15.751206+0000","last_undegraded":"2024-09-17T01:55:15.751206+0000","last_fullsized":"2024-09-17T01:55:15.751206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750057+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:55:15.750057+0000","last_peered":"2024-09-17T01:55:15.750057+0000","last_clean":"2024-09-17T01:55:15.750057+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:55:15.750057+0000","last_undegraded":"2024-09-17T01:55:15.750057+0000","last_fullsized":"2024-09-17T01:55:15.750057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449738+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:55:16.449738+0000","last_peered":"2024-09-17T01:55:16.449738+0000","last_clean":"2024-09-17T01:55:16.449738+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:55:16.449738+0000","last_undegraded":"2024-09-17T01:55:16.449738+0000","last_fullsized":"2024-09-17T01:55:16.449738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751156+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:55:15.751156+0000","last_peered":"2024-09-17T01:55:15.751156+0000","last_clean":"2024-09-17T01:55:15.751156+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:55:15.751156+0000","last_undegraded":"2024-09-17T01:55:15.751156+0000","last_fullsized":"2024-09-17T01:55:15.751156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450074+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:55:16.450074+0000","last_peered":"2024-09-17T01:55:16.450074+0000","last_clean":"2024-09-17T01:55:16.450074+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:55:16.450074+0000","last_undegraded":"2024-09-17T01:55:16.450074+0000","last_fullsized":"2024-09-17T01:55:16.450074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451642+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:55:16.451642+0000","last_peered":"2024-09-17T01:55:16.451642+0000","last_clean":"2024-09-17T01:55:16.451642+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:55:16.451642+0000","last_undegraded":"2024-09-17T01:55:16.451642+0000","last_fullsized":"2024-09-17T01:55:16.451642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449908+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:55:16.449908+0000","last_peered":"2024-09-17T01:55:16.449908+0000","last_clean":"2024-09-17T01:55:16.449908+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:55:16.449908+0000","last_undegraded":"2024-09-17T01:55:16.449908+0000","last_fullsized":"2024-09-17T01:55:16.449908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452852+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:55:16.452852+0000","last_peered":"2024-09-17T01:55:16.452852+0000","last_clean":"2024-09-17T01:55:16.452852+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:55:16.452852+0000","last_undegraded":"2024-09-17T01:55:16.452852+0000","last_fullsized":"2024-09-17T01:55:16.452852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451745+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:55:16.451745+0000","last_peered":"2024-09-17T01:55:16.451745+0000","last_clean":"2024-09-17T01:55:16.451745+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:55:16.451745+0000","last_undegraded":"2024-09-17T01:55:16.451745+0000","last_fullsized":"2024-09-17T01:55:16.451745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451216+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:55:16.451216+0000","last_peered":"2024-09-17T01:55:16.451216+0000","last_clean":"2024-09-17T01:55:16.451216+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:55:16.451216+0000","last_undegraded":"2024-09-17T01:55:16.451216+0000","last_fullsized":"2024-09-17T01:55:16.451216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450973+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:55:16.450973+0000","last_peered":"2024-09-17T01:55:16.450973+0000","last_clean":"2024-09-17T01:55:16.450973+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:55:16.450973+0000","last_undegraded":"2024-09-17T01:55:16.450973+0000","last_fullsized":"2024-09-17T01:55:16.450973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449241+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:55:16.449241+0000","last_peered":"2024-09-17T01:55:16.449241+0000","last_clean":"2024-09-17T01:55:16.449241+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:55:16.449241+0000","last_undegraded":"2024-09-17T01:55:16.449241+0000","last_fullsized":"2024-09-17T01:55:16.449241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448348+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:55:16.448348+0000","last_peered":"2024-09-17T01:55:16.448348+0000","last_clean":"2024-09-17T01:55:16.448348+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:55:16.448348+0000","last_undegraded":"2024-09-17T01:55:16.448348+0000","last_fullsized":"2024-09-17T01:55:16.448348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751083+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:55:15.751083+0000","last_peered":"2024-09-17T01:55:15.751083+0000","last_clean":"2024-09-17T01:55:15.751083+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:55:15.751083+0000","last_undegraded":"2024-09-17T01:55:15.751083+0000","last_fullsized":"2024-09-17T01:55:15.751083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451181+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:55:16.451181+0000","last_peered":"2024-09-17T01:55:16.451181+0000","last_clean":"2024-09-17T01:55:16.451181+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:55:16.451181+0000","last_undegraded":"2024-09-17T01:55:16.451181+0000","last_fullsized":"2024-09-17T01:55:16.451181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749752+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:55:15.749752+0000","last_peered":"2024-09-17T01:55:15.749752+0000","last_clean":"2024-09-17T01:55:15.749752+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:55:15.749752+0000","last_undegraded":"2024-09-17T01:55:15.749752+0000","last_fullsized":"2024-09-17T01:55:15.749752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750544+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:55:15.750544+0000","last_peered":"2024-09-17T01:55:15.750544+0000","last_clean":"2024-09-17T01:55:15.750544+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:55:15.750544+0000","last_undegraded":"2024-09-17T01:55:15.750544+0000","last_fullsized":"2024-09-17T01:55:15.750544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448838+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:55:16.448838+0000","last_peered":"2024-09-17T01:55:16.448838+0000","last_clean":"2024-09-17T01:55:16.448838+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:55:16.448838+0000","last_undegraded":"2024-09-17T01:55:16.448838+0000","last_fullsized":"2024-09-17T01:55:16.448838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450456+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:55:16.450456+0000","last_peered":"2024-09-17T01:55:16.450456+0000","last_clean":"2024-09-17T01:55:16.450456+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:55:16.450456+0000","last_undegraded":"2024-09-17T01:55:16.450456+0000","last_fullsized":"2024-09-17T01:55:16.450456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751146+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:55:15.751146+0000","last_peered":"2024-09-17T01:55:15.751146+0000","last_clean":"2024-09-17T01:55:15.751146+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:55:15.751146+0000","last_undegraded":"2024-09-17T01:55:15.751146+0000","last_fullsized":"2024-09-17T01:55:15.751146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449147+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:55:16.449147+0000","last_peered":"2024-09-17T01:55:16.449147+0000","last_clean":"2024-09-17T01:55:16.449147+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:55:16.449147+0000","last_undegraded":"2024-09-17T01:55:16.449147+0000","last_fullsized":"2024-09-17T01:55:16.449147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448157+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:55:16.448157+0000","last_peered":"2024-09-17T01:55:16.448157+0000","last_clean":"2024-09-17T01:55:16.448157+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:55:16.448157+0000","last_undegraded":"2024-09-17T01:55:16.448157+0000","last_fullsized":"2024-09-17T01:55:16.448157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449152+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:55:16.449152+0000","last_peered":"2024-09-17T01:55:16.449152+0000","last_clean":"2024-09-17T01:55:16.449152+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:55:16.449152+0000","last_undegraded":"2024-09-17T01:55:16.449152+0000","last_fullsized":"2024-09-17T01:55:16.449152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453334+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:55:16.453334+0000","last_peered":"2024-09-17T01:55:16.453334+0000","last_clean":"2024-09-17T01:55:16.453334+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:55:16.453334+0000","last_undegraded":"2024-09-17T01:55:16.453334+0000","last_fullsized":"2024-09-17T01:55:16.453334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449729+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:55:16.449729+0000","last_peered":"2024-09-17T01:55:16.449729+0000","last_clean":"2024-09-17T01:55:16.449729+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:55:16.449729+0000","last_undegraded":"2024-09-17T01:55:16.449729+0000","last_fullsized":"2024-09-17T01:55:16.449729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450403+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:55:16.450403+0000","last_peered":"2024-09-17T01:55:16.450403+0000","last_clean":"2024-09-17T01:55:16.450403+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:55:16.450403+0000","last_undegraded":"2024-09-17T01:55:16.450403+0000","last_fullsized":"2024-09-17T01:55:16.450403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447710+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:55:16.447710+0000","last_peered":"2024-09-17T01:55:16.447710+0000","last_clean":"2024-09-17T01:55:16.447710+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:55:16.447710+0000","last_undegraded":"2024-09-17T01:55:16.447710+0000","last_fullsized":"2024-09-17T01:55:16.447710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452346+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:55:16.452346+0000","last_peered":"2024-09-17T01:55:16.452346+0000","last_clean":"2024-09-17T01:55:16.452346+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:55:16.452346+0000","last_undegraded":"2024-09-17T01:55:16.452346+0000","last_fullsized":"2024-09-17T01:55:16.452346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451915+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:55:16.451915+0000","last_peered":"2024-09-17T01:55:16.451915+0000","last_clean":"2024-09-17T01:55:16.451915+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:55:16.451915+0000","last_undegraded":"2024-09-17T01:55:16.451915+0000","last_fullsized":"2024-09-17T01:55:16.451915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452120+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:55:16.452120+0000","last_peered":"2024-09-17T01:55:16.452120+0000","last_clean":"2024-09-17T01:55:16.452120+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:55:16.452120+0000","last_undegraded":"2024-09-17T01:55:16.452120+0000","last_fullsized":"2024-09-17T01:55:16.452120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450194+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:55:16.450194+0000","last_peered":"2024-09-17T01:55:16.450194+0000","last_clean":"2024-09-17T01:55:16.450194+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:55:16.450194+0000","last_undegraded":"2024-09-17T01:55:16.450194+0000","last_fullsized":"2024-09-17T01:55:16.450194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749598+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:55:15.749598+0000","last_peered":"2024-09-17T01:55:15.749598+0000","last_clean":"2024-09-17T01:55:15.749598+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:55:15.749598+0000","last_undegraded":"2024-09-17T01:55:15.749598+0000","last_fullsized":"2024-09-17T01:55:15.749598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750344+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:55:15.750344+0000","last_peered":"2024-09-17T01:55:15.750344+0000","last_clean":"2024-09-17T01:55:15.750344+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:55:15.750344+0000","last_undegraded":"2024-09-17T01:55:15.750344+0000","last_fullsized":"2024-09-17T01:55:15.750344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749750+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:55:15.749750+0000","last_peered":"2024-09-17T01:55:15.749750+0000","last_clean":"2024-09-17T01:55:15.749750+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:55:15.749750+0000","last_undegraded":"2024-09-17T01:55:15.749750+0000","last_fullsized":"2024-09-17T01:55:15.749750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450612+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:55:16.450612+0000","last_peered":"2024-09-17T01:55:16.450612+0000","last_clean":"2024-09-17T01:55:16.450612+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:55:16.450612+0000","last_undegraded":"2024-09-17T01:55:16.450612+0000","last_fullsized":"2024-09-17T01:55:16.450612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451571+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:55:16.451571+0000","last_peered":"2024-09-17T01:55:16.451571+0000","last_clean":"2024-09-17T01:55:16.451571+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:55:16.451571+0000","last_undegraded":"2024-09-17T01:55:16.451571+0000","last_fullsized":"2024-09-17T01:55:16.451571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450807+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:55:16.450807+0000","last_peered":"2024-09-17T01:55:16.450807+0000","last_clean":"2024-09-17T01:55:16.450807+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:55:16.450807+0000","last_undegraded":"2024-09-17T01:55:16.450807+0000","last_fullsized":"2024-09-17T01:55:16.450807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749237+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:55:15.749237+0000","last_peered":"2024-09-17T01:55:15.749237+0000","last_clean":"2024-09-17T01:55:15.749237+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:55:15.749237+0000","last_undegraded":"2024-09-17T01:55:15.749237+0000","last_fullsized":"2024-09-17T01:55:15.749237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448464+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:55:16.448464+0000","last_peered":"2024-09-17T01:55:16.448464+0000","last_clean":"2024-09-17T01:55:16.448464+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:55:16.448464+0000","last_undegraded":"2024-09-17T01:55:16.448464+0000","last_fullsized":"2024-09-17T01:55:16.448464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":690542,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":307200,"data_stored":685683,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":93437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:55:20.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:55:20.182 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:20.189+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:20.251 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:20.270 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:20.270 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:20.285 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:20.286 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:20.283+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:20.387 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:20.393+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:20.407 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:20.407 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:20.428 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:20.428 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:20.450 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:20.450 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:20.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.355872507000001, 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:20.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.455 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.999966804000003, 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:20.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.830303231000002, 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:20.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.464 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.829506023999997, 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:20.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:20.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.828948701000002, 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.828406725000001, 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:20.474 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:20.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.82741352, 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:20.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.826853104000001, 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:20.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:20.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:20.491 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.826371530999999, 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:20.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:20.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.656468332000003, 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.496 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:20.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:20.500 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.655397934, 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:20.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:20.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.651589457, 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:20.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:20.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.245171788, 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:20.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:20.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.515 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.245067783000003, 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:20.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.244966724000001, 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:20.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:20.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.244859611000003, 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.527 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:20.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.532 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.244796545, 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.244738161999997, 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.538 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:20.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.244670405999997, 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:20.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:20.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.244604475999999, 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:20.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:20.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.553 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:20.554 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:20.554 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:20.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:20.557 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:20.561 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:55:20.561 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:20.561+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T01:55:19.983339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90260,"kb_used_data":856,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025260,"statfs":{"total":289910292480,"available":289817866240,"internally_reserved":0,"allocated":876544,"data_stored":1469662,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.246406"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453178+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:55:16.453178+0000","last_peered":"2024-09-17T01:55:16.453178+0000","last_clean":"2024-09-17T01:55:16.453178+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:55:16.453178+0000","last_undegraded":"2024-09-17T01:55:16.453178+0000","last_fullsized":"2024-09-17T01:55:16.453178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452443+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:55:16.452443+0000","last_peered":"2024-09-17T01:55:16.452443+0000","last_clean":"2024-09-17T01:55:16.452443+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:55:16.452443+0000","last_undegraded":"2024-09-17T01:55:16.452443+0000","last_fullsized":"2024-09-17T01:55:16.452443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749954+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:55:15.749954+0000","last_peered":"2024-09-17T01:55:15.749954+0000","last_clean":"2024-09-17T01:55:15.749954+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:55:15.749954+0000","last_undegraded":"2024-09-17T01:55:15.749954+0000","last_fullsized":"2024-09-17T01:55:15.749954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749722+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:55:15.749722+0000","last_peered":"2024-09-17T01:55:15.749722+0000","last_clean":"2024-09-17T01:55:15.749722+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:55:15.749722+0000","last_undegraded":"2024-09-17T01:55:15.749722+0000","last_fullsized":"2024-09-17T01:55:15.749722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451928+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:55:16.451928+0000","last_peered":"2024-09-17T01:55:16.451928+0000","last_clean":"2024-09-17T01:55:16.451928+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:55:16.451928+0000","last_undegraded":"2024-09-17T01:55:16.451928+0000","last_fullsized":"2024-09-17T01:55:16.451928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749098+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:55:15.749098+0000","last_peered":"2024-09-17T01:55:15.749098+0000","last_clean":"2024-09-17T01:55:15.749098+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:55:15.749098+0000","last_undegraded":"2024-09-17T01:55:15.749098+0000","last_fullsized":"2024-09-17T01:55:15.749098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749219+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:55:15.749219+0000","last_peered":"2024-09-17T01:55:15.749219+0000","last_clean":"2024-09-17T01:55:15.749219+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:55:15.749219+0000","last_undegraded":"2024-09-17T01:55:15.749219+0000","last_fullsized":"2024-09-17T01:55:15.749219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748655+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:55:15.748655+0000","last_peered":"2024-09-17T01:55:15.748655+0000","last_clean":"2024-09-17T01:55:15.748655+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:55:15.748655+0000","last_undegraded":"2024-09-17T01:55:15.748655+0000","last_fullsized":"2024-09-17T01:55:15.748655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450382+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:55:16.450382+0000","last_peered":"2024-09-17T01:55:16.450382+0000","last_clean":"2024-09-17T01:55:16.450382+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:55:16.450382+0000","last_undegraded":"2024-09-17T01:55:16.450382+0000","last_fullsized":"2024-09-17T01:55:16.450382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452559+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:55:16.452559+0000","last_peered":"2024-09-17T01:55:16.452559+0000","last_clean":"2024-09-17T01:55:16.452559+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:55:16.452559+0000","last_undegraded":"2024-09-17T01:55:16.452559+0000","last_fullsized":"2024-09-17T01:55:16.452559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750167+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:55:15.750167+0000","last_peered":"2024-09-17T01:55:15.750167+0000","last_clean":"2024-09-17T01:55:15.750167+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:55:15.750167+0000","last_undegraded":"2024-09-17T01:55:15.750167+0000","last_fullsized":"2024-09-17T01:55:15.750167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452099+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:55:16.452099+0000","last_peered":"2024-09-17T01:55:16.452099+0000","last_clean":"2024-09-17T01:55:16.452099+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:55:16.452099+0000","last_undegraded":"2024-09-17T01:55:16.452099+0000","last_fullsized":"2024-09-17T01:55:16.452099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451684+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:55:16.451684+0000","last_peered":"2024-09-17T01:55:16.451684+0000","last_clean":"2024-09-17T01:55:16.451684+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:55:16.451684+0000","last_undegraded":"2024-09-17T01:55:16.451684+0000","last_fullsized":"2024-09-17T01:55:16.451684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749997+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:55:15.749997+0000","last_peered":"2024-09-17T01:55:15.749997+0000","last_clean":"2024-09-17T01:55:15.749997+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:55:15.749997+0000","last_undegraded":"2024-09-17T01:55:15.749997+0000","last_fullsized":"2024-09-17T01:55:15.749997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749274+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:55:15.749274+0000","last_peered":"2024-09-17T01:55:15.749274+0000","last_clean":"2024-09-17T01:55:15.749274+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:55:15.749274+0000","last_undegraded":"2024-09-17T01:55:15.749274+0000","last_fullsized":"2024-09-17T01:55:15.749274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748656+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:55:15.748656+0000","last_peered":"2024-09-17T01:55:15.748656+0000","last_clean":"2024-09-17T01:55:15.748656+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:55:15.748656+0000","last_undegraded":"2024-09-17T01:55:15.748656+0000","last_fullsized":"2024-09-17T01:55:15.748656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451114+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:55:16.451114+0000","last_peered":"2024-09-17T01:55:16.451114+0000","last_clean":"2024-09-17T01:55:16.451114+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:55:16.451114+0000","last_undegraded":"2024-09-17T01:55:16.451114+0000","last_fullsized":"2024-09-17T01:55:16.451114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453011+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:55:16.453011+0000","last_peered":"2024-09-17T01:55:16.453011+0000","last_clean":"2024-09-17T01:55:16.453011+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:55:16.453011+0000","last_undegraded":"2024-09-17T01:55:16.453011+0000","last_fullsized":"2024-09-17T01:55:16.453011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450068+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:55:16.450068+0000","last_peered":"2024-09-17T01:55:16.450068+0000","last_clean":"2024-09-17T01:55:16.450068+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:55:16.450068+0000","last_undegraded":"2024-09-17T01:55:16.450068+0000","last_fullsized":"2024-09-17T01:55:16.450068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750057+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:55:15.750057+0000","last_peered":"2024-09-17T01:55:15.750057+0000","last_clean":"2024-09-17T01:55:15.750057+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:55:15.750057+0000","last_undegraded":"2024-09-17T01:55:15.750057+0000","last_fullsized":"2024-09-17T01:55:15.750057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749489+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:55:15.749489+0000","last_peered":"2024-09-17T01:55:15.749489+0000","last_clean":"2024-09-17T01:55:15.749489+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:55:15.749489+0000","last_undegraded":"2024-09-17T01:55:15.749489+0000","last_fullsized":"2024-09-17T01:55:15.749489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451371+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:55:16.451371+0000","last_peered":"2024-09-17T01:55:16.451371+0000","last_clean":"2024-09-17T01:55:16.451371+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:55:16.451371+0000","last_undegraded":"2024-09-17T01:55:16.451371+0000","last_fullsized":"2024-09-17T01:55:16.451371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448523+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:55:16.448523+0000","last_peered":"2024-09-17T01:55:16.448523+0000","last_clean":"2024-09-17T01:55:16.448523+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:55:16.448523+0000","last_undegraded":"2024-09-17T01:55:16.448523+0000","last_fullsized":"2024-09-17T01:55:16.448523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450726+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:55:16.450726+0000","last_peered":"2024-09-17T01:55:16.450726+0000","last_clean":"2024-09-17T01:55:16.450726+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:55:16.450726+0000","last_undegraded":"2024-09-17T01:55:16.450726+0000","last_fullsized":"2024-09-17T01:55:16.450726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453189+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:55:16.453189+0000","last_peered":"2024-09-17T01:55:16.453189+0000","last_clean":"2024-09-17T01:55:16.453189+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:55:16.453189+0000","last_undegraded":"2024-09-17T01:55:16.453189+0000","last_fullsized":"2024-09-17T01:55:16.453189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450512+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:55:16.450512+0000","last_peered":"2024-09-17T01:55:16.450512+0000","last_clean":"2024-09-17T01:55:16.450512+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:55:16.450512+0000","last_undegraded":"2024-09-17T01:55:16.450512+0000","last_fullsized":"2024-09-17T01:55:16.450512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750214+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:55:15.750214+0000","last_peered":"2024-09-17T01:55:15.750214+0000","last_clean":"2024-09-17T01:55:15.750214+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:55:15.750214+0000","last_undegraded":"2024-09-17T01:55:15.750214+0000","last_fullsized":"2024-09-17T01:55:15.750214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452386+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:55:16.452386+0000","last_peered":"2024-09-17T01:55:16.452386+0000","last_clean":"2024-09-17T01:55:16.452386+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:55:16.452386+0000","last_undegraded":"2024-09-17T01:55:16.452386+0000","last_fullsized":"2024-09-17T01:55:16.452386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449563+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:55:16.449563+0000","last_peered":"2024-09-17T01:55:16.449563+0000","last_clean":"2024-09-17T01:55:16.449563+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:55:16.449563+0000","last_undegraded":"2024-09-17T01:55:16.449563+0000","last_fullsized":"2024-09-17T01:55:16.449563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451655+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:55:16.451655+0000","last_peered":"2024-09-17T01:55:16.451655+0000","last_clean":"2024-09-17T01:55:16.451655+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:55:16.451655+0000","last_undegraded":"2024-09-17T01:55:16.451655+0000","last_fullsized":"2024-09-17T01:55:16.451655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448587+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:55:16.448587+0000","last_peered":"2024-09-17T01:55:16.448587+0000","last_clean":"2024-09-17T01:55:16.448587+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:55:16.448587+0000","last_undegraded":"2024-09-17T01:55:16.448587+0000","last_fullsized":"2024-09-17T01:55:16.448587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748955+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:55:15.748955+0000","last_peered":"2024-09-17T01:55:15.748955+0000","last_clean":"2024-09-17T01:55:15.748955+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:55:15.748955+0000","last_undegraded":"2024-09-17T01:55:15.748955+0000","last_fullsized":"2024-09-17T01:55:15.748955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452354+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:55:16.452354+0000","last_peered":"2024-09-17T01:55:16.452354+0000","last_clean":"2024-09-17T01:55:16.452354+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:55:16.452354+0000","last_undegraded":"2024-09-17T01:55:16.452354+0000","last_fullsized":"2024-09-17T01:55:16.452354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749870+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:55:15.749870+0000","last_peered":"2024-09-17T01:55:15.749870+0000","last_clean":"2024-09-17T01:55:15.749870+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:55:15.749870+0000","last_undegraded":"2024-09-17T01:55:15.749870+0000","last_fullsized":"2024-09-17T01:55:15.749870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452441+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:55:16.452441+0000","last_peered":"2024-09-17T01:55:16.452441+0000","last_clean":"2024-09-17T01:55:16.452441+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:55:16.452441+0000","last_undegraded":"2024-09-17T01:55:16.452441+0000","last_fullsized":"2024-09-17T01:55:16.452441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447784+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:55:16.447784+0000","last_peered":"2024-09-17T01:55:16.447784+0000","last_clean":"2024-09-17T01:55:16.447784+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:55:16.447784+0000","last_undegraded":"2024-09-17T01:55:16.447784+0000","last_fullsized":"2024-09-17T01:55:16.447784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450810+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:55:16.450810+0000","last_peered":"2024-09-17T01:55:16.450810+0000","last_clean":"2024-09-17T01:55:16.450810+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:55:16.450810+0000","last_undegraded":"2024-09-17T01:55:16.450810+0000","last_fullsized":"2024-09-17T01:55:16.450810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450176+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:55:16.450176+0000","last_peered":"2024-09-17T01:55:16.450176+0000","last_clean":"2024-09-17T01:55:16.450176+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:55:16.450176+0000","last_undegraded":"2024-09-17T01:55:16.450176+0000","last_fullsized":"2024-09-17T01:55:16.450176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450475+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:55:16.450475+0000","last_peered":"2024-09-17T01:55:16.450475+0000","last_clean":"2024-09-17T01:55:16.450475+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:55:16.450475+0000","last_undegraded":"2024-09-17T01:55:16.450475+0000","last_fullsized":"2024-09-17T01:55:16.450475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.748961+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:55:15.748961+0000","last_peered":"2024-09-17T01:55:15.748961+0000","last_clean":"2024-09-17T01:55:15.748961+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:55:15.748961+0000","last_undegraded":"2024-09-17T01:55:15.748961+0000","last_fullsized":"2024-09-17T01:55:15.748961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750860+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:55:15.750860+0000","last_peered":"2024-09-17T01:55:15.750860+0000","last_clean":"2024-09-17T01:55:15.750860+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:55:15.750860+0000","last_undegraded":"2024-09-17T01:55:15.750860+0000","last_fullsized":"2024-09-17T01:55:15.750860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450922+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:55:16.450922+0000","last_peered":"2024-09-17T01:55:16.450922+0000","last_clean":"2024-09-17T01:55:16.450922+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:55:16.450922+0000","last_undegraded":"2024-09-17T01:55:16.450922+0000","last_fullsized":"2024-09-17T01:55:16.450922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450511+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:55:16.450511+0000","last_peered":"2024-09-17T01:55:16.450511+0000","last_clean":"2024-09-17T01:55:16.450511+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:55:16.450511+0000","last_undegraded":"2024-09-17T01:55:16.450511+0000","last_fullsized":"2024-09-17T01:55:16.450511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451213+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:55:16.451213+0000","last_peered":"2024-09-17T01:55:16.451213+0000","last_clean":"2024-09-17T01:55:16.451213+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:55:16.451213+0000","last_undegraded":"2024-09-17T01:55:16.451213+0000","last_fullsized":"2024-09-17T01:55:16.451213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751164+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:55:15.751164+0000","last_peered":"2024-09-17T01:55:15.751164+0000","last_clean":"2024-09-17T01:55:15.751164+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:55:15.751164+0000","last_undegraded":"2024-09-17T01:55:15.751164+0000","last_fullsized":"2024-09-17T01:55:15.751164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750788+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:55:15.750788+0000","last_peered":"2024-09-17T01:55:15.750788+0000","last_clean":"2024-09-17T01:55:15.750788+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:55:15.750788+0000","last_undegraded":"2024-09-17T01:55:15.750788+0000","last_fullsized":"2024-09-17T01:55:15.750788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750707+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:55:15.750707+0000","last_peered":"2024-09-17T01:55:15.750707+0000","last_clean":"2024-09-17T01:55:15.750707+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:55:15.750707+0000","last_undegraded":"2024-09-17T01:55:15.750707+0000","last_fullsized":"2024-09-17T01:55:15.750707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449332+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:55:16.449332+0000","last_peered":"2024-09-17T01:55:16.449332+0000","last_clean":"2024-09-17T01:55:16.449332+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:55:16.449332+0000","last_undegraded":"2024-09-17T01:55:16.449332+0000","last_fullsized":"2024-09-17T01:55:16.449332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447756+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:55:16.447756+0000","last_peered":"2024-09-17T01:55:16.447756+0000","last_clean":"2024-09-17T01:55:16.447756+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:55:16.447756+0000","last_undegraded":"2024-09-17T01:55:16.447756+0000","last_fullsized":"2024-09-17T01:55:16.447756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750266+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:55:15.750266+0000","last_peered":"2024-09-17T01:55:15.750266+0000","last_clean":"2024-09-17T01:55:15.750266+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:55:15.750266+0000","last_undegraded":"2024-09-17T01:55:15.750266+0000","last_fullsized":"2024-09-17T01:55:15.750266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751083+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:55:15.751083+0000","last_peered":"2024-09-17T01:55:15.751083+0000","last_clean":"2024-09-17T01:55:15.751083+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:55:15.751083+0000","last_undegraded":"2024-09-17T01:55:15.751083+0000","last_fullsized":"2024-09-17T01:55:15.751083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750618+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:55:15.750618+0000","last_peered":"2024-09-17T01:55:15.750618+0000","last_clean":"2024-09-17T01:55:15.750618+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:55:15.750618+0000","last_undegraded":"2024-09-17T01:55:15.750618+0000","last_fullsized":"2024-09-17T01:55:15.750618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450147+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:55:16.450147+0000","last_peered":"2024-09-17T01:55:16.450147+0000","last_clean":"2024-09-17T01:55:16.450147+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:55:16.450147+0000","last_undegraded":"2024-09-17T01:55:16.450147+0000","last_fullsized":"2024-09-17T01:55:16.450147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750840+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:55:15.750840+0000","last_peered":"2024-09-17T01:55:15.750840+0000","last_clean":"2024-09-17T01:55:15.750840+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:55:15.750840+0000","last_undegraded":"2024-09-17T01:55:15.750840+0000","last_fullsized":"2024-09-17T01:55:15.750840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450969+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:55:16.450969+0000","last_peered":"2024-09-17T01:55:16.450969+0000","last_clean":"2024-09-17T01:55:16.450969+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:55:16.450969+0000","last_undegraded":"2024-09-17T01:55:16.450969+0000","last_fullsized":"2024-09-17T01:55:16.450969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450799+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:55:16.450799+0000","last_peered":"2024-09-17T01:55:16.450799+0000","last_clean":"2024-09-17T01:55:16.450799+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:55:16.450799+0000","last_undegraded":"2024-09-17T01:55:16.450799+0000","last_fullsized":"2024-09-17T01:55:16.450799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749906+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:55:15.749906+0000","last_peered":"2024-09-17T01:55:15.749906+0000","last_clean":"2024-09-17T01:55:15.749906+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:55:15.749906+0000","last_undegraded":"2024-09-17T01:55:15.749906+0000","last_fullsized":"2024-09-17T01:55:15.749906+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750183+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:55:15.750183+0000","last_peered":"2024-09-17T01:55:15.750183+0000","last_clean":"2024-09-17T01:55:15.750183+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:55:15.750183+0000","last_undegraded":"2024-09-17T01:55:15.750183+0000","last_fullsized":"2024-09-17T01:55:15.750183+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449926+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:55:16.449926+0000","last_peered":"2024-09-17T01:55:16.449926+0000","last_clean":"2024-09-17T01:55:16.449926+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:55:16.449926+0000","last_undegraded":"2024-09-17T01:55:16.449926+0000","last_fullsized":"2024-09-17T01:55:16.449926+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750880+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:55:15.750880+0000","last_peered":"2024-09-17T01:55:15.750880+0000","last_clean":"2024-09-17T01:55:15.750880+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:55:15.750880+0000","last_undegraded":"2024-09-17T01:55:15.750880+0000","last_fullsized":"2024-09-17T01:55:15.750880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749636+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:55:15.749636+0000","last_peered":"2024-09-17T01:55:15.749636+0000","last_clean":"2024-09-17T01:55:15.749636+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:55:15.749636+0000","last_undegraded":"2024-09-17T01:55:15.749636+0000","last_fullsized":"2024-09-17T01:55:15.749636+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447683+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:55:16.447683+0000","last_peered":"2024-09-17T01:55:16.447683+0000","last_clean":"2024-09-17T01:55:16.447683+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:55:16.447683+0000","last_undegraded":"2024-09-17T01:55:16.447683+0000","last_fullsized":"2024-09-17T01:55:16.447683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452738+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:55:16.452738+0000","last_peered":"2024-09-17T01:55:16.452738+0000","last_clean":"2024-09-17T01:55:16.452738+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:55:16.452738+0000","last_undegraded":"2024-09-17T01:55:16.452738+0000","last_fullsized":"2024-09-17T01:55:16.452738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449280+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:55:16.449280+0000","last_peered":"2024-09-17T01:55:16.449280+0000","last_clean":"2024-09-17T01:55:16.449280+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:55:16.449280+0000","last_undegraded":"2024-09-17T01:55:16.449280+0000","last_fullsized":"2024-09-17T01:55:16.449280+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450120+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:55:16.450120+0000","last_peered":"2024-09-17T01:55:16.450120+0000","last_clean":"2024-09-17T01:55:16.450120+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:55:16.450120+0000","last_undegraded":"2024-09-17T01:55:16.450120+0000","last_fullsized":"2024-09-17T01:55:16.450120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450809+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:55:16.450809+0000","last_peered":"2024-09-17T01:55:16.450809+0000","last_clean":"2024-09-17T01:55:16.450809+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:55:16.450809+0000","last_undegraded":"2024-09-17T01:55:16.450809+0000","last_fullsized":"2024-09-17T01:55:16.450809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751206+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:55:15.751206+0000","last_peered":"2024-09-17T01:55:15.751206+0000","last_clean":"2024-09-17T01:55:15.751206+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:55:15.751206+0000","last_undegraded":"2024-09-17T01:55:15.751206+0000","last_fullsized":"2024-09-17T01:55:15.751206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750057+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:55:15.750057+0000","last_peered":"2024-09-17T01:55:15.750057+0000","last_clean":"2024-09-17T01:55:15.750057+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:55:15.750057+0000","last_undegraded":"2024-09-17T01:55:15.750057+0000","last_fullsized":"2024-09-17T01:55:15.750057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449738+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:55:16.449738+0000","last_peered":"2024-09-17T01:55:16.449738+0000","last_clean":"2024-09-17T01:55:16.449738+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:55:16.449738+0000","last_undegraded":"2024-09-17T01:55:16.449738+0000","last_fullsized":"2024-09-17T01:55:16.449738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751156+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:55:15.751156+0000","last_peered":"2024-09-17T01:55:15.751156+0000","last_clean":"2024-09-17T01:55:15.751156+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:55:15.751156+0000","last_undegraded":"2024-09-17T01:55:15.751156+0000","last_fullsized":"2024-09-17T01:55:15.751156+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450074+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:55:16.450074+0000","last_peered":"2024-09-17T01:55:16.450074+0000","last_clean":"2024-09-17T01:55:16.450074+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:55:16.450074+0000","last_undegraded":"2024-09-17T01:55:16.450074+0000","last_fullsized":"2024-09-17T01:55:16.450074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451642+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:55:16.451642+0000","last_peered":"2024-09-17T01:55:16.451642+0000","last_clean":"2024-09-17T01:55:16.451642+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:55:16.451642+0000","last_undegraded":"2024-09-17T01:55:16.451642+0000","last_fullsized":"2024-09-17T01:55:16.451642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449908+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:55:16.449908+0000","last_peered":"2024-09-17T01:55:16.449908+0000","last_clean":"2024-09-17T01:55:16.449908+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:55:16.449908+0000","last_undegraded":"2024-09-17T01:55:16.449908+0000","last_fullsized":"2024-09-17T01:55:16.449908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452852+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:55:16.452852+0000","last_peered":"2024-09-17T01:55:16.452852+0000","last_clean":"2024-09-17T01:55:16.452852+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:55:16.452852+0000","last_undegraded":"2024-09-17T01:55:16.452852+0000","last_fullsized":"2024-09-17T01:55:16.452852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451745+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:55:16.451745+0000","last_peered":"2024-09-17T01:55:16.451745+0000","last_clean":"2024-09-17T01:55:16.451745+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:55:16.451745+0000","last_undegraded":"2024-09-17T01:55:16.451745+0000","last_fullsized":"2024-09-17T01:55:16.451745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451216+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:55:16.451216+0000","last_peered":"2024-09-17T01:55:16.451216+0000","last_clean":"2024-09-17T01:55:16.451216+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:55:16.451216+0000","last_undegraded":"2024-09-17T01:55:16.451216+0000","last_fullsized":"2024-09-17T01:55:16.451216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450973+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:55:16.450973+0000","last_peered":"2024-09-17T01:55:16.450973+0000","last_clean":"2024-09-17T01:55:16.450973+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:55:16.450973+0000","last_undegraded":"2024-09-17T01:55:16.450973+0000","last_fullsized":"2024-09-17T01:55:16.450973+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449241+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:55:16.449241+0000","last_peered":"2024-09-17T01:55:16.449241+0000","last_clean":"2024-09-17T01:55:16.449241+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:55:16.449241+0000","last_undegraded":"2024-09-17T01:55:16.449241+0000","last_fullsized":"2024-09-17T01:55:16.449241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448348+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:55:16.448348+0000","last_peered":"2024-09-17T01:55:16.448348+0000","last_clean":"2024-09-17T01:55:16.448348+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:55:16.448348+0000","last_undegraded":"2024-09-17T01:55:16.448348+0000","last_fullsized":"2024-09-17T01:55:16.448348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751083+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:55:15.751083+0000","last_peered":"2024-09-17T01:55:15.751083+0000","last_clean":"2024-09-17T01:55:15.751083+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:55:15.751083+0000","last_undegraded":"2024-09-17T01:55:15.751083+0000","last_fullsized":"2024-09-17T01:55:15.751083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451181+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:55:16.451181+0000","last_peered":"2024-09-17T01:55:16.451181+0000","last_clean":"2024-09-17T01:55:16.451181+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:55:16.451181+0000","last_undegraded":"2024-09-17T01:55:16.451181+0000","last_fullsized":"2024-09-17T01:55:16.451181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749752+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:55:15.749752+0000","last_peered":"2024-09-17T01:55:15.749752+0000","last_clean":"2024-09-17T01:55:15.749752+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:55:15.749752+0000","last_undegraded":"2024-09-17T01:55:15.749752+0000","last_fullsized":"2024-09-17T01:55:15.749752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750544+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:55:15.750544+0000","last_peered":"2024-09-17T01:55:15.750544+0000","last_clean":"2024-09-17T01:55:15.750544+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:55:15.750544+0000","last_undegraded":"2024-09-17T01:55:15.750544+0000","last_fullsized":"2024-09-17T01:55:15.750544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448838+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:55:16.448838+0000","last_peered":"2024-09-17T01:55:16.448838+0000","last_clean":"2024-09-17T01:55:16.448838+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:55:16.448838+0000","last_undegraded":"2024-09-17T01:55:16.448838+0000","last_fullsized":"2024-09-17T01:55:16.448838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450456+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:55:16.450456+0000","last_peered":"2024-09-17T01:55:16.450456+0000","last_clean":"2024-09-17T01:55:16.450456+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:55:16.450456+0000","last_undegraded":"2024-09-17T01:55:16.450456+0000","last_fullsized":"2024-09-17T01:55:16.450456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.751146+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:55:15.751146+0000","last_peered":"2024-09-17T01:55:15.751146+0000","last_clean":"2024-09-17T01:55:15.751146+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:55:15.751146+0000","last_undegraded":"2024-09-17T01:55:15.751146+0000","last_fullsized":"2024-09-17T01:55:15.751146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449147+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:55:16.449147+0000","last_peered":"2024-09-17T01:55:16.449147+0000","last_clean":"2024-09-17T01:55:16.449147+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:55:16.449147+0000","last_undegraded":"2024-09-17T01:55:16.449147+0000","last_fullsized":"2024-09-17T01:55:16.449147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448157+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:55:16.448157+0000","last_peered":"2024-09-17T01:55:16.448157+0000","last_clean":"2024-09-17T01:55:16.448157+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:55:16.448157+0000","last_undegraded":"2024-09-17T01:55:16.448157+0000","last_fullsized":"2024-09-17T01:55:16.448157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449152+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:55:16.449152+0000","last_peered":"2024-09-17T01:55:16.449152+0000","last_clean":"2024-09-17T01:55:16.449152+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:55:16.449152+0000","last_undegraded":"2024-09-17T01:55:16.449152+0000","last_fullsized":"2024-09-17T01:55:16.449152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.453334+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:55:16.453334+0000","last_peered":"2024-09-17T01:55:16.453334+0000","last_clean":"2024-09-17T01:55:16.453334+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:55:16.453334+0000","last_undegraded":"2024-09-17T01:55:16.453334+0000","last_fullsized":"2024-09-17T01:55:16.453334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.449729+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:55:16.449729+0000","last_peered":"2024-09-17T01:55:16.449729+0000","last_clean":"2024-09-17T01:55:16.449729+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:55:16.449729+0000","last_undegraded":"2024-09-17T01:55:16.449729+0000","last_fullsized":"2024-09-17T01:55:16.449729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450403+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:55:16.450403+0000","last_peered":"2024-09-17T01:55:16.450403+0000","last_clean":"2024-09-17T01:55:16.450403+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:55:16.450403+0000","last_undegraded":"2024-09-17T01:55:16.450403+0000","last_fullsized":"2024-09-17T01:55:16.450403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.447710+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:55:16.447710+0000","last_peered":"2024-09-17T01:55:16.447710+0000","last_clean":"2024-09-17T01:55:16.447710+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:55:16.447710+0000","last_undegraded":"2024-09-17T01:55:16.447710+0000","last_fullsized":"2024-09-17T01:55:16.447710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452346+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:55:16.452346+0000","last_peered":"2024-09-17T01:55:16.452346+0000","last_clean":"2024-09-17T01:55:16.452346+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:55:16.452346+0000","last_undegraded":"2024-09-17T01:55:16.452346+0000","last_fullsized":"2024-09-17T01:55:16.452346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451915+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:55:16.451915+0000","last_peered":"2024-09-17T01:55:16.451915+0000","last_clean":"2024-09-17T01:55:16.451915+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:55:16.451915+0000","last_undegraded":"2024-09-17T01:55:16.451915+0000","last_fullsized":"2024-09-17T01:55:16.451915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.452120+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:55:16.452120+0000","last_peered":"2024-09-17T01:55:16.452120+0000","last_clean":"2024-09-17T01:55:16.452120+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:55:16.452120+0000","last_undegraded":"2024-09-17T01:55:16.452120+0000","last_fullsized":"2024-09-17T01:55:16.452120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450194+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:55:16.450194+0000","last_peered":"2024-09-17T01:55:16.450194+0000","last_clean":"2024-09-17T01:55:16.450194+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:55:16.450194+0000","last_undegraded":"2024-09-17T01:55:16.450194+0000","last_fullsized":"2024-09-17T01:55:16.450194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749598+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:55:15.749598+0000","last_peered":"2024-09-17T01:55:15.749598+0000","last_clean":"2024-09-17T01:55:15.749598+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:55:15.749598+0000","last_undegraded":"2024-09-17T01:55:15.749598+0000","last_fullsized":"2024-09-17T01:55:15.749598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.750344+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:55:15.750344+0000","last_peered":"2024-09-17T01:55:15.750344+0000","last_clean":"2024-09-17T01:55:15.750344+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:55:15.750344+0000","last_undegraded":"2024-09-17T01:55:15.750344+0000","last_fullsized":"2024-09-17T01:55:15.750344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749750+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:55:15.749750+0000","last_peered":"2024-09-17T01:55:15.749750+0000","last_clean":"2024-09-17T01:55:15.749750+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:55:15.749750+0000","last_undegraded":"2024-09-17T01:55:15.749750+0000","last_fullsized":"2024-09-17T01:55:15.749750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450612+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:55:16.450612+0000","last_peered":"2024-09-17T01:55:16.450612+0000","last_clean":"2024-09-17T01:55:16.450612+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:55:16.450612+0000","last_undegraded":"2024-09-17T01:55:16.450612+0000","last_fullsized":"2024-09-17T01:55:16.450612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.451571+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:55:16.451571+0000","last_peered":"2024-09-17T01:55:16.451571+0000","last_clean":"2024-09-17T01:55:16.451571+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:55:16.451571+0000","last_undegraded":"2024-09-17T01:55:16.451571+0000","last_fullsized":"2024-09-17T01:55:16.451571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.450807+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:55:16.450807+0000","last_peered":"2024-09-17T01:55:16.450807+0000","last_clean":"2024-09-17T01:55:16.450807+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:55:16.450807+0000","last_undegraded":"2024-09-17T01:55:16.450807+0000","last_fullsized":"2024-09-17T01:55:16.450807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:15.749237+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:55:15.749237+0000","last_peered":"2024-09-17T01:55:15.749237+0000","last_clean":"2024-09-17T01:55:15.749237+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:55:15.749237+0000","last_undegraded":"2024-09-17T01:55:15.749237+0000","last_fullsized":"2024-09-17T01:55:15.749237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-17T01:55:16.448464+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:55:16.448464+0000","last_peered":"2024-09-17T01:55:16.448464+0000","last_clean":"2024-09-17T01:55:16.448464+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:55:16.448464+0000","last_undegraded":"2024-09-17T01:55:16.448464+0000","last_fullsized":"2024-09-17T01:55:16.448464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":690542,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":307200,"data_stored":685683,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":93437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:55:20.567 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T01:55:20.567 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:20.567 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T01:55:20.567 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T01:55:20.656 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:20.655+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:20.693 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:20.693 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:20.693 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:20.693 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:20.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:20.757 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:20.755+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:20.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:55:20.828 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:20.829 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:20.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:20.858 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:20.855+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 30, 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-17T01:54:21.836260+0000", 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-17T01:55:19.776226+0000", 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-17T01:54:31.869613+0000", 2024-09-17T01:55:20.921 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-17T01:54:23.678756+0000", 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5804032, 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "nodeep-scrub", 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2024-09-17T01:55:20.922 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 3, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-17T01:55:20.923 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:32.050776+0000", 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:20.925 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "11", 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:20.926 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:20.927 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:20.928 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:20.929 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 2.9900000095367432, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 2.9900000095367432, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.930 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:38.032150+0000", 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2024-09-17T01:55:20.932 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2024-09-17T01:55:20.933 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 2, 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 15, 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:20.934 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:20.935 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:20.936 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:20.937 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.055353+0000", 2024-09-17T01:55:20.938 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:20.940 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:20.941 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:20.942 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:20.943 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:55:20.944 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:20.945 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.558395+0000", 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-17T01:55:20.947 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "19", 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:20.949 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:20.950 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T01:55:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:55:20.952 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:55:20.953 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "321981a6-5caa-44f3-b6ae-aa4e97947db6", 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.954 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6800", 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6801", 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:20.955 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6802", 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6803", 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6806", 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6807", 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.957 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6804", 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6805", 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.958 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.96:6801/1783419646", 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.96:6803/1783419646", 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.96:6807/1783419646", 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.96:6805/1783419646", 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:55:20.959 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "36930e57-781c-48b6-a499-40cb00df2f38", 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6800", 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6801", 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.961 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6802", 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6803", 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6806", 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6807", 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6804", 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6805", 2024-09-17T01:55:20.964 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.98:6801/3191117572", 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.98:6803/3191117572", 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3191117572", 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3191117572", 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.965 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5a5a5a07-1fcd-4160-a4b1-e8431052e44c", 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6800", 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6801", 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6802", 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6803", 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:20.968 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6806", 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6807", 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.969 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6804", 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6805", 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.154:6801/495067980", 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.154:6803/495067980", 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.154:6807/495067980", 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.154:6805/495067980", 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:55:20.971 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.631084+0000", 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:20.972 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.623706+0000", 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.711322+0000", 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.973 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-17T01:55:20.974 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-17T01:55:20.975 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-17T01:55:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:20.976 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:55:20.977 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.696604571000002, 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:20.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:20.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:20.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.696565952, 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:20.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:20.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:20.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:20.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:20.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.696528364999999, 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:20.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:20.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:20.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:20.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.696376846, 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:20.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:20.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:20.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:21.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.696340526999997, 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:21.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:21.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.525189920999999, 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.008 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:21.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:21.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:21.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.525124175000002, 2024-09-17T01:55:21.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:21.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:21.020 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.525004496000001, 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:21.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.524967226000001, 2024-09-17T01:55:21.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:21.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.032 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.524904503000002, 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:21.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.524787607, 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.039 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:21.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:21.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.184885518000002, 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:21.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:21.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.184732715999999, 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:21.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:21.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.184510770999999, 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:21.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:21.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:21.063 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.184435307999998, 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:21.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.184352961999998, 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:21.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:21.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.184066178000002, 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:21.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.183976581000003, 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.082 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:21.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:21.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.183864049, 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:21.088 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:21.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:21.094 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.183607084000002, 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:21.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:21.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:21.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.100 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:21.101 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:21.101 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:21.101 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:20.981+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:21.104 INFO:tasks.thrashosds.thrasher:j is {'epoch': 30, 'fsid': '7af2c608-be6c-4ac4-a462-cff6aa13e357', 'created': '2024-09-17T01:54:21.836260+0000', 'modified': '2024-09-17T01:55:19.776226+0000', 'last_up_change': '2024-09-17T01:54:31.869613+0000', 'last_in_change': '2024-09-17T01:54:23.678756+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:54:32.050776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T01:54:38.032150+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T01:54:43.055353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T01:54:43.558395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '321981a6-5caa-44f3-b6ae-aa4e97947db6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6800', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6801', 'nonce': 1783419646}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 1783419646}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6806', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6807', 'nonce': 1783419646}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6804', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6805', 'nonce': 1783419646}]}, 'public_addr': '172.21.15.96:6801/1783419646', 'cluster_addr': '172.21.15.96:6803/1783419646', 'heartbeat_back_addr': '172.21.15.96:6807/1783419646', 'heartbeat_front_addr': '172.21.15.96:6805/1783419646', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '36930e57-781c-48b6-a499-40cb00df2f38', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3191117572}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3191117572}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3191117572}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3191117572}]}, 'public_addr': '172.21.15.98:6801/3191117572', 'cluster_addr': '172.21.15.98:6803/3191117572', 'heartbeat_back_addr': '172.21.15.98:6807/3191117572', 'heartbeat_front_addr': '172.21.15.98:6805/3191117572', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5a5a5a07-1fcd-4160-a4b1-e8431052e44c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 495067980}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 495067980}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 495067980}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 495067980}]}, 'public_addr': '172.21.15.154:6801/495067980', 'cluster_addr': '172.21.15.154:6803/495067980', 'heartbeat_back_addr': '172.21.15.154:6807/495067980', 'heartbeat_front_addr': '172.21.15.154:6805/495067980', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.631084+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.623706+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.711322+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T01:55:21.104 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-17T01:55:21.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:21.107 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:21.113+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:21.208 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:21.213+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:21.235 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:21.235 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:21.235 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:21.235 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:21.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:21.309 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:21.307+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:21.411 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:21.417+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:21.416 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:21.416 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:21.416 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:21.416 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:21.416 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:21.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:21.522 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:21.529+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.582536916000002, 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.606 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:21.610 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 40.570451628999997, 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:21.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.614 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.559585544999997, 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:21.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400816603000003, 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.619 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:21.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400716836999997, 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:21.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400673040999997, 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.630 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:21.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:21.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:21.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400595125000002, 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:21.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:21.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.641 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400513259, 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:21.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:21.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:21.647 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400462509, 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.652 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400401703, 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:21.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:21.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400311770000002, 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:21.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:21.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.400252113999997, 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:21.661 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:21.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.398740682000003, 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:21.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.397834105999998, 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:21.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:21.674 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.397689063999998, 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.395926723999999, 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.679 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:21.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 36.395818071999997, 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.684 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:21.688 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 34.401456283000002, 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:21.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 17.399287752999999, 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:21.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:21.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:21.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 12.398614352999999, 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:21.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:21.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:21.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:21.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:21.706 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:21.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:21.708 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:21.713+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:21.799 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:55:21.809 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:21.813+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:21.834 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:21.834 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:21.834 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:21.834 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:21.849 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:21.910 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:21.917+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:21.970 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:21.971 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:21.985 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:22.032 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:22.031+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:22.108 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.014203434000002, 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.658297730999998, 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.488634157999996, 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.487836950999998, 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.487279628000003, 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.486737652000002, 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.485744447000002, 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.485184031000003, 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.484702458000001, 2024-09-17T01:55:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.314799258999997, 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.313728861000001, 2024-09-17T01:55:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.309920384000002, 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903502715000002, 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:22.171 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903398709999998, 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:22.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:22.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903297651000003, 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:22.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:22.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903190537999997, 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903127472000001, 2024-09-17T01:55:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903069088999999, 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.903001332999999, 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:22.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:22.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.902935403000001, 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:22.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:22.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:22.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:22.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.210 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:22.210 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:22.210 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:22.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:22.212 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:22.217+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:22.312 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:22.317+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:22.343 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:22.343 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:22.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:22.413 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:22.411+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:22.476 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:22.476 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:22.476 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:22.476 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:22.476 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:22.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:22.514 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:22.515+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:22.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:22.615 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.343541035000001, 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.343502416, 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.343464828999998, 2024-09-17T01:55:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.343313309999999, 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.343276991000003, 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.172126384999999, 2024-09-17T01:55:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.172060639000001, 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:22.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:22.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.171940960000001, 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.171903690000001, 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.171840967000001, 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.171724071, 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.831821982000001, 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.831669179999999, 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.831447234999999, 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.831371771999997, 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.831289425999998, 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.831002642000001, 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.830913045000003, 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.830800513, 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.830543548000001, 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:22.733 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:22.734 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:22.735 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:22.621+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:22.735 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:22.736 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:22.736 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:22.736 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:22.737 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:22.741+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:22.744 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:22.744 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:22.836 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:22.841+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:22.871 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:22.871 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:22.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:22.937 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:22.941+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:23.038 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:23.041+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.053 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:23.158 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:23.165+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:23.235 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.235 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.240 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:23.245+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:23.249 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:23.340 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:23.345+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:23.380 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.381 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.394 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:23.441 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:23.439+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:23.515 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.516 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:23.541 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:23.545+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:23.642 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:23.649+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:23.694 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.694 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:23.743 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:23.749+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:23.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:55:23.840 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.840 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.844 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:23.839+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:23.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:23.945 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:23.943+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:23.976 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:23.977 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:23.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:24.045 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:24.048+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:24.110 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:24.110 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:24.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:24.147 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:24.143+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:24.248 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:24.247+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:24.259 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:24.259 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:24.273 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:24.348 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:24.353+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:24.390 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:24.390 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:24.405 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:24.449 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:24.447+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:24.550 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:24.557+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:24.569 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:24.569 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:24.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:24.651 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:24.647+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:24.718 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:24.718 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:24.732 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:24.752 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:24.757+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:24.763 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:24.853 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:24.851+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:24.900 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:24.901 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:24.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:24.916 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:24.916 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:24.937 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:24.937 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:24.953 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:24.960+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:24.957 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:24.957 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:25.048 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:55:25.055 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:25.061+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:25.081 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.988797665, 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.632891962000002, 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.463228389000001, 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.462431182000003, 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.461873859000001, 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.461331883, 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.460338677999999, 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.459778262, 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.459296688999999, 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.289393490000002, 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.288323091999999, 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.284514614999999, 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.878096945999999, 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877992941000002, 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877891882, 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877784769000002, 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877721702999999, 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877663320000003, 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877595564000003, 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.877529633999998, 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:25.202 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:25.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:25.204 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:25.209+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:25.305 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:25.303+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:25.335 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:25.335 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:25.335 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:25.335 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:25.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:25.406 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:25.412+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:25.468 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:25.468 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:25.468 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:25.468 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:25.468 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:25.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:25.506 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:25.503+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:25.609 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:25.607+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:25.652 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:25.652 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:25.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.380757371000001, 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.653 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:25.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:25.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.380718752, 2024-09-17T01:55:25.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.660 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:25.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:25.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.380681164999999, 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:25.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.380529645999999, 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.672 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:25.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:25.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.380493327000003, 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.679 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:25.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:25.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:25.685 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.209342720999999, 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:25.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.209276975000002, 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:25.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:25.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:25.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.209157296000001, 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:25.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:25.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:25.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:25.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.209120026000001, 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:25.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:25.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.209057303000002, 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:25.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.716 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.208940407, 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:25.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:25.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:25.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.722 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.869038318000001, 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:25.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:25.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:25.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868885515999999, 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868663570999999, 2024-09-17T01:55:25.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:25.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:25.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868588107999997, 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:25.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868505761999998, 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.746 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:25.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868218978000002, 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:25.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:25.757 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868129381000003, 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.868016849, 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:25.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:25.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.867759884000002, 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:25.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:25.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:25.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:25.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:25.775 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:25.777 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:25.784+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:25.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:25.878 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:25.881+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:25.908 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:25.908 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:25.908 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:25.908 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:25.922 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:25.978 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:25.979+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:26.079 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:26.079+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:26.090 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:26.090 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:26.090 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:26.106 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:26.106 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:26.106 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:26.106 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T01:55:26.106 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T01:55:26.181 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:26.184+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:26.233 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:26.234 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:26.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:26.234 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:26.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.234 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:26.235 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:26.235 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 46.209409065999999, 2024-09-17T01:55:26.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:26.235 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.236 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.236 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:26.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:26.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:26.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:26.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:26.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:26.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:26.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:26.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:26.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:26.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:26.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:26.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:26.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:26.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:26.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:26.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:26.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:26.245 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.245 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.245 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.246 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:26.246 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:26.246 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.197323779000001, 2024-09-17T01:55:26.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:26.246 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.247 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.247 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:26.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:26.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:26.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:26.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:26.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:26.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:26.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:26.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:26.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:26.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:26.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:26.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:26.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:26.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:26.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:26.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:26.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:26.256 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.256 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.256 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.257 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:26.257 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:26.257 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 44.186457695000001, 2024-09-17T01:55:26.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:26.258 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.258 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.258 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.258 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:26.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:26.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:26.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:26.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:26.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:26.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:26.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:26.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:26.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:26.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:26.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:26.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:26.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:26.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:26.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:26.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:26.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:26.267 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.267 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.267 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.268 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.268 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:26.268 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027688753, 2024-09-17T01:55:26.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:26.268 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.269 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.269 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.269 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:26.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:26.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:26.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:26.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:26.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:26.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027588987000001, 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:26.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027545191000002, 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:26.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.288 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027467274999999, 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:26.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:26.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027385408999997, 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027334658999997, 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.299 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.304 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027273852999997, 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:26.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:26.308 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027183919999999, 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:26.309 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.027124264000001, 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.313 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:26.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.025612832, 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:26.317 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:26.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.024706256000002, 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:26.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.325 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.024561214000002, 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.326 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:26.329 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.022798874000003, 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.330 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 41.022690222000001, 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:26.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:26.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.338 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.028328432999999, 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:26.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:26.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.026159903, 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:26.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:26.350 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 17.025486503, 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:26.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:26.352 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.355 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.356 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.356 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:26.356 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:26.356 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:26.357 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:26.358 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:26.364+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 32, 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-17T01:54:21.836260+0000", 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-17T01:55:25.036983+0000", 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-17T01:54:31.869613+0000", 2024-09-17T01:55:26.416 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-17T01:54:23.678756+0000", 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5801984, 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "noscrub", 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T01:55:26.417 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 3, 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:32.050776+0000", 2024-09-17T01:55:26.418 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:26.419 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.420 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "11", 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:26.421 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:26.422 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:26.422 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:26.424 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:26.425 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 2.9900000095367432, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 2.9900000095367432, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:55:26.426 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:38.032150+0000", 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T01:55:26.427 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2024-09-17T01:55:26.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:26.429 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 2, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 15, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:26.430 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:26.431 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-17T01:55:26.432 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.055353+0000", 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:26.433 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-17T01:55:26.434 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:26.435 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:26.436 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:26.437 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-17T01:55:26.438 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.558395+0000", 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:26.440 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:26.441 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "19", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:26.442 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:26.443 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:26.444 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:26.445 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.446 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "321981a6-5caa-44f3-b6ae-aa4e97947db6", 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6800", 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6801", 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.448 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6802", 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6803", 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6806", 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6807", 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6804", 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6805", 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.451 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.96:6801/1783419646", 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.96:6803/1783419646", 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.96:6807/1783419646", 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.96:6805/1783419646", 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "36930e57-781c-48b6-a499-40cb00df2f38", 2024-09-17T01:55:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.453 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6800", 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6801", 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6802", 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6803", 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.455 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6806", 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6807", 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.456 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6804", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6805", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.98:6801/3191117572", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.98:6803/3191117572", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3191117572", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3191117572", 2024-09-17T01:55:26.457 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5a5a5a07-1fcd-4160-a4b1-e8431052e44c", 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6800", 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6801", 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6802", 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6803", 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.460 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6806", 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6807", 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6804", 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6805", 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.154:6801/495067980", 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.154:6803/495067980", 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.154:6807/495067980", 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.154:6805/495067980", 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:26.463 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.631084+0000", 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.623706+0000", 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.711322+0000", 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-17T01:55:26.465 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-17T01:55:26.466 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:26.467 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:55:26.469 INFO:tasks.thrashosds.thrasher:j is {'epoch': 32, 'fsid': '7af2c608-be6c-4ac4-a462-cff6aa13e357', 'created': '2024-09-17T01:54:21.836260+0000', 'modified': '2024-09-17T01:55:25.036983+0000', 'last_up_change': '2024-09-17T01:54:31.869613+0000', 'last_in_change': '2024-09-17T01:54:23.678756+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:54:32.050776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T01:54:38.032150+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T01:54:43.055353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T01:54:43.558395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '321981a6-5caa-44f3-b6ae-aa4e97947db6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6800', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6801', 'nonce': 1783419646}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 1783419646}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6806', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6807', 'nonce': 1783419646}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6804', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6805', 'nonce': 1783419646}]}, 'public_addr': '172.21.15.96:6801/1783419646', 'cluster_addr': '172.21.15.96:6803/1783419646', 'heartbeat_back_addr': '172.21.15.96:6807/1783419646', 'heartbeat_front_addr': '172.21.15.96:6805/1783419646', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '36930e57-781c-48b6-a499-40cb00df2f38', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3191117572}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3191117572}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3191117572}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3191117572}]}, 'public_addr': '172.21.15.98:6801/3191117572', 'cluster_addr': '172.21.15.98:6803/3191117572', 'heartbeat_back_addr': '172.21.15.98:6807/3191117572', 'heartbeat_front_addr': '172.21.15.98:6805/3191117572', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5a5a5a07-1fcd-4160-a4b1-e8431052e44c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 495067980}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 495067980}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 495067980}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 495067980}]}, 'public_addr': '172.21.15.154:6801/495067980', 'cluster_addr': '172.21.15.154:6803/495067980', 'heartbeat_back_addr': '172.21.15.154:6807/495067980', 'heartbeat_front_addr': '172.21.15.154:6805/495067980', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.631084+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.623706+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.711322+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T01:55:26.469 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:55:26.470 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:26.476+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:26.489 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:26.489 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:26.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:26.569 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:26.567+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:26.624 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:26.624 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:26.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:26.680 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:26.679+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:26.770 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:26.767+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:26.772 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:55:26.792 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-17T01:55:25.984637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90352,"kb_used_data":936,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025168,"statfs":{"total":289910292480,"available":289817772032,"internally_reserved":0,"allocated":958464,"data_stored":1511974,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.203684"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419272+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:55:20.419272+0000","last_peered":"2024-09-17T01:55:20.419272+0000","last_clean":"2024-09-17T01:55:20.419272+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:55:20.419272+0000","last_undegraded":"2024-09-17T01:55:20.419272+0000","last_fullsized":"2024-09-17T01:55:20.419272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418490+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:55:20.418490+0000","last_peered":"2024-09-17T01:55:20.418490+0000","last_clean":"2024-09-17T01:55:20.418490+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:55:20.418490+0000","last_undegraded":"2024-09-17T01:55:20.418490+0000","last_fullsized":"2024-09-17T01:55:20.418490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808947+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:55:21.808947+0000","last_peered":"2024-09-17T01:55:21.808947+0000","last_clean":"2024-09-17T01:55:21.808947+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:55:21.808947+0000","last_undegraded":"2024-09-17T01:55:21.808947+0000","last_fullsized":"2024-09-17T01:55:21.808947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808594+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:55:21.808594+0000","last_peered":"2024-09-17T01:55:21.808594+0000","last_clean":"2024-09-17T01:55:21.808594+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:55:21.808594+0000","last_undegraded":"2024-09-17T01:55:21.808594+0000","last_fullsized":"2024-09-17T01:55:21.808594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417848+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:55:20.417848+0000","last_peered":"2024-09-17T01:55:20.417848+0000","last_clean":"2024-09-17T01:55:20.417848+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:55:20.417848+0000","last_undegraded":"2024-09-17T01:55:20.417848+0000","last_fullsized":"2024-09-17T01:55:20.417848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.807974+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:55:21.807974+0000","last_peered":"2024-09-17T01:55:21.807974+0000","last_clean":"2024-09-17T01:55:21.807974+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:55:21.807974+0000","last_undegraded":"2024-09-17T01:55:21.807974+0000","last_fullsized":"2024-09-17T01:55:21.807974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808059+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:55:21.808059+0000","last_peered":"2024-09-17T01:55:21.808059+0000","last_clean":"2024-09-17T01:55:21.808059+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:55:21.808059+0000","last_undegraded":"2024-09-17T01:55:21.808059+0000","last_fullsized":"2024-09-17T01:55:21.808059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.807462+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:55:21.807462+0000","last_peered":"2024-09-17T01:55:21.807462+0000","last_clean":"2024-09-17T01:55:21.807462+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:55:21.807462+0000","last_undegraded":"2024-09-17T01:55:21.807462+0000","last_fullsized":"2024-09-17T01:55:21.807462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792311+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:55:19.792311+0000","last_peered":"2024-09-17T01:55:19.792311+0000","last_clean":"2024-09-17T01:55:19.792311+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:55:19.792311+0000","last_undegraded":"2024-09-17T01:55:19.792311+0000","last_fullsized":"2024-09-17T01:55:19.792311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418884+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:55:20.418884+0000","last_peered":"2024-09-17T01:55:20.418884+0000","last_clean":"2024-09-17T01:55:20.418884+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:55:20.418884+0000","last_undegraded":"2024-09-17T01:55:20.418884+0000","last_fullsized":"2024-09-17T01:55:20.418884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809223+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:55:21.809223+0000","last_peered":"2024-09-17T01:55:21.809223+0000","last_clean":"2024-09-17T01:55:21.809223+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:55:21.809223+0000","last_undegraded":"2024-09-17T01:55:21.809223+0000","last_fullsized":"2024-09-17T01:55:21.809223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418420+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:55:20.418420+0000","last_peered":"2024-09-17T01:55:20.418420+0000","last_clean":"2024-09-17T01:55:20.418420+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:55:20.418420+0000","last_undegraded":"2024-09-17T01:55:20.418420+0000","last_fullsized":"2024-09-17T01:55:20.418420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417416+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:55:20.417416+0000","last_peered":"2024-09-17T01:55:20.417416+0000","last_clean":"2024-09-17T01:55:20.417416+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:55:20.417416+0000","last_undegraded":"2024-09-17T01:55:20.417416+0000","last_fullsized":"2024-09-17T01:55:20.417416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808344+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:55:21.808344+0000","last_peered":"2024-09-17T01:55:21.808344+0000","last_clean":"2024-09-17T01:55:21.808344+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:55:21.808344+0000","last_undegraded":"2024-09-17T01:55:21.808344+0000","last_fullsized":"2024-09-17T01:55:21.808344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808143+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:55:21.808143+0000","last_peered":"2024-09-17T01:55:21.808143+0000","last_clean":"2024-09-17T01:55:21.808143+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:55:21.808143+0000","last_undegraded":"2024-09-17T01:55:21.808143+0000","last_fullsized":"2024-09-17T01:55:21.808143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.807546+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:55:21.807546+0000","last_peered":"2024-09-17T01:55:21.807546+0000","last_clean":"2024-09-17T01:55:21.807546+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:55:21.807546+0000","last_undegraded":"2024-09-17T01:55:21.807546+0000","last_fullsized":"2024-09-17T01:55:21.807546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792729+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:55:19.792729+0000","last_peered":"2024-09-17T01:55:19.792729+0000","last_clean":"2024-09-17T01:55:19.792729+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:55:19.792729+0000","last_undegraded":"2024-09-17T01:55:19.792729+0000","last_fullsized":"2024-09-17T01:55:19.792729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418943+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:55:20.418943+0000","last_peered":"2024-09-17T01:55:20.418943+0000","last_clean":"2024-09-17T01:55:20.418943+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:55:20.418943+0000","last_undegraded":"2024-09-17T01:55:20.418943+0000","last_fullsized":"2024-09-17T01:55:20.418943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792000+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:55:19.792000+0000","last_peered":"2024-09-17T01:55:19.792000+0000","last_clean":"2024-09-17T01:55:19.792000+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:55:19.792000+0000","last_undegraded":"2024-09-17T01:55:19.792000+0000","last_fullsized":"2024-09-17T01:55:19.792000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808558+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:55:21.808558+0000","last_peered":"2024-09-17T01:55:21.808558+0000","last_clean":"2024-09-17T01:55:21.808558+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:55:21.808558+0000","last_undegraded":"2024-09-17T01:55:21.808558+0000","last_fullsized":"2024-09-17T01:55:21.808558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809937+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:55:21.809937+0000","last_peered":"2024-09-17T01:55:21.809937+0000","last_clean":"2024-09-17T01:55:21.809937+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:55:21.809937+0000","last_undegraded":"2024-09-17T01:55:21.809937+0000","last_fullsized":"2024-09-17T01:55:21.809937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417523+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:55:20.417523+0000","last_peered":"2024-09-17T01:55:20.417523+0000","last_clean":"2024-09-17T01:55:20.417523+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:55:20.417523+0000","last_undegraded":"2024-09-17T01:55:20.417523+0000","last_fullsized":"2024-09-17T01:55:20.417523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791326+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:55:19.791326+0000","last_peered":"2024-09-17T01:55:19.791326+0000","last_clean":"2024-09-17T01:55:19.791326+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:55:19.791326+0000","last_undegraded":"2024-09-17T01:55:19.791326+0000","last_fullsized":"2024-09-17T01:55:19.791326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.416775+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:55:20.416775+0000","last_peered":"2024-09-17T01:55:20.416775+0000","last_clean":"2024-09-17T01:55:20.416775+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:55:20.416775+0000","last_undegraded":"2024-09-17T01:55:20.416775+0000","last_fullsized":"2024-09-17T01:55:20.416775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419444+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:55:20.419444+0000","last_peered":"2024-09-17T01:55:20.419444+0000","last_clean":"2024-09-17T01:55:20.419444+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:55:20.419444+0000","last_undegraded":"2024-09-17T01:55:20.419444+0000","last_fullsized":"2024-09-17T01:55:20.419444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792424+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:55:19.792424+0000","last_peered":"2024-09-17T01:55:19.792424+0000","last_clean":"2024-09-17T01:55:19.792424+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:55:19.792424+0000","last_undegraded":"2024-09-17T01:55:19.792424+0000","last_fullsized":"2024-09-17T01:55:19.792424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809257+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:55:21.809257+0000","last_peered":"2024-09-17T01:55:21.809257+0000","last_clean":"2024-09-17T01:55:21.809257+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:55:21.809257+0000","last_undegraded":"2024-09-17T01:55:21.809257+0000","last_fullsized":"2024-09-17T01:55:21.809257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419066+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:55:20.419066+0000","last_peered":"2024-09-17T01:55:20.419066+0000","last_clean":"2024-09-17T01:55:20.419066+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:55:20.419066+0000","last_undegraded":"2024-09-17T01:55:20.419066+0000","last_fullsized":"2024-09-17T01:55:20.419066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791837+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:55:19.791837+0000","last_peered":"2024-09-17T01:55:19.791837+0000","last_clean":"2024-09-17T01:55:19.791837+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:55:19.791837+0000","last_undegraded":"2024-09-17T01:55:19.791837+0000","last_fullsized":"2024-09-17T01:55:19.791837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417911+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:55:20.417911+0000","last_peered":"2024-09-17T01:55:20.417911+0000","last_clean":"2024-09-17T01:55:20.417911+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:55:20.417911+0000","last_undegraded":"2024-09-17T01:55:20.417911+0000","last_fullsized":"2024-09-17T01:55:20.417911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791383+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:55:19.791383+0000","last_peered":"2024-09-17T01:55:19.791383+0000","last_clean":"2024-09-17T01:55:19.791383+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:55:19.791383+0000","last_undegraded":"2024-09-17T01:55:19.791383+0000","last_fullsized":"2024-09-17T01:55:19.791383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.807741+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:55:21.807741+0000","last_peered":"2024-09-17T01:55:21.807741+0000","last_clean":"2024-09-17T01:55:21.807741+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:55:21.807741+0000","last_undegraded":"2024-09-17T01:55:21.807741+0000","last_fullsized":"2024-09-17T01:55:21.807741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419192+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:55:20.419192+0000","last_peered":"2024-09-17T01:55:20.419192+0000","last_clean":"2024-09-17T01:55:20.419192+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:55:20.419192+0000","last_undegraded":"2024-09-17T01:55:20.419192+0000","last_fullsized":"2024-09-17T01:55:20.419192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809128+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:55:21.809128+0000","last_peered":"2024-09-17T01:55:21.809128+0000","last_clean":"2024-09-17T01:55:21.809128+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:55:21.809128+0000","last_undegraded":"2024-09-17T01:55:21.809128+0000","last_fullsized":"2024-09-17T01:55:21.809128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418908+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:55:20.418908+0000","last_peered":"2024-09-17T01:55:20.418908+0000","last_clean":"2024-09-17T01:55:20.418908+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:55:20.418908+0000","last_undegraded":"2024-09-17T01:55:20.418908+0000","last_fullsized":"2024-09-17T01:55:20.418908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791897+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:55:19.791897+0000","last_peered":"2024-09-17T01:55:19.791897+0000","last_clean":"2024-09-17T01:55:19.791897+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:55:19.791897+0000","last_undegraded":"2024-09-17T01:55:19.791897+0000","last_fullsized":"2024-09-17T01:55:19.791897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792561+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:55:19.792561+0000","last_peered":"2024-09-17T01:55:19.792561+0000","last_clean":"2024-09-17T01:55:19.792561+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:55:19.792561+0000","last_undegraded":"2024-09-17T01:55:19.792561+0000","last_fullsized":"2024-09-17T01:55:19.792561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417166+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:55:20.417166+0000","last_peered":"2024-09-17T01:55:20.417166+0000","last_clean":"2024-09-17T01:55:20.417166+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:55:20.417166+0000","last_undegraded":"2024-09-17T01:55:20.417166+0000","last_fullsized":"2024-09-17T01:55:20.417166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792389+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:55:19.792389+0000","last_peered":"2024-09-17T01:55:19.792389+0000","last_clean":"2024-09-17T01:55:19.792389+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:55:19.792389+0000","last_undegraded":"2024-09-17T01:55:19.792389+0000","last_fullsized":"2024-09-17T01:55:19.792389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.807809+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:55:21.807809+0000","last_peered":"2024-09-17T01:55:21.807809+0000","last_clean":"2024-09-17T01:55:21.807809+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:55:21.807809+0000","last_undegraded":"2024-09-17T01:55:21.807809+0000","last_fullsized":"2024-09-17T01:55:21.807809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809789+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:55:21.809789+0000","last_peered":"2024-09-17T01:55:21.809789+0000","last_clean":"2024-09-17T01:55:21.809789+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:55:21.809789+0000","last_undegraded":"2024-09-17T01:55:21.809789+0000","last_fullsized":"2024-09-17T01:55:21.809789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417066+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:55:20.417066+0000","last_peered":"2024-09-17T01:55:20.417066+0000","last_clean":"2024-09-17T01:55:20.417066+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:55:20.417066+0000","last_undegraded":"2024-09-17T01:55:20.417066+0000","last_fullsized":"2024-09-17T01:55:20.417066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419090+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:55:20.419090+0000","last_peered":"2024-09-17T01:55:20.419090+0000","last_clean":"2024-09-17T01:55:20.419090+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:55:20.419090+0000","last_undegraded":"2024-09-17T01:55:20.419090+0000","last_fullsized":"2024-09-17T01:55:20.419090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.416975+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:55:20.416975+0000","last_peered":"2024-09-17T01:55:20.416975+0000","last_clean":"2024-09-17T01:55:20.416975+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:55:20.416975+0000","last_undegraded":"2024-09-17T01:55:20.416975+0000","last_fullsized":"2024-09-17T01:55:20.416975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809876+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:55:21.809876+0000","last_peered":"2024-09-17T01:55:21.809876+0000","last_clean":"2024-09-17T01:55:21.809876+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:55:21.809876+0000","last_undegraded":"2024-09-17T01:55:21.809876+0000","last_fullsized":"2024-09-17T01:55:21.809876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809040+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:55:21.809040+0000","last_peered":"2024-09-17T01:55:21.809040+0000","last_clean":"2024-09-17T01:55:21.809040+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:55:21.809040+0000","last_undegraded":"2024-09-17T01:55:21.809040+0000","last_fullsized":"2024-09-17T01:55:21.809040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809447+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:55:21.809447+0000","last_peered":"2024-09-17T01:55:21.809447+0000","last_clean":"2024-09-17T01:55:21.809447+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:55:21.809447+0000","last_undegraded":"2024-09-17T01:55:21.809447+0000","last_fullsized":"2024-09-17T01:55:21.809447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791699+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:55:19.791699+0000","last_peered":"2024-09-17T01:55:19.791699+0000","last_clean":"2024-09-17T01:55:19.791699+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:55:19.791699+0000","last_undegraded":"2024-09-17T01:55:19.791699+0000","last_fullsized":"2024-09-17T01:55:19.791699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792243+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:55:19.792243+0000","last_peered":"2024-09-17T01:55:19.792243+0000","last_clean":"2024-09-17T01:55:19.792243+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:55:19.792243+0000","last_undegraded":"2024-09-17T01:55:19.792243+0000","last_fullsized":"2024-09-17T01:55:19.792243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808875+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:55:21.808875+0000","last_peered":"2024-09-17T01:55:21.808875+0000","last_clean":"2024-09-17T01:55:21.808875+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:55:21.808875+0000","last_undegraded":"2024-09-17T01:55:21.808875+0000","last_fullsized":"2024-09-17T01:55:21.808875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809428+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:55:21.809428+0000","last_peered":"2024-09-17T01:55:21.809428+0000","last_clean":"2024-09-17T01:55:21.809428+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:55:21.809428+0000","last_undegraded":"2024-09-17T01:55:21.809428+0000","last_fullsized":"2024-09-17T01:55:21.809428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809624+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:55:21.809624+0000","last_peered":"2024-09-17T01:55:21.809624+0000","last_clean":"2024-09-17T01:55:21.809624+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:55:21.809624+0000","last_undegraded":"2024-09-17T01:55:21.809624+0000","last_fullsized":"2024-09-17T01:55:21.809624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417335+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:55:20.417335+0000","last_peered":"2024-09-17T01:55:20.417335+0000","last_clean":"2024-09-17T01:55:20.417335+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:55:20.417335+0000","last_undegraded":"2024-09-17T01:55:20.417335+0000","last_fullsized":"2024-09-17T01:55:20.417335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809295+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:55:21.809295+0000","last_peered":"2024-09-17T01:55:21.809295+0000","last_clean":"2024-09-17T01:55:21.809295+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:55:21.809295+0000","last_undegraded":"2024-09-17T01:55:21.809295+0000","last_fullsized":"2024-09-17T01:55:21.809295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.416988+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:55:20.416988+0000","last_peered":"2024-09-17T01:55:20.416988+0000","last_clean":"2024-09-17T01:55:20.416988+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:55:20.416988+0000","last_undegraded":"2024-09-17T01:55:20.416988+0000","last_fullsized":"2024-09-17T01:55:20.416988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792443+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:55:19.792443+0000","last_peered":"2024-09-17T01:55:19.792443+0000","last_clean":"2024-09-17T01:55:19.792443+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:55:19.792443+0000","last_undegraded":"2024-09-17T01:55:19.792443+0000","last_fullsized":"2024-09-17T01:55:19.792443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808296+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:55:21.808296+0000","last_peered":"2024-09-17T01:55:21.808296+0000","last_clean":"2024-09-17T01:55:21.808296+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:55:21.808296+0000","last_undegraded":"2024-09-17T01:55:21.808296+0000","last_fullsized":"2024-09-17T01:55:21.808296+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809614+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:55:21.809614+0000","last_peered":"2024-09-17T01:55:21.809614+0000","last_clean":"2024-09-17T01:55:21.809614+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:55:21.809614+0000","last_undegraded":"2024-09-17T01:55:21.809614+0000","last_fullsized":"2024-09-17T01:55:21.809614+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792227+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:55:19.792227+0000","last_peered":"2024-09-17T01:55:19.792227+0000","last_clean":"2024-09-17T01:55:19.792227+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:55:19.792227+0000","last_undegraded":"2024-09-17T01:55:19.792227+0000","last_fullsized":"2024-09-17T01:55:19.792227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809716+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:55:21.809716+0000","last_peered":"2024-09-17T01:55:21.809716+0000","last_clean":"2024-09-17T01:55:21.809716+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:55:21.809716+0000","last_undegraded":"2024-09-17T01:55:21.809716+0000","last_fullsized":"2024-09-17T01:55:21.809716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808109+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:55:21.808109+0000","last_peered":"2024-09-17T01:55:21.808109+0000","last_clean":"2024-09-17T01:55:21.808109+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:55:21.808109+0000","last_undegraded":"2024-09-17T01:55:21.808109+0000","last_fullsized":"2024-09-17T01:55:21.808109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792133+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:55:19.792133+0000","last_peered":"2024-09-17T01:55:19.792133+0000","last_clean":"2024-09-17T01:55:19.792133+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:55:19.792133+0000","last_undegraded":"2024-09-17T01:55:19.792133+0000","last_fullsized":"2024-09-17T01:55:19.792133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418675+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:55:20.418675+0000","last_peered":"2024-09-17T01:55:20.418675+0000","last_clean":"2024-09-17T01:55:20.418675+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:55:20.418675+0000","last_undegraded":"2024-09-17T01:55:20.418675+0000","last_fullsized":"2024-09-17T01:55:20.418675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792088+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:55:19.792088+0000","last_peered":"2024-09-17T01:55:19.792088+0000","last_clean":"2024-09-17T01:55:19.792088+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:55:19.792088+0000","last_undegraded":"2024-09-17T01:55:19.792088+0000","last_fullsized":"2024-09-17T01:55:19.792088+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417458+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:55:20.417458+0000","last_peered":"2024-09-17T01:55:20.417458+0000","last_clean":"2024-09-17T01:55:20.417458+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:55:20.417458+0000","last_undegraded":"2024-09-17T01:55:20.417458+0000","last_fullsized":"2024-09-17T01:55:20.417458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792512+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:55:19.792512+0000","last_peered":"2024-09-17T01:55:19.792512+0000","last_clean":"2024-09-17T01:55:19.792512+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:55:19.792512+0000","last_undegraded":"2024-09-17T01:55:19.792512+0000","last_fullsized":"2024-09-17T01:55:19.792512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809759+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:55:21.809759+0000","last_peered":"2024-09-17T01:55:21.809759+0000","last_clean":"2024-09-17T01:55:21.809759+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:55:21.809759+0000","last_undegraded":"2024-09-17T01:55:21.809759+0000","last_fullsized":"2024-09-17T01:55:21.809759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809419+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:55:21.809419+0000","last_peered":"2024-09-17T01:55:21.809419+0000","last_clean":"2024-09-17T01:55:21.809419+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:55:21.809419+0000","last_undegraded":"2024-09-17T01:55:21.809419+0000","last_fullsized":"2024-09-17T01:55:21.809419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791984+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:55:19.791984+0000","last_peered":"2024-09-17T01:55:19.791984+0000","last_clean":"2024-09-17T01:55:19.791984+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:55:19.791984+0000","last_undegraded":"2024-09-17T01:55:19.791984+0000","last_fullsized":"2024-09-17T01:55:19.791984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809968+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:55:21.809968+0000","last_peered":"2024-09-17T01:55:21.809968+0000","last_clean":"2024-09-17T01:55:21.809968+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:55:21.809968+0000","last_undegraded":"2024-09-17T01:55:21.809968+0000","last_fullsized":"2024-09-17T01:55:21.809968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792286+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:55:19.792286+0000","last_peered":"2024-09-17T01:55:19.792286+0000","last_clean":"2024-09-17T01:55:19.792286+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:55:19.792286+0000","last_undegraded":"2024-09-17T01:55:19.792286+0000","last_fullsized":"2024-09-17T01:55:19.792286+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417635+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:55:20.417635+0000","last_peered":"2024-09-17T01:55:20.417635+0000","last_clean":"2024-09-17T01:55:20.417635+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:55:20.417635+0000","last_undegraded":"2024-09-17T01:55:20.417635+0000","last_fullsized":"2024-09-17T01:55:20.417635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792187+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:55:19.792187+0000","last_peered":"2024-09-17T01:55:19.792187+0000","last_clean":"2024-09-17T01:55:19.792187+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:55:19.792187+0000","last_undegraded":"2024-09-17T01:55:19.792187+0000","last_fullsized":"2024-09-17T01:55:19.792187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.416441+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:55:20.416441+0000","last_peered":"2024-09-17T01:55:20.416441+0000","last_clean":"2024-09-17T01:55:20.416441+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:55:20.416441+0000","last_undegraded":"2024-09-17T01:55:20.416441+0000","last_fullsized":"2024-09-17T01:55:20.416441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417774+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:55:20.417774+0000","last_peered":"2024-09-17T01:55:20.417774+0000","last_clean":"2024-09-17T01:55:20.417774+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:55:20.417774+0000","last_undegraded":"2024-09-17T01:55:20.417774+0000","last_fullsized":"2024-09-17T01:55:20.417774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792802+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:55:19.792802+0000","last_peered":"2024-09-17T01:55:19.792802+0000","last_clean":"2024-09-17T01:55:19.792802+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:55:19.792802+0000","last_undegraded":"2024-09-17T01:55:19.792802+0000","last_fullsized":"2024-09-17T01:55:19.792802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792678+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:55:19.792678+0000","last_peered":"2024-09-17T01:55:19.792678+0000","last_clean":"2024-09-17T01:55:19.792678+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:55:19.792678+0000","last_undegraded":"2024-09-17T01:55:19.792678+0000","last_fullsized":"2024-09-17T01:55:19.792678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791488+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:55:19.791488+0000","last_peered":"2024-09-17T01:55:19.791488+0000","last_clean":"2024-09-17T01:55:19.791488+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:55:19.791488+0000","last_undegraded":"2024-09-17T01:55:19.791488+0000","last_fullsized":"2024-09-17T01:55:19.791488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792623+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:55:19.792623+0000","last_peered":"2024-09-17T01:55:19.792623+0000","last_clean":"2024-09-17T01:55:19.792623+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:55:19.792623+0000","last_undegraded":"2024-09-17T01:55:19.792623+0000","last_fullsized":"2024-09-17T01:55:19.792623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809669+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:55:21.809669+0000","last_peered":"2024-09-17T01:55:21.809669+0000","last_clean":"2024-09-17T01:55:21.809669+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:55:21.809669+0000","last_undegraded":"2024-09-17T01:55:21.809669+0000","last_fullsized":"2024-09-17T01:55:21.809669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417185+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:55:20.417185+0000","last_peered":"2024-09-17T01:55:20.417185+0000","last_clean":"2024-09-17T01:55:20.417185+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:55:20.417185+0000","last_undegraded":"2024-09-17T01:55:20.417185+0000","last_fullsized":"2024-09-17T01:55:20.417185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808870+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:55:21.808870+0000","last_peered":"2024-09-17T01:55:21.808870+0000","last_clean":"2024-09-17T01:55:21.808870+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:55:21.808870+0000","last_undegraded":"2024-09-17T01:55:21.808870+0000","last_fullsized":"2024-09-17T01:55:21.808870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809157+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:55:21.809157+0000","last_peered":"2024-09-17T01:55:21.809157+0000","last_clean":"2024-09-17T01:55:21.809157+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:55:21.809157+0000","last_undegraded":"2024-09-17T01:55:21.809157+0000","last_fullsized":"2024-09-17T01:55:21.809157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791572+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:55:19.791572+0000","last_peered":"2024-09-17T01:55:19.791572+0000","last_clean":"2024-09-17T01:55:19.791572+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:55:19.791572+0000","last_undegraded":"2024-09-17T01:55:19.791572+0000","last_fullsized":"2024-09-17T01:55:19.791572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419377+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:55:20.419377+0000","last_peered":"2024-09-17T01:55:20.419377+0000","last_clean":"2024-09-17T01:55:20.419377+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:55:20.419377+0000","last_undegraded":"2024-09-17T01:55:20.419377+0000","last_fullsized":"2024-09-17T01:55:20.419377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809842+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:55:21.809842+0000","last_peered":"2024-09-17T01:55:21.809842+0000","last_clean":"2024-09-17T01:55:21.809842+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:55:21.809842+0000","last_undegraded":"2024-09-17T01:55:21.809842+0000","last_fullsized":"2024-09-17T01:55:21.809842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791470+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:55:19.791470+0000","last_peered":"2024-09-17T01:55:19.791470+0000","last_clean":"2024-09-17T01:55:19.791470+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:55:19.791470+0000","last_undegraded":"2024-09-17T01:55:19.791470+0000","last_fullsized":"2024-09-17T01:55:19.791470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792722+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:55:19.792722+0000","last_peered":"2024-09-17T01:55:19.792722+0000","last_clean":"2024-09-17T01:55:19.792722+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:55:19.792722+0000","last_undegraded":"2024-09-17T01:55:19.792722+0000","last_fullsized":"2024-09-17T01:55:19.792722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791427+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:55:19.791427+0000","last_peered":"2024-09-17T01:55:19.791427+0000","last_clean":"2024-09-17T01:55:19.791427+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:55:19.791427+0000","last_undegraded":"2024-09-17T01:55:19.791427+0000","last_fullsized":"2024-09-17T01:55:19.791427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419610+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:55:20.419610+0000","last_peered":"2024-09-17T01:55:20.419610+0000","last_clean":"2024-09-17T01:55:20.419610+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:55:20.419610+0000","last_undegraded":"2024-09-17T01:55:20.419610+0000","last_fullsized":"2024-09-17T01:55:20.419610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791638+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:55:19.791638+0000","last_peered":"2024-09-17T01:55:19.791638+0000","last_clean":"2024-09-17T01:55:19.791638+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:55:19.791638+0000","last_undegraded":"2024-09-17T01:55:19.791638+0000","last_fullsized":"2024-09-17T01:55:19.791638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792348+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:55:19.792348+0000","last_peered":"2024-09-17T01:55:19.792348+0000","last_clean":"2024-09-17T01:55:19.792348+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:55:19.792348+0000","last_undegraded":"2024-09-17T01:55:19.792348+0000","last_fullsized":"2024-09-17T01:55:19.792348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.791881+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:55:19.791881+0000","last_peered":"2024-09-17T01:55:19.791881+0000","last_clean":"2024-09-17T01:55:19.791881+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:55:19.791881+0000","last_undegraded":"2024-09-17T01:55:19.791881+0000","last_fullsized":"2024-09-17T01:55:19.791881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418816+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:55:20.418816+0000","last_peered":"2024-09-17T01:55:20.418816+0000","last_clean":"2024-09-17T01:55:20.418816+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:55:20.418816+0000","last_undegraded":"2024-09-17T01:55:20.418816+0000","last_fullsized":"2024-09-17T01:55:20.418816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417920+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:55:20.417920+0000","last_peered":"2024-09-17T01:55:20.417920+0000","last_clean":"2024-09-17T01:55:20.417920+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:55:20.417920+0000","last_undegraded":"2024-09-17T01:55:20.417920+0000","last_fullsized":"2024-09-17T01:55:20.417920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.418704+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:55:20.418704+0000","last_peered":"2024-09-17T01:55:20.418704+0000","last_clean":"2024-09-17T01:55:20.418704+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:55:20.418704+0000","last_undegraded":"2024-09-17T01:55:20.418704+0000","last_fullsized":"2024-09-17T01:55:20.418704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417935+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:55:20.417935+0000","last_peered":"2024-09-17T01:55:20.417935+0000","last_clean":"2024-09-17T01:55:20.417935+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:55:20.417935+0000","last_undegraded":"2024-09-17T01:55:20.417935+0000","last_fullsized":"2024-09-17T01:55:20.417935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808610+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:55:21.808610+0000","last_peered":"2024-09-17T01:55:21.808610+0000","last_clean":"2024-09-17T01:55:21.808610+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:55:21.808610+0000","last_undegraded":"2024-09-17T01:55:21.808610+0000","last_fullsized":"2024-09-17T01:55:21.808610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.809305+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:55:21.809305+0000","last_peered":"2024-09-17T01:55:21.809305+0000","last_clean":"2024-09-17T01:55:21.809305+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:55:21.809305+0000","last_undegraded":"2024-09-17T01:55:21.809305+0000","last_fullsized":"2024-09-17T01:55:21.809305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808775+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:55:21.808775+0000","last_peered":"2024-09-17T01:55:21.808775+0000","last_clean":"2024-09-17T01:55:21.808775+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:55:21.808775+0000","last_undegraded":"2024-09-17T01:55:21.808775+0000","last_fullsized":"2024-09-17T01:55:21.808775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.419196+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:55:20.419196+0000","last_peered":"2024-09-17T01:55:20.419196+0000","last_clean":"2024-09-17T01:55:20.419196+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:55:20.419196+0000","last_undegraded":"2024-09-17T01:55:20.419196+0000","last_fullsized":"2024-09-17T01:55:20.419196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:20.417592+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:55:20.417592+0000","last_peered":"2024-09-17T01:55:20.417592+0000","last_clean":"2024-09-17T01:55:20.417592+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:55:20.417592+0000","last_undegraded":"2024-09-17T01:55:20.417592+0000","last_fullsized":"2024-09-17T01:55:20.417592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792533+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:55:19.792533+0000","last_peered":"2024-09-17T01:55:19.792533+0000","last_clean":"2024-09-17T01:55:19.792533+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:55:19.792533+0000","last_undegraded":"2024-09-17T01:55:19.792533+0000","last_fullsized":"2024-09-17T01:55:19.792533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:55:21.808000+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:55:21.808000+0000","last_peered":"2024-09-17T01:55:21.808000+0000","last_clean":"2024-09-17T01:55:21.808000+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:55:21.808000+0000","last_undegraded":"2024-09-17T01:55:21.808000+0000","last_fullsized":"2024-09-17T01:55:21.808000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T01:55:19.792569+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:55:19.792569+0000","last_peered":"2024-09-17T01:55:19.792569+0000","last_clean":"2024-09-17T01:55:19.792569+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:55:19.792569+0000","last_undegraded":"2024-09-17T01:55:19.792569+0000","last_fullsized":"2024-09-17T01:55:19.792569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":352256,"data_stored":703238,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":702603,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":106133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:55:26.796 INFO:tasks.thrashosds.thrasher:Setting 4.12 to [2, 1, 0] 2024-09-17T01:55:26.796 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.12', '2', '1', '0'] 2024-09-17T01:55:26.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.12 2 1 0 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.705363374000001, 2024-09-17T01:55:26.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:26.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:26.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:26.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.349457671000003, 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:26.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:26.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.179794098000002, 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:26.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.178996890999997, 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:26.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:26.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.178439568000002, 2024-09-17T01:55:26.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:26.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.177897592000001, 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:26.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:26.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.176904387, 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:26.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:26.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:26.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.176343971000001, 2024-09-17T01:55:26.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:26.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:26.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.175862398, 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:26.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:26.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.843 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.005959199000003, 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:26.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:26.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:26.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.004888801, 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.001080324, 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:26.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594662655, 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:26.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:26.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:26.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594558650000003, 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:26.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:26.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:26.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594457591000001, 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594350478000003, 2024-09-17T01:55:26.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:26.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:26.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594287412, 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:26.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.886 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594229028999997, 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:26.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:26.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594161272999997, 2024-09-17T01:55:26.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:26.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:26.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.897 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.594095342999999, 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:26.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.901 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:26.902 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:26.902 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:26.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:26.905 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:26.909+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:26.974 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:27.004 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:27.003+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:27.035 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:27.036 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:27.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:27.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:55:27.105 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:27.109+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:27.158 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:27.158 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:27.168 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:27.168 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:27.168 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:27.168 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:27.168 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:27.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:27.194 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:27.194 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:27.220 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:27.220 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:27.230 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:27.236+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:27.266 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-17T01:55:27.272 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:27.272 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-17T01:55:27.306 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:27.313+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:27.307 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:27.307 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:27.321 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:27.408 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:27.407+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:27.454 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:27.454 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:27.469 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:27.508 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:27.507+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:27.585 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:27.585 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:27.599 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:27.609 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:27.608+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:27.710 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:27.716+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:27.715 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:27.715 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:27.729 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:27.811 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:27.808+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:27.861 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:27.861 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:27.875 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:27.911 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:27.916+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:28.012 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:28.017+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:28.037 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.037 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:28.069 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:55:28.114 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:28.120+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:28.177 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.177 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:28.214 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:28.221+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:28.315 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:28.321+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:28.321 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.322 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:28.416 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:28.416+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:28.451 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.451 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:28.516 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:28.516+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:28.581 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.581 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.595 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:28.642 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:28.649+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:28.718 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:28.716+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:28.726 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.726 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.740 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:28.819 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:28.816+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:28.907 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:28.907 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:28.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:28.921 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:28.925+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:29.021 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:29.020+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:29.087 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:29.087 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:29.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:29.148 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:29.148+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:29.223 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:29.228+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:29.233 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:29.233 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:29.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:29.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:29.336 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:29.336+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:29.399 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:29.400 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:29.415 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:29.415 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:29.421 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:29.421 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:29.425 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:29.424+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:29.430 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:29.442 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:29.442 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:29.526 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:29.533+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:29.590 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.498254717999998, 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.142349015000001, 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.972685442, 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.971888235000002, 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.971330911999999, 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.970788935999998, 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.969795730999998, 2024-09-17T01:55:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.969235314999999, 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968753741999997, 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.798850543, 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.797780144999997, 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.793971667999998, 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:29.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387553998999998, 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:29.659 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:29.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:29.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.668 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387449994000001, 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:29.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:29.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387348934999999, 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:29.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:29.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.680 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387241822, 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:29.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:29.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387178755999997, 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:29.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.692 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387120373000002, 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:29.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:29.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.702 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.387052617000002, 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:29.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:29.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:29.709 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.386986686999997, 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:29.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:29.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:29.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:29.714 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:29.715 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:29.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:29.717 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:29.720+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:29.817 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:29.820+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:29.847 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:29.848 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:29.848 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:29.848 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:29.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:29.918 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:29.916+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:29.978 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:29.978 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:29.978 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:29.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:30.019 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:30.024+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:30.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:55:30.117 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.843998339000002, 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.118 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:30.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:30.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.843959720000001, 2024-09-17T01:55:30.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:30.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:30.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.843922133, 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:30.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:30.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.843770614, 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:30.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.843734294999997, 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:30.142 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:30.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.672583689, 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:30.148 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:30.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:30.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:30.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.672517943000003, 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:30.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:30.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:30.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:30.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.672398264000002, 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:30.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:30.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.672360994000002, 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:30.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:30.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.672298271000003, 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:30.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.672181375000001, 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.178 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:30.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.332279286000002, 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:30.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:30.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.332126484, 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331904539, 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:30.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:30.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331829075999998, 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.201 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:30.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331746729999999, 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:30.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:30.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.213 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331459946000003, 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:30.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:30.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:30.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331370348999997, 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.220 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:30.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331257817000001, 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:30.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:30.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:30.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:30.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.331000852000003, 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:30.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:30.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:30.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:30.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:30.238 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:30.240 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:30.244+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:30.240 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:30.340 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:30.344+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:30.371 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:30.371 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:30.371 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:30.371 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:30.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:30.471 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:30.476+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:30.542 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:30.548+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:30.548 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:30.548 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:30.548 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:30.549 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:30.549 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:30.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:30.644 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:30.648+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:30.727 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:30.727 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:30.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:30.727 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:30.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 50.702861171999999, 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:30.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:30.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.732 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.690775885000001, 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:30.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:30.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 48.679909801000001, 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:30.737 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:30.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:30.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.521140858999999, 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.742 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:30.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.747 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.521041093000001, 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:30.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:30.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520997297000001, 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:30.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:30.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.759 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520919380999999, 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:30.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:30.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.765 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520837514999997, 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:30.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520786764999997, 2024-09-17T01:55:30.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:30.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:30.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:30.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520725959000004, 2024-09-17T01:55:30.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520636025999998, 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:30.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:30.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.520576370000001, 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.786 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:30.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:30.790 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.519064938, 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:30.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:30.794 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.518158362000001, 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:30.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:30.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:30.799 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.518013320000001, 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:30.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.516250980000002, 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:30.804 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:30.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.808 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 45.516142328000001, 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:30.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:30.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 43.521780538999998, 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:30.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:30.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:30.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 26.519612008999999, 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.820 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:30.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:30.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:30.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.826 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 21.518938608999999, 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:30.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:30.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:30.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.832 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.833 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:30.833 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:30.833 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:30.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:30.835 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:30.836+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:30.935 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:30.940+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:30.968 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:30.968 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:30.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:31.035 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:31.040+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:31.091 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:55:31.107 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:31.107 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:31.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:31.136 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:31.140+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:31.236 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:31.236+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:31.246 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.153156756000001, 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:31.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.251 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.797251052999997, 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:31.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:31.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.627587480000003, 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.626790272999997, 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:31.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.266 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.626232950000002, 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.625690974000001, 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.275 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.624697769000001, 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:31.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:31.279 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.624137353000002, 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:31.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:31.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.62365578, 2024-09-17T01:55:31.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:31.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.453752581000003, 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:31.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:31.293 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.452682183, 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:31.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.448873706000001, 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.298 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:31.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.302 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.042456037000001, 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:31.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:31.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.042352031999997, 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:31.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:31.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:31.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.042250973000002, 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:31.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:31.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:31.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.042143860000003, 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:31.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:31.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.324 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.042080794, 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:31.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:31.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.042022410999998, 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:31.330 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:31.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.041954654999998, 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:31.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:31.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:31.341 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.041888725, 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:31.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:31.345 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:31.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:31.348 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:31.344+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:31.448 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:31.452+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:31.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:31.479 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:31.479 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:31.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:31.578 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:31.584+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:31.607 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:31.608 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:31.629 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:31.629 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:31.650 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:31.652+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:31.650 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:31.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:31.751 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:31.756+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:31.838 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:31.839 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:31.853 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:31.852+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:31.854 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:31.954 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:31.956+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:31.986 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:31.986 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.001 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:32.054 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:32.052+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:32.123 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:32.124 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.137 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:32.183 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:32.188+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:32.255 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:32.255 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.256 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:32.260+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:32.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:32.274 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:32.274 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:32.274 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-17T01:55:32.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-17T01:55:32.358 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:32.356+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:32.401 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:32.401 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.416 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:32.425 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-17T01:55:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-17T01:55:32.428 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:32.428 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-17T01:55:32.429 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-17T01:55:32.459 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:32.464+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:32.560 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:32.560+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:32.584 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:32.584 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.587 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-17T01:55:32.587 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-17T01:55:32.587 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-17T01:55:32.588 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-17T01:55:32.590 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:32.591 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-17T01:55:32.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-17T01:55:32.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:32.661 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:32.664+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-17T01:55:32.740 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-17T01:55:32.741 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-17T01:55:32.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:32.743 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-17T01:55:32.759 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:32.759 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.761 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:32.760+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:32.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:32.862 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:32.864+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:32.906 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:32.906 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:32.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:32.966 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:32.972+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:33.043 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:33.043 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:33.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:33.063 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.068+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:55:33.164 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.168+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.219 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:33.219 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:33.233 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:33.279 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.284+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.364 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:33.364 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:33.366 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.368+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.378 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:33.468 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.472+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.534 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:33.535 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:33.548 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:33.591 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.596+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:33.669 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.672+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:33.713 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:33.713 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:33.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:33.775 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:33.776+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:33.797 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:33.817 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:33.818 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:33.838 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:33.838 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:33.862 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:33.874 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:33.868+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:33.877 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:33.971 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:33.976+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:34.041 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:34.041 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:34.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:34.073 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:34.080+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:34.103 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:34.174 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.08159543, 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:34.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:34.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.725689727000002, 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:34.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.556026154000001, 2024-09-17T01:55:34.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:34.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:34.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.555228947000003, 2024-09-17T01:55:34.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:34.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.554671624000001, 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:34.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:34.197 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.554129648, 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:34.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.553136443, 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:34.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.552576027000001, 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.211 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.552094453999999, 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:34.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:34.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.382191255000002, 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.216 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:34.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.220 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.381120856999999, 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:34.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:34.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.377312379999999, 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:34.225 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:34.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970894711, 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:34.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:34.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970790706000003, 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:34.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:34.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:34.242 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970689647, 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:34.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970582534000002, 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.248 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:34.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.253 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970519467999999, 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970461084999997, 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:34.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:34.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:34.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970393328999997, 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.265 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:34.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:34.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:34.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:34.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.970327398999999, 2024-09-17T01:55:34.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:34.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:34.274 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:34.275 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:34.276 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:34.180+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:34.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:34.277 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:34.276+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:34.377 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:34.380+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:34.409 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:34.409 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:34.409 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:34.410 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:34.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:34.478 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:34.476+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:34.541 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:34.541 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:34.541 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:34.541 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:34.541 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:34.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:34.602 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:34.608+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:34.673 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:34.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.401385034999997, 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:34.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:34.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.679 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.401346416000003, 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:34.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:34.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:34.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.685 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.401308829000001, 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.401157310000002, 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:34.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.401120990999999, 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:34.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.229970385000001, 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:34.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.229904638999997, 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.708 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:34.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.714 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.229784960000003, 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.715 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.720 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.229747690000004, 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:34.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:34.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:34.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:34.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.229684966999997, 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.726 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:34.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.732 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.229568071000003, 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:34.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.889665981999997, 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:34.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:34.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.889513180000002, 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:34.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:34.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:34.750 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.889291235000002, 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:34.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:34.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:34.756 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.889215772, 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:34.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:34.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.889133426000001, 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:34.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:34.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:34.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.888846641999997, 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.774 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.888757044999998, 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.775 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:34.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.780 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.888644513000003, 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.781 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:34.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:34.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.888387547999997, 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.787 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:34.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:34.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:34.793 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:34.793 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:34.794 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:34.795 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:34.800+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:34.895 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:34.900+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:34.927 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:34.927 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:34.927 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:34.927 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:34.942 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:34.996 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:35.004+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:35.061 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:35.061 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:35.061 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:35.061 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:35.061 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:35.076 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:35.123 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:35.128+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:35.198 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:35.204+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 55.178507260000003, 2024-09-17T01:55:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:35.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:35.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.166421972999999, 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.209 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:35.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 53.155555888999999, 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:35.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.220 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996786946999997, 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996687180999999, 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:35.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:35.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:35.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996643384999999, 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996565468999997, 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.237 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:35.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996483603000001, 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.243 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:35.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:35.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996432853000002, 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:35.249 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:35.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.254 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996372047000001, 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:35.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:35.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996282114000003, 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:35.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.996222457999998, 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:35.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.994711025999997, 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.267 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:35.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.993804449999999, 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.271 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:35.275 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.993659407999999, 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.991897068, 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.280 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 49.991788415999999, 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:35.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 47.997426627000003, 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.289 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:35.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.995258097000001, 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:35.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:35.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:35.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 25.994584697000001, 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:35.301 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:35.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:35.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:35.307 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:35.307 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:35.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:35.309 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:35.312+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:35.409 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:35.416+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:35.440 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:35.440 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:35.440 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:35.440 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:35.454 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:35.510 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:35.508+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:35.575 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:35.576 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:35.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:35.632 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:35.632+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:35.712 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:35.712+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:35.758 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:35.758 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:35.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.665102459000003, 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:35.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:35.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:35.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.309196755999999, 2024-09-17T01:55:35.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:35.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.139533182999998, 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:35.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:35.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.138735976, 2024-09-17T01:55:35.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:35.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.776 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.138178652999997, 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:35.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.137636677000003, 2024-09-17T01:55:35.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:35.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.136643472000003, 2024-09-17T01:55:35.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:35.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:35.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.136083055999997, 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:35.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.135601483000002, 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:35.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:35.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.965698283999998, 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:35.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.964627886000002, 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:35.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:35.810 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.960819409000003, 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:35.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:35.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:35.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.554401740000003, 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:35.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.554297734999999, 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:35.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:35.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.554196675999997, 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:35.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:35.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.832 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.554089562999998, 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:35.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.554026497000002, 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:35.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:35.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.553968114, 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:35.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:35.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.850 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.553900358, 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:35.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:35.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.553834428000002, 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:35.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:35.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:35.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:35.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:35.861 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:35.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:35.863 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:35.868+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:35.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:35.963 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:35.968+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:35.995 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:35.995 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:35.995 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:35.995 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:36.001 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:36.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:36.021 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:36.039 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:36.095 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:36.100+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:36.122 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:55:36.165 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:36.172+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:36.174 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:36.174 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:36.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:36.267 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:36.272+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:36.355 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:36.355 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:36.368 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:36.372+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:36.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:36.469 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:36.472+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:36.501 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:36.501 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:36.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:36.570 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:36.568+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:36.630 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:36.631 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:36.645 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:36.670 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:36.668+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:36.765 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:36.765 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:36.771 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:36.776+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:36.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:36.872 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:36.876+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:36.911 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:36.911 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:36.925 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:36.972 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:36.972+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:37.047 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.047 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.061 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:37.074 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:37.076+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:37.104 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:55:37.175 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:37.172+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:37.225 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.225 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:37.275 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:37.280+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:37.368 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.369 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.376 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:37.376+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:37.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:37.477 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:37.476+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:37.498 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.498 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:37.578 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:37.576+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:37.632 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.633 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.647 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:37.681 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:37.680+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:37.745 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:37.745 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:37.745 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-17T01:55:37.745 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-17T01:55:37.780 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.780 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.782 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:37.788+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:37.793 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:37.883 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:37.888+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:37.909 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:37.910 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:37.923 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:37.941 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-17T01:55:37.985 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:37.988+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:38.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:38.086 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:38.084+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:38.089 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:38.089 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:38.103 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:38.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-17T01:55:38.186 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:38.188+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:38.218 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:38.218 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:38.235 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:38.235 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:38.249 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:38.250 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:38.250 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:38.283 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:38.283 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:38.295 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:38.296+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:38.373 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:38.373 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:38.373 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:38.373 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:38.373 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:38.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:38.388 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:38.392+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:38.488 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:38.492+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:38.557 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 64.46415451, 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 64.108248806999995, 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:38.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:38.569 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.938585234000001, 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:38.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.937788027000003, 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:38.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:38.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.937230704000001, 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:38.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:38.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:38.585 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.936688728, 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:38.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:38.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.935695523, 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.591 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:38.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.935135107000001, 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:38.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.934653533999999, 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:38.602 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:38.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:38.607 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.764750335000002, 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:38.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.763679936999999, 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:38.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:38.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.759871459999999, 2024-09-17T01:55:38.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:38.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.353453791, 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:38.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:38.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:38.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.630 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.353349786000003, 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:38.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:38.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:38.637 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.353248727, 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:38.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:38.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:38.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.644 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.353141614000002, 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:38.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.353078547999999, 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:38.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:38.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:38.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.657 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.353020164999997, 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:38.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:38.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.352952408999997, 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:38.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:38.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:38.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.352886478999999, 2024-09-17T01:55:38.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:38.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:38.676 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:38.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:38.678 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:38.676+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:38.778 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:38.784+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:38.808 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:38.808 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:38.808 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:38.808 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:38.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:38.879 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:38.884+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:38.980 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:38.980+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:38.985 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:38.985 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:38.985 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:38.985 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:38.985 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:38.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:39.081 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:39.080+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:39.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:55:39.127 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.854954401000001, 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:39.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:39.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.854915782000006, 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:39.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.854878194999998, 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:39.140 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:39.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.854726675999999, 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:39.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:39.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:39.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:39.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.854690356999996, 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:39.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:39.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.683539750999998, 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.159 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.683474004999994, 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:39.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:39.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:39.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.683354326, 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:39.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:39.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:39.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.683317056000007, 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.177 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:39.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.183 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.683254332999994, 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:39.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:39.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.683137436999999, 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:39.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:39.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:39.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.343235347999993, 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:39.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.343082546000005, 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:39.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:39.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.207 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.342860600999998, 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:39.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:39.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.342785137999996, 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.214 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:39.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.219 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.342702791999997, 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.220 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:39.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:39.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.342416008000001, 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.226 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:39.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:39.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.342326411000002, 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:39.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:39.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:39.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.342213878999999, 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.238 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:39.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.341956913999994, 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:39.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:39.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:39.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:39.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:39.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:39.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.250 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:39.250 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:39.250 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:39.251 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:39.252 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:39.256+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:39.353 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:39.360+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:39.382 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:39.383 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:39.383 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:39.383 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:39.396 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:39.453 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:39.452+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:39.518 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:39.518 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:39.518 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:39.518 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:39.518 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:39.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:39.554 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:39.552+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:39.655 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:39.659+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 59.636254145000002, 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.661 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:39.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.665 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.624168857999997, 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:39.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:39.670 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 57.613302773999997, 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:39.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:39.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454533832000003, 2024-09-17T01:55:39.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:39.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454434065999997, 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:39.681 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:39.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454390269999998, 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:39.687 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:39.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454312354000002, 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.693 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:39.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454230488, 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:39.699 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:39.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:39.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:39.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:39.705 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454179738000001, 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:39.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:39.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454118932, 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:39.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:39.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.454028999000002, 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.716 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:39.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.453969342999997, 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.452457911000003, 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:39.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:39.728 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.451551334999998, 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:39.732 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.451406292999998, 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:39.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:39.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.737 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.449643952999999, 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.742 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 54.449535300999997, 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:39.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:39.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 52.455173512000002, 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:39.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:39.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:39.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 35.453004982000003, 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:39.753 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:39.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:39.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.759 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 30.452331581999999, 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:39.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:39.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:39.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.765 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.766 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.766 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:39.766 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:39.766 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:39.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:39.768 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:39.771+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:39.868 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:39.872+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:39.902 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:39.902 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:39.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:39.969 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:39.971+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:40.038 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:40.039 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:40.052 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:40.070 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:40.075+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:55:40.171 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:40.176+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:40.172 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:40.172 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:40.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:40.172 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.079598486999998, 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:40.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:40.177 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.723692783999994, 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:40.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:40.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.554029211, 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.553232003999995, 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:40.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:40.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.552674680999999, 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:40.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.552132705000005, 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:40.196 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.551139500000005, 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:40.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.550579084000006, 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.550097511000004, 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:40.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:40.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:40.214 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.380194312, 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:40.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:40.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:40.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.379123914000004, 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.223 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.375315436999998, 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:40.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968897767999998, 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.228 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:40.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968793763000001, 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:40.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:40.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:40.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:40.239 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968692703999999, 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:40.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:40.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968585591, 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.245 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:40.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968522524999997, 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:40.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968464142000002, 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:40.256 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:40.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968396386000002, 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:40.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:40.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:40.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:40.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.968330455999997, 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:40.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:40.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:40.271 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:40.272 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:40.273 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:40.274 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:40.272+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:40.308 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:40.374 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:40.376+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:40.407 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:40.407 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:40.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:40.475 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:40.476+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:40.506 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:40.506 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:40.539 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:40.540 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:40.540 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:40.540 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:40.540 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:40.540 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:40.541 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:40.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:40.571 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:40.571 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:40.576 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:40.576+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:40.675 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:40.676 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:40.676 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:40.676+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:40.690 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:40.777 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:40.783+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:40.820 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:40.820 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:40.834 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:40.878 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:40.883+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:40.953 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:40.953 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:40.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:40.979 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:40.983+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:41.081 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:41.083+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:41.091 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:41.091 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:41.106 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:41.181 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:41.180+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:41.238 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:41.238 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:41.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:41.281 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:41.288+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:41.382 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:41.387+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:41.414 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:41.415 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:41.428 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:41.483 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:41.488+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:41.549 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:41.549 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:41.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:41.610 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:41.615+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:41.685 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:41.687+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:41.695 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:41.695 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:41.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:41.802 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:41.807+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:41.878 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:41.878 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:41.888 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:41.892+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:41.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:41.989 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:41.991+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:42.055 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:42.055 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:42.068 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:42.110 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:42.115+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:42.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:55:42.192 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:42.188+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:42.200 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:42.200 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:42.214 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:42.291 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:42.295+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:42.350 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:42.351 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:42.393 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:42.399+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:42.470 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:42.470 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:42.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:42.531 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:42.532+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:42.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:42.594 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:42.599+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:42.616 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:42.617 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:42.632 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:42.719 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:42.720+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:42.793 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:42.794 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:42.795 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:42.795 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:42.795 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:42.799+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:42.809 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:42.824 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:42.825 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:42.858 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:42.858 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:42.896 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:42.899+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:42.977 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.884244152999997, 2024-09-17T01:55:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.528338450000007, 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.358674876999999, 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.357877669999993, 2024-09-17T01:55:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.357320346999998, 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.356778371000004, 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.355785166000004, 2024-09-17T01:55:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.355224750000005, 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.354743177000003, 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.184839977999999, 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.183769580000003, 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.179961102999997, 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773543433999997, 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773439429, 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773338369999998, 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773231256999999, 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773168191000003, 2024-09-17T01:55:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773109808000001, 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:43.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.773042052000001, 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:43.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:43.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:43.093 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.772976122000003, 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:43.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:43.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:43.097 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:43.098 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:43.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:43.100 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:43.099+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:43.123 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:55:43.199 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:43.203+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:43.231 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:43.231 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:43.231 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:43.231 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:43.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:43.300 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:43.303+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:43.309 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:43.309 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:43.310 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-17T01:55:43.310 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-17T01:55:43.369 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:43.369 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:43.369 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:43.369 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:43.370 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:43.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:43.401 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:43.400+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:43.502 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:43.503+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.279321658000001, 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:43.552 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:43.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.279283039000006, 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.559 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:43.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:43.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.279245451999998, 2024-09-17T01:55:43.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:43.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.279093932999999, 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.572 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:43.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:43.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:43.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.279057613999996, 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.579 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.107907007999998, 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.107841261999994, 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:43.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.107721583, 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:43.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:43.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:43.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.107684312999993, 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.604 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:43.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:43.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.107621589999994, 2024-09-17T01:55:43.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.107504693999999, 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:43.616 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:43.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.767602604999993, 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:43.624 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:43.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:43.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.630 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.767449803000005, 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.767227857999998, 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:43.638 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:43.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:43.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:43.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:43.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.767152394999997, 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:43.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:43.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:43.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:43.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.767070048999997, 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:43.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:43.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:43.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:43.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.660 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.766783265000001, 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:43.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:43.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.766693668000002, 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.668 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:43.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:43.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.766581135999999, 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.675 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:43.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:43.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.766324170999994, 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:43.681 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:43.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:43.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:43.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:43.687 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:43.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:43.689 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:43.691+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:43.790 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:43.791+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:43.809 INFO:teuthology.orchestra.run.smithi063.stdout:moved 0 / 210 (0%) 2024-09-17T01:55:43.809 INFO:teuthology.orchestra.run.smithi063.stdout:avg 70 2024-09-17T01:55:43.809 INFO:teuthology.orchestra.run.smithi063.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:oload 1000 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:max_change 3 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:max_change_osds 4 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:average_utilization 0.0003 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stdout:overload_utilization 0.0032 2024-09-17T01:55:43.810 INFO:teuthology.orchestra.run.smithi063.stderr:no change 2024-09-17T01:55:43.820 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:43.820 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:43.820 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:43.820 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:43.833 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-17T01:55:43.834 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-17T01:55:43.836 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:43.891 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:43.892+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:43.992 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:43.992+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:44.003 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:44.003 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:44.003 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:44.003 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:44.003 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:44.017 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:44.093 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:44.092+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:44.141 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:44.141 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:44.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 64.117008068999993, 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:44.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:44.146 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.104922782000003, 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:44.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:44.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 62.094056698000003, 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.151 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:44.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.155 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.935287756000001, 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:44.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:44.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.161 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.935187990000003, 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:44.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:44.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:44.167 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.935144194000003, 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:44.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:44.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:44.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.173 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.935066278000001, 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:44.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:44.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:44.179 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.934984411999999, 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:44.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:44.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.934933661999999, 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.185 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:44.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:44.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.934872855999998, 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.191 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:44.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:44.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.934782923, 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.195 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:44.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:44.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.934723267000003, 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:44.199 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.933211835000002, 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:44.207 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.932305259000003, 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:44.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:44.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:44.212 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.932160217000003, 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:44.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:44.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.930397876999997, 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:44.217 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:44.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 58.930289225000003, 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.222 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:44.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:44.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:44.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 56.935927436, 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:44.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.933758906000001, 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:44.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:44.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:44.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:44.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:44.240 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 34.933085505999998, 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:44.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:44.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:44.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:44.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.246 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:44.246 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:44.246 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:44.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:44.248 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:44.251+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:moved 0 / 210 (0%) 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:avg 70 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:oload 1000 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:max_change 3 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:max_change_osds 4 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:average_utilization 0.0003 2024-09-17T01:55:44.332 INFO:teuthology.orchestra.run.smithi063.stdout:overload_utilization 0.0032 2024-09-17T01:55:44.333 INFO:teuthology.orchestra.run.smithi063.stderr:no change 2024-09-17T01:55:44.348 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:44.351+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:44.354 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-17T01:55:44.354 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-17T01:55:44.380 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:44.380 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:44.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:44.449 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:44.448+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:44.516 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:44.516 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:44.516 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:44.516 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:44.517 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:44.532 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:44.575 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:44.576+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:44.651 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:44.655+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.605518208999996, 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.249612506000005, 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.079948932999997, 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.079151726000006, 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.078594402999997, 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.078052427000003, 2024-09-17T01:55:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.077059222000003, 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.076498806000004, 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.076017233000002, 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:44.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:44.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.906114033999998, 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.739 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.743 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.905043636000002, 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:44.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.901235158999995, 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.748 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:44.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.752 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494817490000003, 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494713484999998, 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.758 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:44.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:44.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494612426000003, 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:44.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:44.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494505312999998, 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:44.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:44.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494442247000002, 2024-09-17T01:55:44.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:44.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.780 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494383864, 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494316108, 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 59.494250178000001, 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:44.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:44.798 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:44.803+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:moved 0 / 210 (0%) 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:avg 70 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:oload 110 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:max_change 3 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:max_change_osds 4 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:average_utilization 0.0003 2024-09-17T01:55:44.853 INFO:teuthology.orchestra.run.smithi063.stdout:overload_utilization 0.0004 2024-09-17T01:55:44.854 INFO:teuthology.orchestra.run.smithi063.stderr:no change 2024-09-17T01:55:44.876 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-17T01:55:44.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-17T01:55:44.878 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:44.898 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:44.903+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:44.929 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:44.929 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:44.929 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:44.929 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:44.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:44.999 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.003+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.101 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.103+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.109 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:45.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:45.109 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:45.110 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:45.110 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:45.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:45.126 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:45.126 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:45.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:55:45.163 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:45.164 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:45.196 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:45.196 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:45.201 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.203+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.249 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:45.249 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:45.264 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:45.311 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.315+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.382 INFO:teuthology.orchestra.run.smithi063.stdout:moved 0 / 210 (0%) 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:avg 70 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:oload 1000 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:max_change 3 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:max_change_osds 4 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:average_utilization 0.0003 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stdout:overload_utilization 0.0032 2024-09-17T01:55:45.383 INFO:teuthology.orchestra.run.smithi063.stderr:no change 2024-09-17T01:55:45.396 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:45.397 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:45.403 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:45.404+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:45.407 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-17T01:55:45.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-17T01:55:45.410 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:45.503 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:45.504+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:45.590 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:45.636 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.639+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.706 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.707+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.707 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:45.707 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:45.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:45.806 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.811+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.852 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:45.853 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:45.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:45.907 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:45.911+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:45.909 INFO:teuthology.orchestra.run.smithi063.stdout:moved 0 / 210 (0%) 2024-09-17T01:55:45.909 INFO:teuthology.orchestra.run.smithi063.stdout:avg 70 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:max osd.0 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:oload 1000 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:max_change 0.05 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:max_change_osds 4 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:average_utilization 0.0003 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stdout:overload_utilization 0.0032 2024-09-17T01:55:45.910 INFO:teuthology.orchestra.run.smithi063.stderr:no change 2024-09-17T01:55:45.989 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:45.989 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:46.009 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:46.011+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:46.110 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:46.115+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.133 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:55:46.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:46.211 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:46.211+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:46.276 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:46.276 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:46.338 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:46.343+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:46.408 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:46.408 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.413 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:46.415+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:46.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:46.513 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:46.515+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:46.586 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:46.586 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:46.646 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:46.651+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:46.715 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:46.719+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:46.733 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:46.733 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.749 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:46.815 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:46.816+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:46.872 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:46.872 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:46.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:46.916 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:46.916+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:47.008 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:47.008 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:47.016 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:47.023+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:47.022 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:47.117 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:47.116+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:47.153 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:47.153 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:47.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:47.218 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:47.223+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:47.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:47.321 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:47.323+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:47.336 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:47.336 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:47.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:47.421 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:47.422 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:47.423+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:47.453 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:47.453 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 73.379255826000005, 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 73.023350123, 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.853686550000006, 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.852889343000001, 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.852332020000006, 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.851790043999998, 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.850796838999997, 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.850236422999998, 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.849754849999997, 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.679851651000007, 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.678781252999997, 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.674972776000004, 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.268555106999997, 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.529 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:47.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.268451102, 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:47.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:47.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:47.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.268350042999998, 2024-09-17T01:55:47.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:47.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:47.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.26824293, 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:47.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:47.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:47.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.268179863999997, 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:47.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.268121481000001, 2024-09-17T01:55:47.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:47.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:47.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.268053725000001, 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:47.563 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:47.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:47.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:47.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.267987795000003, 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:47.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:47.573 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:47.574 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:47.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:47.576 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:47.576 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:47.579+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:47.676 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:47.679+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:47.706 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:47.706 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:47.706 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:47.706 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:47.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:47.777 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:47.776+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:47.842 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:47.842 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:47.842 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:47.842 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:47.842 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:47.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:47.903 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:47.907+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:47.974 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.701552562000003, 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:47.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:47.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:47.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:47.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.701513942999995, 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:47.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:47.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:47.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:47.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.701476356000001, 2024-09-17T01:55:47.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:47.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:47.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:47.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:47.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.701324837000001, 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:47.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:47.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:47.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:47.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:47.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:48.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.701288517999998, 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.003 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:48.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:48.009 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.530137912000001, 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:48.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:48.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.530072165999997, 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.016 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:48.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:48.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.529952487000003, 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.029 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.529915216999996, 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.030 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:48.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.529852493999996, 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:48.037 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:48.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.529735598000002, 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:48.044 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:48.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.189833508999996, 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:48.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.189680706999994, 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.057 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:48.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:48.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:48.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.189458762000001, 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.189383298999999, 2024-09-17T01:55:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:48.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.189300953, 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.078 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:48.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:48.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.189014169000004, 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:48.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:48.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.188924572000005, 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:48.090 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:48.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:48.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.188812040000002, 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:48.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:48.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.188555074999996, 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:48.105 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:48.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:48.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:48.111 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:48.113 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:48.114 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:48.119+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:48.158 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:55:48.214 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:48.215+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:48.247 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:48.247 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:48.247 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:48.261 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:48.315 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:48.316+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:48.416 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:48.419+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:48.426 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:48.426 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:48.426 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:48.426 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:48.426 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:48.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:48.527 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:48.531+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:48.608 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:48.608 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:48.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 68.584019382999998, 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.609 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:48.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.571934096000007, 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:48.614 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:48.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.619 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 66.561068012000007, 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.620 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:48.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.625 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.402299069999998, 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:48.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:48.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:48.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.402199304, 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:48.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:48.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.402155508, 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:48.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:48.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.646 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:48.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.648 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.402077591999998, 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.649 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:48.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.401995726000003, 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:48.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.662 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.401944976000003, 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:48.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:48.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:48.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.669 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.401884170000002, 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.675 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.401794236999997, 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:48.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.681 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.401734580999999, 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:48.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:48.686 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.400223148999999, 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:48.690 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.399316573, 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.691 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:48.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.399171531, 2024-09-17T01:55:48.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:48.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:48.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.701 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.397409191000001, 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:48.702 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:48.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:48.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:48.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 63.397300539, 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.709 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:48.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:48.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:48.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 61.402938749999997, 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.715 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:48.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 44.400770219999998, 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.722 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:48.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 39.400096820000002, 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:48.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:48.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:48.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:48.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:48.737 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:48.737 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:48.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:48.739 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:48.743+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:48.839 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:48.843+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:48.871 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:48.872 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:48.872 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:48.872 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:48.887 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:48.940 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:48.940+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:49.009 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:49.010 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:49.010 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:49.024 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:49.067 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:49.068+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:49.143 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:49.147+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:49.149 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:55:49.185 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 75.094080289000004, 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.738174586, 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.568511013000006, 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.567713806, 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.567156483000005, 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.566614506999997, 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.565621301999997, 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.565060885999998, 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.564579312999996, 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.394676114000006, 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.393605715999996, 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.389797239000004, 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.983379569999997, 2024-09-17T01:55:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.983275565, 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.983174505999997, 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.983067392999999, 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.983004327000003, 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.982945944000001, 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.982878188000001, 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.982812258000003, 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:49.287 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:49.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:49.290 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:49.291+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:49.390 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:49.395+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:49.420 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:49.421 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:49.421 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:49.421 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:49.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:49.492 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:49.495+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:49.577 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:49.593 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:49.595+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:49.605 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:49.606 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:49.606 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:49.606 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:49.606 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:49.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:49.694 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:49.695+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:49.780 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:49.784 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.510125220000006, 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:49.791 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.510086600999998, 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.792 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:49.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:49.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.510049014000003, 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.798 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.799 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:49.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.799 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:49.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:49.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.509897495000004, 2024-09-17T01:55:49.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:49.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.813 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.509861176000001, 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:49.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:49.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.821 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.338710570000003, 2024-09-17T01:55:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.822 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.823 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:49.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:49.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:49.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:49.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.835 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.338644823999999, 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:49.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:49.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.843 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.338525145000006, 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:49.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:49.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.338487874999998, 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.851 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:49.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:49.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.857 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.338425151999999, 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:49.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:49.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:49.863 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.338308256000005, 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.864 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:49.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:49.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:49.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.998406166999999, 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.872 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:49.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.998253364999997, 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:49.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:49.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.998031420000004, 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:49.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:49.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.997955957000002, 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.895 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:49.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:49.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.997873611000003, 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.903 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:49.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.997586827000006, 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:49.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:49.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:49.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.997497229999993, 2024-09-17T01:55:49.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:49.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.997384698000005, 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:49.921 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:49.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:49.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.927 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.997127732999999, 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:49.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:49.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:49.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:49.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:49.934 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:49.935 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:49.935 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:49.936 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:49.936 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:49.937 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:49.938 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:49.936+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:50.036 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:50.039+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:50.068 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:50.068 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:50.082 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:50.136 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:50.139+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:50.200 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:50.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:50.237 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:50.236+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:50.338 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:50.336+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:50.381 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:50.381 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:50.395 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:50.439 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:50.439+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:50.525 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:50.525 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:50.540 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:50.540 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:50.540+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:50.641 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:50.640+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:50.705 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:50.705 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:50.719 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:50.742 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:50.747+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:50.843 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:50.847+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:50.886 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:50.886 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:50.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:50.933 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:50.933 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:50.933 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-17T01:55:50.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-17T01:55:50.946 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:50.951+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:51.032 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.032 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.045 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:51.044+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:51.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:51.146 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:51.151+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-17T01:55:51.158 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-17T01:55:51.161 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:51.161 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-17T01:55:51.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-17T01:55:51.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:55:51.212 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.212 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:51.246 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:51.251+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:51.346 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.347 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.347 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:51.348+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:51.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-17T01:55:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-17T01:55:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-17T01:55:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-17T01:55:51.396 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-17T01:55:51.397 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-17T01:55:51.399 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:51.399 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-17T01:55:51.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-17T01:55:51.448 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:51.451+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:51.493 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.494 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.508 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:51.549 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:51.548+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-17T01:55:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-17T01:55:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-17T01:55:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-17T01:55:51.624 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:55:51.625 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-17T01:55:51.625 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.625 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.639 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:51.684 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:51.687+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:51.750 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:51.755+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:51.757 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.757 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:51.851 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:51.851+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:51.901 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:51.901 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:51.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:51.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:51.952 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:51.955+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:52.033 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:52.033 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:52.047 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:52.091 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:52.092+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:52.138 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:52.138 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:52.154 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:52.152+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:52.164 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:52.164 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:52.166 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:55:52.173 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:52.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:52.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:52.206 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:52.255 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:52.259+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:52.308 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:52.308 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:52.309 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:52.309 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:52.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:52.356 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:52.359+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:52.444 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:52.445 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:52.445 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:52.445 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:52.445 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:52.456 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:52.459+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:52.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:52.558 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:52.556+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:52.579 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:52.579 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:52.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.305051160999994, 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:52.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:52.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:52.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.305012542, 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:52.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:52.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:52.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:52.592 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.304974955000006, 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:52.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:52.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.304823436000007, 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:52.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:52.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.304787117000004, 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:52.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:52.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:52.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:52.611 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.133636511000006, 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:52.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.133570765000002, 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:52.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.133451085999994, 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:52.626 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.632 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.133413816000001, 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:52.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:52.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.133351093000002, 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.639 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:52.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:52.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:52.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.133234196999993, 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:52.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.793332108000001, 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:52.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:52.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:52.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.793179305999999, 2024-09-17T01:55:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:52.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:52.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:52.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792957361000006, 2024-09-17T01:55:52.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:52.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:52.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792881898000005, 2024-09-17T01:55:52.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:52.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:52.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:52.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:52.675 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792799552000005, 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.676 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:52.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792512767999995, 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:52.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792423170999996, 2024-09-17T01:55:52.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:52.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:52.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792310638999993, 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:52.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.700 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 77.792053674000002, 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:52.701 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:52.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:52.707 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:52.709 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:52.715+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:52.709 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:52.809 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:52.815+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:52.841 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:52.841 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:52.841 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:52.841 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:52.855 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:52.910 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:52.915+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:52.972 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:52.972 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:52.972 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:52.972 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:52.972 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:52.986 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:53.011 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:53.012+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:53.103 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:53.103 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 73.078502123000007, 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:53.104 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:53.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.066416836000002, 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.109 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:53.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.113 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 71.055550752000002, 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:53.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:53.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896781809999993, 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:53.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:53.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:53.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.124 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896682044000002, 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:53.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:53.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:53.130 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896638248000002, 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:53.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:53.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896560332000007, 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:53.136 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:53.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896478466000005, 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.142 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:53.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:53.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:53.147 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896427716000005, 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.148 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:53.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:53.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896366909999998, 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:53.154 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:53.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.158 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896276976999999, 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:53.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.896217320999995, 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:53.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:53.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.894705888999994, 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:53.167 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:53.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.893799313000002, 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.171 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:53.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:53.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.893654271000003, 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:53.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.891891931000004, 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:53.180 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:53.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.184 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.891783278999995, 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:53.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:53.189 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 65.897421489999999, 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:53.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 48.895252960000001, 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.195 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:53.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:53.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.201 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 43.894579559999997, 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:53.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:53.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:53.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:53.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:53.207 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:53.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:53.209 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:53.211+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:53.310 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:53.315+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:53.335 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:53.335 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:53.348 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:53.411 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:53.413+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:53.456 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:53.457 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:53.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:53.512 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:53.515+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:53.613 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:53.613+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:53.631 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:53.631 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:53.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:53.631 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.538926884000006, 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:53.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.183021181000001, 2024-09-17T01:55:53.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:53.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:53.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.013357608000007, 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.645 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.012560401000002, 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:53.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:53.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.012003078000006, 2024-09-17T01:55:53.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:53.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:53.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.011461101999998, 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:53.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.010467896999998, 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:53.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:53.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.664 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.009907480999999, 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.009425907999997, 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.839522708999993, 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.838452310999998, 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.834643834000005, 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.428226164999998, 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.428122160000001, 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.428021100999999, 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.427913988, 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.427850922000005, 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.427792538999995, 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.427724783000002, 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.427658852999997, 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:53.732 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:53.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:53.734 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:53.735+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:53.835 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:53.835+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:53.865 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:53.865 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:53.865 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:53.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:53.936 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:53.939+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:53.997 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:53.997 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:53.998 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:53.998 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:53.998 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:54.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:54.036 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:54.037+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:54.137 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:54.137+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:54.139 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.864942780999996, 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.140 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:54.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:54.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:54.146 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.864904162000002, 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:54.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:54.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:54.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:54.152 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.864866574999994, 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:54.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:54.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.864715055999994, 2024-09-17T01:55:54.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:54.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:54.164 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.864678737000006, 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:54.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.170 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.693528130999994, 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:54.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.693462385000004, 2024-09-17T01:55:54.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:54.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:54.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:54.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.693342705999996, 2024-09-17T01:55:54.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:54.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:54.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.693305436000003, 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.189 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:54.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:54.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.693242713000004, 2024-09-17T01:55:54.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:54.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:54.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:54.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.693125816999995, 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.353223728000003, 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.208 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:54.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:54.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:54.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.353070926000001, 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:54.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:54.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.352848980999994, 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:54.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.352773518000006, 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:54.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:54.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.352691171999993, 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.232 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:54.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:54.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.352404387999997, 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.238 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:54.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:54.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.352314790999998, 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:54.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:54.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.352202258999995, 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.250 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:54.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:54.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:54.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:54.257 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.351945294000004, 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:54.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:54.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:54.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:54.263 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:54.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:55:54.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:54.266 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:54.267+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:54.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:54.367 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:54.371+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:54.398 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:54.398 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:54.398 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:54.398 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:54.412 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:54.466 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:54.467 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:54.467 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:54.467+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:54.500 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:54.500 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:54.533 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:54.534 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:54.535 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:54.568 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:54.571+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:54.669 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:54.671+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:54.699 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:54.699 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:54.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:54.769 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:54.771+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:54.840 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:54.840 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:54.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:54.898 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:54.901+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:54.961 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:54.962 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:54.971 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:54.973+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:54.974 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:55.073 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:55.079+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:55.124 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:55.125 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:55.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:55.174 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:55.173+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:55.174 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:55:55.268 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:55.268 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:55.274 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:55.279+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:55.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:55.375 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:55.377+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:55.399 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:55.400 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:55.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:55.476 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:55.477+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:55.538 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:55.539 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:55.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:55.577 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:55.579+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:55.678 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:55.677+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:55.685 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:55.686 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:55.700 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:55.779 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:55.779+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:55.818 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:55.818 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:55.833 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:55.880 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:55.887+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:55.983 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:55.981+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:56.005 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:56.005 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:56.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:56.083 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:56.085+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:56.152 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:56.152 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:56.168 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:56.211 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:56.213+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:56.285 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:56.291+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:56.326 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:56.326 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:56.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:56.386 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:56.385+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:56.447 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:56.447 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:56.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:56.506 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:56.511+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:56.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:55:56.588 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:56.591+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:56.593 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:56.593 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:56.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:56.625 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:55:56.625 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:55:56.625 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T01:55:56.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T01:55:56.689 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:56.689+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:56.758 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:56.758 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:56.771 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:56.771 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:56.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:56.790 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:56.795+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:56.792 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:56.793 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:56.824 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:56.824 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:56.890 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:56.895+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:56.908 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.631040274, 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:56.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:56.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.631001655000006, 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:56.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.630964067999997, 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:56.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:56.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.630812548999998, 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.927 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:56.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.630776229999995, 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:56.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:56.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.939 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.459625623999997, 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:56.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.459559877999993, 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.946 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:56.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.459440198999999, 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.952 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:56.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.459402929000007, 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:56.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.459340205999993, 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:56.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:56.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:56.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.459223309999999, 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:56.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.119321221000007, 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:56.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:56.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:56.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.119168419000005, 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:56.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118946473999998, 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:56.988 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:56.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:56.994 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118871010999996, 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.995 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:56.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:56.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118788664999997, 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:57.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:57.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.006 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118501881, 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:57.007 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:57.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:57.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118412284000001, 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:57.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:57.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:57.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118299751999999, 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.019 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:57.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:57.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:57.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 82.118042786999993, 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:57.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:57.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:57.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:57.031 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:57.032 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:57.033 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:57.033+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:57.092 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:57.092 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 42, 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-17T01:54:21.836260+0000", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-17T01:55:55.166493+0000", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-17T01:54:31.869613+0000", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-17T01:54:23.678756+0000", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5804032, 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "nodeep-scrub", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-17T01:55:57.093 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 3, 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-17T01:55:57.094 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:32.050776+0000", 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:57.095 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:57.096 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "11", 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:57.097 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:57.098 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:57.099 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 2.9900000095367432, 2024-09-17T01:55:57.100 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 2.9900000095367432, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:38.032150+0000", 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-17T01:55:57.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2024-09-17T01:55:57.102 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:57.103 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 2, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 15, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:57.104 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:57.105 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:57.106 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-17T01:55:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.055353+0000", 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:57.108 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:57.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:57.110 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:57.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:57.112 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:55:57.113 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.558395+0000", 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:55:57.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-17T01:55:57.115 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "19", 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:55:57.116 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:55:57.117 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:55:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:55:57.119 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:55:57.120 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "321981a6-5caa-44f3-b6ae-aa4e97947db6", 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:57.121 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6800", 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6801", 2024-09-17T01:55:57.122 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6802", 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6803", 2024-09-17T01:55:57.123 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6806", 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.124 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6807", 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6804", 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.125 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6805", 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.96:6801/1783419646", 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.96:6803/1783419646", 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.96:6807/1783419646", 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.96:6805/1783419646", 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "36930e57-781c-48b6-a499-40cb00df2f38", 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:57.127 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6800", 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6801", 2024-09-17T01:55:57.128 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6802", 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.129 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6803", 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6806", 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.130 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6807", 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6804", 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.131 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6805", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.98:6801/3191117572", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.98:6803/3191117572", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3191117572", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3191117572", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5a5a5a07-1fcd-4160-a4b1-e8431052e44c", 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:55:57.133 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6800", 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6801", 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6802", 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6803", 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6806", 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6807", 2024-09-17T01:55:57.136 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6804", 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:55:57.137 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6805", 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.154:6801/495067980", 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.154:6803/495067980", 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.154:6807/495067980", 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.154:6805/495067980", 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.138 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.631084+0000", 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.623706+0000", 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:55:57.140 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.711322+0000", 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-17T01:55:57.141 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-17T01:55:57.142 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:55:57.143 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:55:57.145 INFO:tasks.thrashosds.thrasher:j is {'epoch': 42, 'fsid': '7af2c608-be6c-4ac4-a462-cff6aa13e357', 'created': '2024-09-17T01:54:21.836260+0000', 'modified': '2024-09-17T01:55:55.166493+0000', 'last_up_change': '2024-09-17T01:54:31.869613+0000', 'last_in_change': '2024-09-17T01:54:23.678756+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:54:32.050776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T01:54:38.032150+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T01:54:43.055353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T01:54:43.558395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '321981a6-5caa-44f3-b6ae-aa4e97947db6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6800', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6801', 'nonce': 1783419646}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 1783419646}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6806', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6807', 'nonce': 1783419646}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6804', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6805', 'nonce': 1783419646}]}, 'public_addr': '172.21.15.96:6801/1783419646', 'cluster_addr': '172.21.15.96:6803/1783419646', 'heartbeat_back_addr': '172.21.15.96:6807/1783419646', 'heartbeat_front_addr': '172.21.15.96:6805/1783419646', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '36930e57-781c-48b6-a499-40cb00df2f38', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3191117572}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3191117572}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3191117572}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3191117572}]}, 'public_addr': '172.21.15.98:6801/3191117572', 'cluster_addr': '172.21.15.98:6803/3191117572', 'heartbeat_back_addr': '172.21.15.98:6807/3191117572', 'heartbeat_front_addr': '172.21.15.98:6805/3191117572', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5a5a5a07-1fcd-4160-a4b1-e8431052e44c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 495067980}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 495067980}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 495067980}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 495067980}]}, 'public_addr': '172.21.15.154:6801/495067980', 'cluster_addr': '172.21.15.154:6803/495067980', 'heartbeat_back_addr': '172.21.15.154:6807/495067980', 'heartbeat_front_addr': '172.21.15.154:6805/495067980', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.631084+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.623706+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.711322+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T01:55:57.145 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:55:57.146 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:57.151+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:57.166 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:57.166 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:57.166 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:57.166 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:57.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:57.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:55:57.245 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:57.251+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:57.309 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:57.310 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:57.310 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:55:57.310 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:55:57.310 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:57.324 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:57.368 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:57.371+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:57.445 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:57.445 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:55:57.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:55:57.445 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:55:57.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.445 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 77.418824907000001, 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:55:57.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:55:57.450 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.406739619999996, 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 75.395873535999996, 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:55:57.455 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:55:57.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:55:57.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.237104594000002, 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.460 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.237004827999996, 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:55:57.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:55:57.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236961031999996, 2024-09-17T01:55:57.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:55:57.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:55:57.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236883116000001, 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:55:57.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:55:57.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:57.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.482 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236801249999999, 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:55:57.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236750499999999, 2024-09-17T01:55:57.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:55:57.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:55:57.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236689694000006, 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:55:57.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236599760999994, 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.498 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.236540105000003, 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.502 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:55:57.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:57.506 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.235028673000002, 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:55:57.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.234122096999997, 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.510 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.514 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.233977054999997, 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:55:57.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:55:57.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.232214714999998, 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:55:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:55:57.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.232106063000003, 2024-09-17T01:55:57.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:57.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.527 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 70.237744273999994, 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:55:57.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:55:57.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:55:57.533 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 53.235575744000002, 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:55:57.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.539 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 48.234902343999998, 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:55:57.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:55:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:55:57.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:55:57.545 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:57.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:57.550 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:57.547+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:57.550 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:55:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:55:57.553 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-17T01:55:55.990872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90580,"kb_used_data":1176,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024940,"statfs":{"total":289910292480,"available":289817538560,"internally_reserved":0,"allocated":1204224,"data_stored":1638694,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.837962"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.784079+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:55:50.784079+0000","last_peered":"2024-09-17T01:55:50.784079+0000","last_clean":"2024-09-17T01:55:50.784079+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:55:50.784079+0000","last_undegraded":"2024-09-17T01:55:50.784079+0000","last_fullsized":"2024-09-17T01:55:50.784079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783450+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:55:50.783450+0000","last_peered":"2024-09-17T01:55:50.783450+0000","last_clean":"2024-09-17T01:55:50.783450+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:55:50.783450+0000","last_undegraded":"2024-09-17T01:55:50.783450+0000","last_fullsized":"2024-09-17T01:55:50.783450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287712+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:55:51.287712+0000","last_peered":"2024-09-17T01:55:51.287712+0000","last_clean":"2024-09-17T01:55:51.287712+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:55:51.287712+0000","last_undegraded":"2024-09-17T01:55:51.287712+0000","last_fullsized":"2024-09-17T01:55:51.287712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287680+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:55:51.287680+0000","last_peered":"2024-09-17T01:55:51.287680+0000","last_clean":"2024-09-17T01:55:51.287680+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:55:51.287680+0000","last_undegraded":"2024-09-17T01:55:51.287680+0000","last_fullsized":"2024-09-17T01:55:51.287680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783178+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:55:50.783178+0000","last_peered":"2024-09-17T01:55:50.783178+0000","last_clean":"2024-09-17T01:55:50.783178+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:55:50.783178+0000","last_undegraded":"2024-09-17T01:55:50.783178+0000","last_fullsized":"2024-09-17T01:55:50.783178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287260+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:55:51.287260+0000","last_peered":"2024-09-17T01:55:51.287260+0000","last_clean":"2024-09-17T01:55:51.287260+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:55:51.287260+0000","last_undegraded":"2024-09-17T01:55:51.287260+0000","last_fullsized":"2024-09-17T01:55:51.287260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287259+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:55:51.287259+0000","last_peered":"2024-09-17T01:55:51.287259+0000","last_clean":"2024-09-17T01:55:51.287259+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:55:51.287259+0000","last_undegraded":"2024-09-17T01:55:51.287259+0000","last_fullsized":"2024-09-17T01:55:51.287259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287014+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:55:51.287014+0000","last_peered":"2024-09-17T01:55:51.287014+0000","last_clean":"2024-09-17T01:55:51.287014+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:55:51.287014+0000","last_undegraded":"2024-09-17T01:55:51.287014+0000","last_fullsized":"2024-09-17T01:55:51.287014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159447+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:55:49.159447+0000","last_peered":"2024-09-17T01:55:49.159447+0000","last_clean":"2024-09-17T01:55:49.159447+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:55:49.159447+0000","last_undegraded":"2024-09-17T01:55:49.159447+0000","last_fullsized":"2024-09-17T01:55:49.159447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783508+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:55:50.783508+0000","last_peered":"2024-09-17T01:55:50.783508+0000","last_clean":"2024-09-17T01:55:50.783508+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:55:50.783508+0000","last_undegraded":"2024-09-17T01:55:50.783508+0000","last_fullsized":"2024-09-17T01:55:50.783508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287751+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:55:51.287751+0000","last_peered":"2024-09-17T01:55:51.287751+0000","last_clean":"2024-09-17T01:55:51.287751+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:55:51.287751+0000","last_undegraded":"2024-09-17T01:55:51.287751+0000","last_fullsized":"2024-09-17T01:55:51.287751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783235+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:55:50.783235+0000","last_peered":"2024-09-17T01:55:50.783235+0000","last_clean":"2024-09-17T01:55:50.783235+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:55:50.783235+0000","last_undegraded":"2024-09-17T01:55:50.783235+0000","last_fullsized":"2024-09-17T01:55:50.783235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783067+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:55:50.783067+0000","last_peered":"2024-09-17T01:55:50.783067+0000","last_clean":"2024-09-17T01:55:50.783067+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:55:50.783067+0000","last_undegraded":"2024-09-17T01:55:50.783067+0000","last_fullsized":"2024-09-17T01:55:50.783067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287310+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:55:51.287310+0000","last_peered":"2024-09-17T01:55:51.287310+0000","last_clean":"2024-09-17T01:55:51.287310+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:55:51.287310+0000","last_undegraded":"2024-09-17T01:55:51.287310+0000","last_fullsized":"2024-09-17T01:55:51.287310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287260+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:55:51.287260+0000","last_peered":"2024-09-17T01:55:51.287260+0000","last_clean":"2024-09-17T01:55:51.287260+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:55:51.287260+0000","last_undegraded":"2024-09-17T01:55:51.287260+0000","last_fullsized":"2024-09-17T01:55:51.287260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287080+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:55:51.287080+0000","last_peered":"2024-09-17T01:55:51.287080+0000","last_clean":"2024-09-17T01:55:51.287080+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:55:51.287080+0000","last_undegraded":"2024-09-17T01:55:51.287080+0000","last_fullsized":"2024-09-17T01:55:51.287080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.160091+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:55:49.160091+0000","last_peered":"2024-09-17T01:55:49.160091+0000","last_clean":"2024-09-17T01:55:49.160091+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:55:49.160091+0000","last_undegraded":"2024-09-17T01:55:49.160091+0000","last_fullsized":"2024-09-17T01:55:49.160091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783729+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:55:50.783729+0000","last_peered":"2024-09-17T01:55:50.783729+0000","last_clean":"2024-09-17T01:55:50.783729+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:55:50.783729+0000","last_undegraded":"2024-09-17T01:55:50.783729+0000","last_fullsized":"2024-09-17T01:55:50.783729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158777+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:55:49.158777+0000","last_peered":"2024-09-17T01:55:49.158777+0000","last_clean":"2024-09-17T01:55:49.158777+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:55:49.158777+0000","last_undegraded":"2024-09-17T01:55:49.158777+0000","last_fullsized":"2024-09-17T01:55:49.158777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287771+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:55:51.287771+0000","last_peered":"2024-09-17T01:55:51.287771+0000","last_clean":"2024-09-17T01:55:51.287771+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:55:51.287771+0000","last_undegraded":"2024-09-17T01:55:51.287771+0000","last_fullsized":"2024-09-17T01:55:51.287771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287761+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:55:51.287761+0000","last_peered":"2024-09-17T01:55:51.287761+0000","last_clean":"2024-09-17T01:55:51.287761+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:55:51.287761+0000","last_undegraded":"2024-09-17T01:55:51.287761+0000","last_fullsized":"2024-09-17T01:55:51.287761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782935+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:55:50.782935+0000","last_peered":"2024-09-17T01:55:50.782935+0000","last_clean":"2024-09-17T01:55:50.782935+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:55:50.782935+0000","last_undegraded":"2024-09-17T01:55:50.782935+0000","last_fullsized":"2024-09-17T01:55:50.782935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157211+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:55:49.157211+0000","last_peered":"2024-09-17T01:55:49.157211+0000","last_clean":"2024-09-17T01:55:49.157211+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:55:49.157211+0000","last_undegraded":"2024-09-17T01:55:49.157211+0000","last_fullsized":"2024-09-17T01:55:49.157211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782340+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:55:50.782340+0000","last_peered":"2024-09-17T01:55:50.782340+0000","last_clean":"2024-09-17T01:55:50.782340+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:55:50.782340+0000","last_undegraded":"2024-09-17T01:55:50.782340+0000","last_fullsized":"2024-09-17T01:55:50.782340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.784207+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:55:50.784207+0000","last_peered":"2024-09-17T01:55:50.784207+0000","last_clean":"2024-09-17T01:55:50.784207+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:55:50.784207+0000","last_undegraded":"2024-09-17T01:55:50.784207+0000","last_fullsized":"2024-09-17T01:55:50.784207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159325+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:55:49.159325+0000","last_peered":"2024-09-17T01:55:49.159325+0000","last_clean":"2024-09-17T01:55:49.159325+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:55:49.159325+0000","last_undegraded":"2024-09-17T01:55:49.159325+0000","last_fullsized":"2024-09-17T01:55:49.159325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287855+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:55:51.287855+0000","last_peered":"2024-09-17T01:55:51.287855+0000","last_clean":"2024-09-17T01:55:51.287855+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:55:51.287855+0000","last_undegraded":"2024-09-17T01:55:51.287855+0000","last_fullsized":"2024-09-17T01:55:51.287855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783546+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:55:50.783546+0000","last_peered":"2024-09-17T01:55:50.783546+0000","last_clean":"2024-09-17T01:55:50.783546+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:55:50.783546+0000","last_undegraded":"2024-09-17T01:55:50.783546+0000","last_fullsized":"2024-09-17T01:55:50.783546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158351+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:55:49.158351+0000","last_peered":"2024-09-17T01:55:49.158351+0000","last_clean":"2024-09-17T01:55:49.158351+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:55:49.158351+0000","last_undegraded":"2024-09-17T01:55:49.158351+0000","last_fullsized":"2024-09-17T01:55:49.158351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783013+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:55:50.783013+0000","last_peered":"2024-09-17T01:55:50.783013+0000","last_clean":"2024-09-17T01:55:50.783013+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:55:50.783013+0000","last_undegraded":"2024-09-17T01:55:50.783013+0000","last_fullsized":"2024-09-17T01:55:50.783013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157327+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:55:49.157327+0000","last_peered":"2024-09-17T01:55:49.157327+0000","last_clean":"2024-09-17T01:55:49.157327+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:55:49.157327+0000","last_undegraded":"2024-09-17T01:55:49.157327+0000","last_fullsized":"2024-09-17T01:55:49.157327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287258+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:55:51.287258+0000","last_peered":"2024-09-17T01:55:51.287258+0000","last_clean":"2024-09-17T01:55:51.287258+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:55:51.287258+0000","last_undegraded":"2024-09-17T01:55:51.287258+0000","last_fullsized":"2024-09-17T01:55:51.287258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783399+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:55:50.783399+0000","last_peered":"2024-09-17T01:55:50.783399+0000","last_clean":"2024-09-17T01:55:50.783399+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:55:50.783399+0000","last_undegraded":"2024-09-17T01:55:50.783399+0000","last_fullsized":"2024-09-17T01:55:50.783399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287943+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:55:51.287943+0000","last_peered":"2024-09-17T01:55:51.287943+0000","last_clean":"2024-09-17T01:55:51.287943+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:55:51.287943+0000","last_undegraded":"2024-09-17T01:55:51.287943+0000","last_fullsized":"2024-09-17T01:55:51.287943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783474+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:55:50.783474+0000","last_peered":"2024-09-17T01:55:50.783474+0000","last_clean":"2024-09-17T01:55:50.783474+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:55:50.783474+0000","last_undegraded":"2024-09-17T01:55:50.783474+0000","last_fullsized":"2024-09-17T01:55:50.783474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158006+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:55:49.158006+0000","last_peered":"2024-09-17T01:55:49.158006+0000","last_clean":"2024-09-17T01:55:49.158006+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:55:49.158006+0000","last_undegraded":"2024-09-17T01:55:49.158006+0000","last_fullsized":"2024-09-17T01:55:49.158006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159776+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:55:49.159776+0000","last_peered":"2024-09-17T01:55:49.159776+0000","last_clean":"2024-09-17T01:55:49.159776+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:55:49.159776+0000","last_undegraded":"2024-09-17T01:55:49.159776+0000","last_fullsized":"2024-09-17T01:55:49.159776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782675+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:55:50.782675+0000","last_peered":"2024-09-17T01:55:50.782675+0000","last_clean":"2024-09-17T01:55:50.782675+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:55:50.782675+0000","last_undegraded":"2024-09-17T01:55:50.782675+0000","last_fullsized":"2024-09-17T01:55:50.782675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159534+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:55:49.159534+0000","last_peered":"2024-09-17T01:55:49.159534+0000","last_clean":"2024-09-17T01:55:49.159534+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:55:49.159534+0000","last_undegraded":"2024-09-17T01:55:49.159534+0000","last_fullsized":"2024-09-17T01:55:49.159534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287252+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:55:51.287252+0000","last_peered":"2024-09-17T01:55:51.287252+0000","last_clean":"2024-09-17T01:55:51.287252+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:55:51.287252+0000","last_undegraded":"2024-09-17T01:55:51.287252+0000","last_fullsized":"2024-09-17T01:55:51.287252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288517+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:55:51.288517+0000","last_peered":"2024-09-17T01:55:51.288517+0000","last_clean":"2024-09-17T01:55:51.288517+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:55:51.288517+0000","last_undegraded":"2024-09-17T01:55:51.288517+0000","last_fullsized":"2024-09-17T01:55:51.288517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782361+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:55:50.782361+0000","last_peered":"2024-09-17T01:55:50.782361+0000","last_clean":"2024-09-17T01:55:50.782361+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:55:50.782361+0000","last_undegraded":"2024-09-17T01:55:50.782361+0000","last_fullsized":"2024-09-17T01:55:50.782361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783798+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:55:50.783798+0000","last_peered":"2024-09-17T01:55:50.783798+0000","last_clean":"2024-09-17T01:55:50.783798+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:55:50.783798+0000","last_undegraded":"2024-09-17T01:55:50.783798+0000","last_fullsized":"2024-09-17T01:55:50.783798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782552+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:55:50.782552+0000","last_peered":"2024-09-17T01:55:50.782552+0000","last_clean":"2024-09-17T01:55:50.782552+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:55:50.782552+0000","last_undegraded":"2024-09-17T01:55:50.782552+0000","last_fullsized":"2024-09-17T01:55:50.782552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288257+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:55:51.288257+0000","last_peered":"2024-09-17T01:55:51.288257+0000","last_clean":"2024-09-17T01:55:51.288257+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:55:51.288257+0000","last_undegraded":"2024-09-17T01:55:51.288257+0000","last_fullsized":"2024-09-17T01:55:51.288257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287494+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:55:51.287494+0000","last_peered":"2024-09-17T01:55:51.287494+0000","last_clean":"2024-09-17T01:55:51.287494+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:55:51.287494+0000","last_undegraded":"2024-09-17T01:55:51.287494+0000","last_fullsized":"2024-09-17T01:55:51.287494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288026+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:55:51.288026+0000","last_peered":"2024-09-17T01:55:51.288026+0000","last_clean":"2024-09-17T01:55:51.288026+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:55:51.288026+0000","last_undegraded":"2024-09-17T01:55:51.288026+0000","last_fullsized":"2024-09-17T01:55:51.288026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157987+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:55:49.157987+0000","last_peered":"2024-09-17T01:55:49.157987+0000","last_clean":"2024-09-17T01:55:49.157987+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:55:49.157987+0000","last_undegraded":"2024-09-17T01:55:49.157987+0000","last_fullsized":"2024-09-17T01:55:49.157987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158832+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:55:49.158832+0000","last_peered":"2024-09-17T01:55:49.158832+0000","last_clean":"2024-09-17T01:55:49.158832+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:55:49.158832+0000","last_undegraded":"2024-09-17T01:55:49.158832+0000","last_fullsized":"2024-09-17T01:55:49.158832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287797+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:55:51.287797+0000","last_peered":"2024-09-17T01:55:51.287797+0000","last_clean":"2024-09-17T01:55:51.287797+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:55:51.287797+0000","last_undegraded":"2024-09-17T01:55:51.287797+0000","last_fullsized":"2024-09-17T01:55:51.287797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287555+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:55:51.287555+0000","last_peered":"2024-09-17T01:55:51.287555+0000","last_clean":"2024-09-17T01:55:51.287555+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:55:51.287555+0000","last_undegraded":"2024-09-17T01:55:51.287555+0000","last_fullsized":"2024-09-17T01:55:51.287555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288135+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:55:51.288135+0000","last_peered":"2024-09-17T01:55:51.288135+0000","last_clean":"2024-09-17T01:55:51.288135+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:55:51.288135+0000","last_undegraded":"2024-09-17T01:55:51.288135+0000","last_fullsized":"2024-09-17T01:55:51.288135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782711+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:55:50.782711+0000","last_peered":"2024-09-17T01:55:50.782711+0000","last_clean":"2024-09-17T01:55:50.782711+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:55:50.782711+0000","last_undegraded":"2024-09-17T01:55:50.782711+0000","last_fullsized":"2024-09-17T01:55:50.782711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288286+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:55:51.288286+0000","last_peered":"2024-09-17T01:55:51.288286+0000","last_clean":"2024-09-17T01:55:51.288286+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:55:51.288286+0000","last_undegraded":"2024-09-17T01:55:51.288286+0000","last_fullsized":"2024-09-17T01:55:51.288286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782431+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:55:50.782431+0000","last_peered":"2024-09-17T01:55:50.782431+0000","last_clean":"2024-09-17T01:55:50.782431+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:55:50.782431+0000","last_undegraded":"2024-09-17T01:55:50.782431+0000","last_fullsized":"2024-09-17T01:55:50.782431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159597+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:55:49.159597+0000","last_peered":"2024-09-17T01:55:49.159597+0000","last_clean":"2024-09-17T01:55:49.159597+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:55:49.159597+0000","last_undegraded":"2024-09-17T01:55:49.159597+0000","last_fullsized":"2024-09-17T01:55:49.159597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":266,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287704+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:55:51.287704+0000","last_peered":"2024-09-17T01:55:51.287704+0000","last_clean":"2024-09-17T01:55:51.287704+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:55:51.287704+0000","last_undegraded":"2024-09-17T01:55:51.287704+0000","last_fullsized":"2024-09-17T01:55:51.287704+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288092+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:55:51.288092+0000","last_peered":"2024-09-17T01:55:51.288092+0000","last_clean":"2024-09-17T01:55:51.288092+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:55:51.288092+0000","last_undegraded":"2024-09-17T01:55:51.288092+0000","last_fullsized":"2024-09-17T01:55:51.288092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158305+0000","last_change":"2024-09-17T01:54:44.230885+0000","last_active":"2024-09-17T01:55:49.158305+0000","last_peered":"2024-09-17T01:55:49.158305+0000","last_clean":"2024-09-17T01:55:49.158305+0000","last_became_active":"2024-09-17T01:54:44.229876+0000","last_became_peered":"2024-09-17T01:54:44.229876+0000","last_unstale":"2024-09-17T01:55:49.158305+0000","last_undegraded":"2024-09-17T01:55:49.158305+0000","last_fullsized":"2024-09-17T01:55:49.158305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:59.834662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288137+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:55:51.288137+0000","last_peered":"2024-09-17T01:55:51.288137+0000","last_clean":"2024-09-17T01:55:51.288137+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:55:51.288137+0000","last_undegraded":"2024-09-17T01:55:51.288137+0000","last_fullsized":"2024-09-17T01:55:51.288137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287566+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:55:51.287566+0000","last_peered":"2024-09-17T01:55:51.287566+0000","last_clean":"2024-09-17T01:55:51.287566+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:55:51.287566+0000","last_undegraded":"2024-09-17T01:55:51.287566+0000","last_fullsized":"2024-09-17T01:55:51.287566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157828+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:55:49.157828+0000","last_peered":"2024-09-17T01:55:49.157828+0000","last_clean":"2024-09-17T01:55:49.157828+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:55:49.157828+0000","last_undegraded":"2024-09-17T01:55:49.157828+0000","last_fullsized":"2024-09-17T01:55:49.157828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783598+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:55:50.783598+0000","last_peered":"2024-09-17T01:55:50.783598+0000","last_clean":"2024-09-17T01:55:50.783598+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:55:50.783598+0000","last_undegraded":"2024-09-17T01:55:50.783598+0000","last_fullsized":"2024-09-17T01:55:50.783598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158161+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:55:49.158161+0000","last_peered":"2024-09-17T01:55:49.158161+0000","last_clean":"2024-09-17T01:55:49.158161+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:55:49.158161+0000","last_undegraded":"2024-09-17T01:55:49.158161+0000","last_fullsized":"2024-09-17T01:55:49.158161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782446+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:55:50.782446+0000","last_peered":"2024-09-17T01:55:50.782446+0000","last_clean":"2024-09-17T01:55:50.782446+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:55:50.782446+0000","last_undegraded":"2024-09-17T01:55:50.782446+0000","last_fullsized":"2024-09-17T01:55:50.782446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159793+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:55:49.159793+0000","last_peered":"2024-09-17T01:55:49.159793+0000","last_clean":"2024-09-17T01:55:49.159793+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:55:49.159793+0000","last_undegraded":"2024-09-17T01:55:49.159793+0000","last_fullsized":"2024-09-17T01:55:49.159793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":71,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287643+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:55:51.287643+0000","last_peered":"2024-09-17T01:55:51.287643+0000","last_clean":"2024-09-17T01:55:51.287643+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:55:51.287643+0000","last_undegraded":"2024-09-17T01:55:51.287643+0000","last_fullsized":"2024-09-17T01:55:51.287643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288025+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:55:51.288025+0000","last_peered":"2024-09-17T01:55:51.288025+0000","last_clean":"2024-09-17T01:55:51.288025+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:55:51.288025+0000","last_undegraded":"2024-09-17T01:55:51.288025+0000","last_fullsized":"2024-09-17T01:55:51.288025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.158925+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:55:49.158925+0000","last_peered":"2024-09-17T01:55:49.158925+0000","last_clean":"2024-09-17T01:55:49.158925+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:55:49.158925+0000","last_undegraded":"2024-09-17T01:55:49.158925+0000","last_fullsized":"2024-09-17T01:55:49.158925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288285+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:55:51.288285+0000","last_peered":"2024-09-17T01:55:51.288285+0000","last_clean":"2024-09-17T01:55:51.288285+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:55:51.288285+0000","last_undegraded":"2024-09-17T01:55:51.288285+0000","last_fullsized":"2024-09-17T01:55:51.288285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159274+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:55:49.159274+0000","last_peered":"2024-09-17T01:55:49.159274+0000","last_clean":"2024-09-17T01:55:49.159274+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:55:49.159274+0000","last_undegraded":"2024-09-17T01:55:49.159274+0000","last_fullsized":"2024-09-17T01:55:49.159274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782945+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:55:50.782945+0000","last_peered":"2024-09-17T01:55:50.782945+0000","last_clean":"2024-09-17T01:55:50.782945+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:55:50.782945+0000","last_undegraded":"2024-09-17T01:55:50.782945+0000","last_fullsized":"2024-09-17T01:55:50.782945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159201+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:55:49.159201+0000","last_peered":"2024-09-17T01:55:49.159201+0000","last_clean":"2024-09-17T01:55:49.159201+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:55:49.159201+0000","last_undegraded":"2024-09-17T01:55:49.159201+0000","last_fullsized":"2024-09-17T01:55:49.159201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783792+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:55:50.783792+0000","last_peered":"2024-09-17T01:55:50.783792+0000","last_clean":"2024-09-17T01:55:50.783792+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:55:50.783792+0000","last_undegraded":"2024-09-17T01:55:50.783792+0000","last_fullsized":"2024-09-17T01:55:50.783792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783115+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:55:50.783115+0000","last_peered":"2024-09-17T01:55:50.783115+0000","last_clean":"2024-09-17T01:55:50.783115+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:55:50.783115+0000","last_undegraded":"2024-09-17T01:55:50.783115+0000","last_fullsized":"2024-09-17T01:55:50.783115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.160157+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:55:49.160157+0000","last_peered":"2024-09-17T01:55:49.160157+0000","last_clean":"2024-09-17T01:55:49.160157+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:55:49.160157+0000","last_undegraded":"2024-09-17T01:55:49.160157+0000","last_fullsized":"2024-09-17T01:55:49.160157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.160024+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:55:49.160024+0000","last_peered":"2024-09-17T01:55:49.160024+0000","last_clean":"2024-09-17T01:55:49.160024+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:55:49.160024+0000","last_undegraded":"2024-09-17T01:55:49.160024+0000","last_fullsized":"2024-09-17T01:55:49.160024+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157650+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:55:49.157650+0000","last_peered":"2024-09-17T01:55:49.157650+0000","last_clean":"2024-09-17T01:55:49.157650+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:55:49.157650+0000","last_undegraded":"2024-09-17T01:55:49.157650+0000","last_fullsized":"2024-09-17T01:55:49.157650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"23'3","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159910+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:55:49.159910+0000","last_peered":"2024-09-17T01:55:49.159910+0000","last_clean":"2024-09-17T01:55:49.159910+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:55:49.159910+0000","last_undegraded":"2024-09-17T01:55:49.159910+0000","last_fullsized":"2024-09-17T01:55:49.159910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288569+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:55:51.288569+0000","last_peered":"2024-09-17T01:55:51.288569+0000","last_clean":"2024-09-17T01:55:51.288569+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:55:51.288569+0000","last_undegraded":"2024-09-17T01:55:51.288569+0000","last_fullsized":"2024-09-17T01:55:51.288569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782550+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:55:50.782550+0000","last_peered":"2024-09-17T01:55:50.782550+0000","last_clean":"2024-09-17T01:55:50.782550+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:55:50.782550+0000","last_undegraded":"2024-09-17T01:55:50.782550+0000","last_fullsized":"2024-09-17T01:55:50.782550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287896+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:55:51.287896+0000","last_peered":"2024-09-17T01:55:51.287896+0000","last_clean":"2024-09-17T01:55:51.287896+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:55:51.287896+0000","last_undegraded":"2024-09-17T01:55:51.287896+0000","last_fullsized":"2024-09-17T01:55:51.287896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":66,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287923+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:55:51.287923+0000","last_peered":"2024-09-17T01:55:51.287923+0000","last_clean":"2024-09-17T01:55:51.287923+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:55:51.287923+0000","last_undegraded":"2024-09-17T01:55:51.287923+0000","last_fullsized":"2024-09-17T01:55:51.287923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157652+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:55:49.157652+0000","last_peered":"2024-09-17T01:55:49.157652+0000","last_clean":"2024-09-17T01:55:49.157652+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:55:49.157652+0000","last_undegraded":"2024-09-17T01:55:49.157652+0000","last_fullsized":"2024-09-17T01:55:49.157652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783717+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:55:50.783717+0000","last_peered":"2024-09-17T01:55:50.783717+0000","last_clean":"2024-09-17T01:55:50.783717+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:55:50.783717+0000","last_undegraded":"2024-09-17T01:55:50.783717+0000","last_fullsized":"2024-09-17T01:55:50.783717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.288392+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:55:51.288392+0000","last_peered":"2024-09-17T01:55:51.288392+0000","last_clean":"2024-09-17T01:55:51.288392+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:55:51.288392+0000","last_undegraded":"2024-09-17T01:55:51.288392+0000","last_fullsized":"2024-09-17T01:55:51.288392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157516+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:55:49.157516+0000","last_peered":"2024-09-17T01:55:49.157516+0000","last_clean":"2024-09-17T01:55:49.157516+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:55:49.157516+0000","last_undegraded":"2024-09-17T01:55:49.157516+0000","last_fullsized":"2024-09-17T01:55:49.157516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.160024+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:55:49.160024+0000","last_peered":"2024-09-17T01:55:49.160024+0000","last_clean":"2024-09-17T01:55:49.160024+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:55:49.160024+0000","last_undegraded":"2024-09-17T01:55:49.160024+0000","last_fullsized":"2024-09-17T01:55:49.160024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157438+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:55:49.157438+0000","last_peered":"2024-09-17T01:55:49.157438+0000","last_clean":"2024-09-17T01:55:49.157438+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:55:49.157438+0000","last_undegraded":"2024-09-17T01:55:49.157438+0000","last_fullsized":"2024-09-17T01:55:49.157438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.784335+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:55:50.784335+0000","last_peered":"2024-09-17T01:55:50.784335+0000","last_clean":"2024-09-17T01:55:50.784335+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:55:50.784335+0000","last_undegraded":"2024-09-17T01:55:50.784335+0000","last_fullsized":"2024-09-17T01:55:50.784335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157785+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:55:49.157785+0000","last_peered":"2024-09-17T01:55:49.157785+0000","last_clean":"2024-09-17T01:55:49.157785+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:55:49.157785+0000","last_undegraded":"2024-09-17T01:55:49.157785+0000","last_fullsized":"2024-09-17T01:55:49.157785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159327+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:55:49.159327+0000","last_peered":"2024-09-17T01:55:49.159327+0000","last_clean":"2024-09-17T01:55:49.159327+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:55:49.159327+0000","last_undegraded":"2024-09-17T01:55:49.159327+0000","last_fullsized":"2024-09-17T01:55:49.159327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.157890+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:55:49.157890+0000","last_peered":"2024-09-17T01:55:49.157890+0000","last_clean":"2024-09-17T01:55:49.157890+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:55:49.157890+0000","last_undegraded":"2024-09-17T01:55:49.157890+0000","last_fullsized":"2024-09-17T01:55:49.157890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783417+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:55:50.783417+0000","last_peered":"2024-09-17T01:55:50.783417+0000","last_clean":"2024-09-17T01:55:50.783417+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:55:50.783417+0000","last_undegraded":"2024-09-17T01:55:50.783417+0000","last_fullsized":"2024-09-17T01:55:50.783417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783043+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:55:50.783043+0000","last_peered":"2024-09-17T01:55:50.783043+0000","last_clean":"2024-09-17T01:55:50.783043+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:55:50.783043+0000","last_undegraded":"2024-09-17T01:55:50.783043+0000","last_fullsized":"2024-09-17T01:55:50.783043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783300+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:55:50.783300+0000","last_peered":"2024-09-17T01:55:50.783300+0000","last_clean":"2024-09-17T01:55:50.783300+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:55:50.783300+0000","last_undegraded":"2024-09-17T01:55:50.783300+0000","last_fullsized":"2024-09-17T01:55:50.783300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783227+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:55:50.783227+0000","last_peered":"2024-09-17T01:55:50.783227+0000","last_clean":"2024-09-17T01:55:50.783227+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:55:50.783227+0000","last_undegraded":"2024-09-17T01:55:50.783227+0000","last_fullsized":"2024-09-17T01:55:50.783227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287823+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:55:51.287823+0000","last_peered":"2024-09-17T01:55:51.287823+0000","last_clean":"2024-09-17T01:55:51.287823+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:55:51.287823+0000","last_undegraded":"2024-09-17T01:55:51.287823+0000","last_fullsized":"2024-09-17T01:55:51.287823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287891+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:55:51.287891+0000","last_peered":"2024-09-17T01:55:51.287891+0000","last_clean":"2024-09-17T01:55:51.287891+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:55:51.287891+0000","last_undegraded":"2024-09-17T01:55:51.287891+0000","last_fullsized":"2024-09-17T01:55:51.287891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287426+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:55:51.287426+0000","last_peered":"2024-09-17T01:55:51.287426+0000","last_clean":"2024-09-17T01:55:51.287426+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:55:51.287426+0000","last_undegraded":"2024-09-17T01:55:51.287426+0000","last_fullsized":"2024-09-17T01:55:51.287426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.783561+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:55:50.783561+0000","last_peered":"2024-09-17T01:55:50.783561+0000","last_clean":"2024-09-17T01:55:50.783561+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:55:50.783561+0000","last_undegraded":"2024-09-17T01:55:50.783561+0000","last_fullsized":"2024-09-17T01:55:50.783561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:50.782788+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:55:50.782788+0000","last_peered":"2024-09-17T01:55:50.782788+0000","last_clean":"2024-09-17T01:55:50.782788+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:55:50.782788+0000","last_undegraded":"2024-09-17T01:55:50.782788+0000","last_fullsized":"2024-09-17T01:55:50.782788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159753+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:55:49.159753+0000","last_peered":"2024-09-17T01:55:49.159753+0000","last_clean":"2024-09-17T01:55:49.159753+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:55:49.159753+0000","last_undegraded":"2024-09-17T01:55:49.159753+0000","last_fullsized":"2024-09-17T01:55:49.159753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:51.287440+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:55:51.287440+0000","last_peered":"2024-09-17T01:55:51.287440+0000","last_clean":"2024-09-17T01:55:51.287440+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:55:51.287440+0000","last_undegraded":"2024-09-17T01:55:51.287440+0000","last_fullsized":"2024-09-17T01:55:51.287440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:55:49.159826+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:55:49.159826+0000","last_peered":"2024-09-17T01:55:49.159826+0000","last_clean":"2024-09-17T01:55:49.159826+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:55:49.159826+0000","last_undegraded":"2024-09-17T01:55:49.159826+0000","last_fullsized":"2024-09-17T01:55:49.159826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":434176,"data_stored":745478,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":421888,"data_stored":744843,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":148373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:55:57.557 INFO:tasks.thrashosds.thrasher:Setting 3.2 to [2, 1] 2024-09-17T01:55:57.557 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.2', '2', '1'] 2024-09-17T01:55:57.557 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.2 2 1 2024-09-17T01:55:57.648 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:57.649+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:57.686 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:55:57.687 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:57.700 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:57.749 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:57.751+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:57.850 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:57.851+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:57.865 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:57.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:55:57.865 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:55:57.865 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:55:57.865 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:57.879 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:57.952 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:57.953+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:55:57.997 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.905982464999994, 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:57.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.002 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.550076762000003, 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:55:58.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:55:58.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.380413188999995, 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.009 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:58.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.379615982000004, 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:55:58.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.379058658999995, 2024-09-17T01:55:58.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:58.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:55:58.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:55:58.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:55:58.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:55:58.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:55:58.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:55:58.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:55:58.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.027 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.378516683000001, 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:55:58.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.377523478000001, 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:55:58.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:55:58.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.376963062000002, 2024-09-17T01:55:58.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:55:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:55:58.043 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.376481489, 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:58.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:55:58.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.206578289999996, 2024-09-17T01:55:58.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:55:58.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:55:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:55:58.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:55:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:55:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:55:58.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:55:58.055 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.205507892, 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:55:58.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.060 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.201699414999993, 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:55:58.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.066 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.795281746000001, 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:55:58.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:55:58.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.072 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.795177741000003, 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:55:58.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:55:58.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:55:58.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.795076682000001, 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:55:58.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.794969569000003, 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.085 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:55:58.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:55:58.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.794906502999993, 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:55:58.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:55:58.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.794848119999997, 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:55:58.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.794780364000005, 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:55:58.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:55:58.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:55:58.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.794714433999999, 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:55:58.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:55:58.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:55:58.114 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:55:58.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:58.117 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:58.119+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:58.188 INFO:teuthology.orchestra.run.smithi063.stderr:set 3.2 pg_upmap mapping to [2,1] 2024-09-17T01:55:58.193 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:55:58.217 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:58.219+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:58.254 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:55:58.254 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:58.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:58.317 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:58.319+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:58.419 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:58.423+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:58.435 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:58.435 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:55:58.435 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:55:58.435 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:55:58.435 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:58.449 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:58.543 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:58.547+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.345016771999994, 2024-09-17T01:55:58.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:58.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:55:58.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.625 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.344978153, 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:55:58.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:55:58.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.344940566000005, 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:55:58.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:55:58.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:55:58.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.344789047000006, 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:58.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:55:58.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:55:58.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.344752728000003, 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:55:58.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:55:58.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:58.652 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.173602122000005, 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:55:58.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:55:58.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.173536376000001, 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:55:58.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:55:58.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.173416696999993, 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:55:58.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:55:58.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.173379427, 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:55:58.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.676 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.173316704000001, 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:55:58.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.173199808000007, 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:55:58.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:55:58.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.833297719000001, 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:55:58.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:55:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.833144916999998, 2024-09-17T01:55:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:55:58.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:55:58.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832922972000006, 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.700 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:55:58.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:55:58.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832847509000004, 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:55:58.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:55:58.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832765163000005, 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.712 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:55:58.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.717 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832478378999994, 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:55:58.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:55:58.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832388781999995, 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:55:58.723 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:55:58.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:55:58.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832276250000007, 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.729 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:55:58.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:55:58.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 83.832019285000001, 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:55:58.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:55:58.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:55:58.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.740 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.741 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.741 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:55:58.741 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:55:58.741 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:55:58.745 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:55:58.746 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:58.745+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:58.846 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:55:58.846 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:58.851+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:58.877 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:55:58.877 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:55:58.877 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:55:58.877 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:55:58.891 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:55:58.947 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:58.951+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:55:59.009 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:55:59.015 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.015 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:55:59.031 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:55:59.031 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:55:59.048 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:59.049+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:59.051 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:55:59.051 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:55:59.148 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:59.151+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:59.149 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.149 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:55:59.249 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:59.255+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:59.293 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.294 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:55:59.350 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:59.355+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:59.431 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.431 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.445 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:55:59.490 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:59.493+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:59.551 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:59.553+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:59.563 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.563 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:55:59.652 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:59.653+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:55:59.711 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.711 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:55:59.753 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:55:59.759+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:55:59.842 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:55:59.842 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:55:59.854 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:55:59.855+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:55:59.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:55:59.955 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:55:59.957+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:00.019 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.019 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.034 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:00.056 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:00.057+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:00.157 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:00.163+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:00.163 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.163 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.178 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:00.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:56:00.258 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:00.257+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:00.301 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.301 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:00.360 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:00.363+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:00.435 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.435 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:00.492 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:00.495+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:00.541 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 92% (11897/12893) Updating files: 93% (11991/12893) Updating files: 94% (12120/12893) Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T01:56:00.561 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:00.567+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:00.581 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.581 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:00.662 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:00.667+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:00.721 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.721 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:00.762 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:00.767+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:00.853 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.853 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:00.863 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:00.867+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:00.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:00.964 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:00.965+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:00.998 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:00.998 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:01.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:01.066 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:01.065+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:01.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:01.134 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:01.135 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:01.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:01.194 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:01.199+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:01.206 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:56:01.218 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:01.218 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:01.239 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:01.258 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:01.258 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:01.267 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:01.267+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:01.269 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.997325619999998, 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:56:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:56:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:56:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:56:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.997287001000004, 2024-09-17T01:56:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:56:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:56:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.997249413999995, 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:56:01.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:56:01.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.997097894999996, 2024-09-17T01:56:01.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:56:01.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:56:01.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.997061575999993, 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:56:01.294 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:56:01.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:56:01.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.825910969999995, 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.300 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:56:01.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:56:01.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.825845224000005, 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:56:01.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.825725544999997, 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:56:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:56:01.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:56:01.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.825688275000005, 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.318 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:56:01.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:56:01.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.324 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.825625552000005, 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:56:01.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.825508655999997, 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:56:01.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.336 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.485606567000005, 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:56:01.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.342 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.485453765000003, 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:56:01.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:56:01.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.348 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.485231819999996, 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:56:01.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:56:01.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.485156356999994, 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:56:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:56:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.485074010999995, 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:56:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:56:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.484787226999998, 2024-09-17T01:56:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:56:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:56:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.484697629999999, 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:56:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.484585097999997, 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:56:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:56:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 86.484328133000005, 2024-09-17T01:56:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:56:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:56:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:01.390 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:01.393 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:01.393 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:56:01.393 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.393 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-17T01:56:01.394 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:56:01.395 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T01:56:01.395 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:01.395+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:01.440 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:56:01.443 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:56:01.443 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:56:01.493 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:01.495+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:01.524 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:01.525 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:01.525 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:01.525 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:01.538 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:01.594 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:01.593+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:01.695 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:01.697+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:01.701 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:01.701 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:01.701 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:01.701 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:01.701 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:01.715 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:01.796 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:01.799+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:01.835 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.810378593999999, 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015760749999999999, 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.836 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028490+0000", 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0699999999999997e-07 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028500+0000", 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4469999999999995e-06 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028518+0000", 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7960000000000001e-05 2024-09-17T01:56:01.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028533+0000", 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.472e-05 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028622+0000", 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9629000000000005e-05 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.028666+0000", 2024-09-17T01:56:01.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3983000000000002e-05 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.029993+0000", 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0013271800000000001 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:40.030066+0000", 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2548999999999999e-05 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 80.798293306999994, 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015949009999999999, 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:56:01.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040575+0000", 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040576+0000", 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040587+0000", 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0723000000000001e-05 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040624+0000", 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.7172999999999998e-05 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040649+0000", 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5239e-05 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040810+0000", 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160956 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.040842+0000", 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2150000000000002e-05 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042099+0000", 2024-09-17T01:56:01.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012564570000000001 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:41.042170+0000", 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1508999999999996e-05 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4195.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 79.787427222999995, 2024-09-17T01:56:01.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001770619, 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051441+0000", 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051442+0000", 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4000000000000001e-07 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051451+0000", 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9160000000000007e-06 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051502+0000", 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0640000000000003e-05 2024-09-17T01:56:01.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051519+0000", 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7889000000000001e-05 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051621+0000", 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102036 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.051656+0000", 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4836999999999999e-05 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053093+0000", 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014365090000000001 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:42.053212+0000", 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119052 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.849 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628658281, 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:56:01.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:56:01.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628558514999995, 2024-09-17T01:56:01.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:56:01.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.860 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628514718999995, 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:56:01.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:01.866 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628436803, 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:01.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:56:01.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628354936999997, 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.872 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:56:01.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:56:01.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:01.878 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628304186999998, 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:56:01.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628243381000004, 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.888 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628153448000006, 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:56:01.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:56:01.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:32 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:56:01.893 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.628093792000001, 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003859126, 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210775+0000", 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210776+0000", 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1060000000000001e-06 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210782+0000", 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0270000000000001e-06 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210800+0000", 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7836e-05 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210814+0000", 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4229999999999999e-05 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210922+0000", 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107909 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211176+0000", 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025380800000000001 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214634+0000", 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034582100000000002 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.897 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:30 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.62658236, 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016999859999999999, 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "reached pg", 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212286+0000", 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212287+0000", 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.356e-06 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212303+0000", 2024-09-17T01:56:01.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5897e-05 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212339+0000", 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5499e-05 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212362+0000", 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3070000000000001e-05 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212482+0000", 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120059 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213986+0000", 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015041049999999999 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:17 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:56:01.901 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.625675783999995, 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018256489999999999, 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.902 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213193+0000", 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213195+0000", 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213240+0000", 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5836e-05 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213260+0000", 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9466e-05 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213272+0000", 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.226e-05 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213356+0000", 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4146000000000004e-05 2024-09-17T01:56:01.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213383+0000", 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214940+0000", 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556885 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215018+0000", 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8236000000000001e-05 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.625530741999995, 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026546489999999998, 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.906 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213338+0000", 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213339+0000", 2024-09-17T01:56:01.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4e-07 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213363+0000", 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4315999999999999e-05 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213376+0000", 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3557000000000001e-05 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213389+0000", 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2476e-05 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213522+0000", 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133089 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.909 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213554+0000", 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1909999999999998e-05 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215932+0000", 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023783210000000001 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215992+0000", 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0139999999999997e-05 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.910 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.623768401999996, 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:56:01.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.914 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:56:01.915 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 76.623659750000002, 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015650180000000001, 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215209+0000", 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6300000000000005e-07 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215215+0000", 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0440000000000001e-06 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215226+0000", 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0763e-05 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215234+0000", 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5170000000000002e-06 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215323+0000", 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9254999999999998e-05 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215365+0000", 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1820000000000003e-05 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216686+0000", 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001321233 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216774+0000", 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7723e-05 2024-09-17T01:56:01.919 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 74.629297961000006, 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003209249, 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.920 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209571+0000", 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209574+0000", 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.994e-06 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.921 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209586+0000", 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2216e-05 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209620+0000", 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4013000000000001e-05 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209643+0000", 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3750000000000001e-05 2024-09-17T01:56:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.209844+0000", 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020081799999999999 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210036+0000", 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019203199999999999 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.210237+0000", 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020029499999999999 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.211605+0000", 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001368123 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212505+0000", 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00090070000000000005 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212656+0000", 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015069200000000001 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:47.212780+0000", 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123616 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 57.627129431, 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:56:01.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.928 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:56:01.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:56:01.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 52.626456031000004, 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028671949999999999, 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:01.932 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212412+0000", 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212415+0000", 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9500000000000001e-06 2024-09-17T01:56:01.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212430+0000", 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5077e-05 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212464+0000", 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3909999999999999e-05 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212481+0000", 2024-09-17T01:56:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7036000000000001e-05 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212642+0000", 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016063899999999999 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.212797+0000", 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015499900000000001 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:01.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.213011+0000", 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021388399999999999 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.214492+0000", 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014810859999999999 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215116+0000", 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00062418200000000004 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215208+0000", 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1824999999999996e-05 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:09.215280+0000", 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1606999999999994e-05 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:01.937 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:01.939 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:01.940 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:01.943+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:02.040 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:02.047+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:02.069 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:02.070 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:02.070 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:02.070 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:02.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:02.141 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:02.143+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:02.205 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:02.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:02.205 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:02.206 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:02.206 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:02.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:02.242 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:02.243+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:02.254 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:56:02.334 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:87 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'57, mlcod=10'52)", 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:56:02.340 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 88.247804498999997, 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007082896, 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092212+0000", 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092213+0000", 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1000000000000001e-06 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092279+0000", 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6105999999999994e-05 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092299+0000", 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9936e-05 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092314+0000", 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5497000000000001e-05 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092409+0000", 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4259000000000007e-05 2024-09-17T01:56:02.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.092442+0000", 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.375e-05 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099196+0000", 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067537650000000001 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.099295+0000", 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8482999999999999e-05 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:134 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'92, mlcod=10'86)", 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.891898796000007, 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051745380000000002, 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448117+0000", 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448118+0000", 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999995e-07 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448187+0000", 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8689000000000006e-05 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448200+0000", 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3614999999999999e-05 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448208+0000", 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5599999999999996e-06 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448267+0000", 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9185999999999999e-05 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.448284+0000", 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453238+0000", 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049546470000000004 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.453292+0000", 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3508999999999999e-05 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:02.350 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.722235222999998, 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.721438015999993, 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:56:02.355 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:56:02.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:56:02.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:56:02.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.360 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:157 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'111, mlcod=10'105)", 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.720880692999998, 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073545199999999998, 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:56:02.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619135+0000", 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619137+0000", 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619148+0000", 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.11e-05 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619172+0000", 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3332999999999998e-05 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619194+0000", 2024-09-17T01:56:02.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982999999999999e-05 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619473+0000", 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279895 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619510+0000", 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6195999999999997e-05 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626457+0000", 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069476399999999997 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626490+0000", 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2700000000000002e-05 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.720338717000004, 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006848504, 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619677+0000", 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619679+0000", 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.77e-06 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619753+0000", 2024-09-17T01:56:02.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3535999999999995e-05 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619783+0000", 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0666000000000001e-05 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.619797+0000", 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3294e-05 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620371+0000", 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057452499999999999 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620421+0000", 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0136000000000002e-05 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626492+0000", 2024-09-17T01:56:02.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060701000000000001 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626526+0000", 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4477000000000002e-05 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'106)", 2024-09-17T01:56:02.370 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.719345512000004, 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058945009999999999, 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620671+0000", 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620672+0000", 2024-09-17T01:56:02.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620683+0000", 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620709+0000", 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5236999999999999e-05 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.620722+0000", 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.322e-05 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621293+0000", 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057098499999999998 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621329+0000", 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626527+0000", 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051982130000000001 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626565+0000", 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7879000000000001e-05 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.375 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'106)", 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.718785096000005, 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053911280000000002, 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621231+0000", 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621233+0000", 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7069999999999999e-06 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621244+0000", 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1063000000000001e-05 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621276+0000", 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2206999999999998e-05 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621291+0000", 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4779e-05 2024-09-17T01:56:02.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621883+0000", 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059165900000000002 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621917+0000", 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4932999999999999e-05 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626567+0000", 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046492340000000004 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626622+0000", 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5546e-05 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'106)", 2024-09-17T01:56:02.380 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.718303523000003, 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049862279999999997, 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:56:02.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621713+0000", 2024-09-17T01:56:02.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621714+0000", 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621789+0000", 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5493000000000004e-05 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621805+0000", 2024-09-17T01:56:02.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.621815+0000", 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622534+0000", 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071904499999999997 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.622575+0000", 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1109999999999998e-05 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626625+0000", 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040501909999999999 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626699+0000", 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3862999999999994e-05 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.385 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:181 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'131, mlcod=10'128)", 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.548400323999999, 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066623810000000002, 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791616+0000", 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791617+0000", 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.387e-06 2024-09-17T01:56:02.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791625+0000", 2024-09-17T01:56:02.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T01:56:02.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791645+0000", 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9945999999999998e-05 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791662+0000", 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7e-05 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791762+0000", 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9785999999999996e-05 2024-09-17T01:56:02.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.791801+0000", 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8386000000000001e-05 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798180+0000", 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063797979999999999 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798278+0000", 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7835000000000001e-05 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:182 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'132, mlcod=10'128)", 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.547329926000003, 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056624559999999997, 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792686+0000", 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792692+0000", 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792739+0000", 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7818999999999997e-05 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792761+0000", 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1860000000000001e-05 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792777+0000", 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.558e-05 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792926+0000", 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014909600000000001 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.792964+0000", 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798287+0000", 2024-09-17T01:56:02.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053231590000000001 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.798349+0000", 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1985999999999999e-05 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:185 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'135, mlcod=10'129)", 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:56:02.398 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.543521448999996, 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051911240000000001, 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796495+0000", 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796500+0000", 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9640000000000002e-06 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796547+0000", 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6931999999999997e-05 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796566+0000", 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9579999999999999e-05 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796581+0000", 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4703e-05 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796764+0000", 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000182683 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.796858+0000", 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3908999999999998e-05 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801585+0000", 2024-09-17T01:56:02.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00472793 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.801686+0000", 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100423 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.404 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.404 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:56:02.404 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.137103780000004, 2024-09-17T01:56:02.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:56:02.404 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:56:02.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:56:02.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136999775000007, 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:56:02.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:56:02.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:56:02.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136898716000005, 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005504442, 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203117+0000", 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203119+0000", 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.75e-06 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203152+0000", 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3077000000000002e-05 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203173+0000", 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0466999999999999e-05 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203190+0000", 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6829000000000001e-05 2024-09-17T01:56:02.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203328+0000", 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013797599999999999 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203564+0000", 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023654200000000001 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203870+0000", 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030547700000000002 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206478+0000", 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026083370000000001 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208393+0000", 2024-09-17T01:56:02.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019146689999999999 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208529+0000", 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000136525 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208622+0000", 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2793000000000004e-05 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136791603000006, 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:56:02.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:56:02.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136728536999996, 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.432 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:56:02.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136670154000001, 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007461896, 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:56:02.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203346+0000", 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203347+0000", 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.097e-06 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203355+0000", 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203373+0000", 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203390+0000", 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7784000000000001e-05 2024-09-17T01:56:02.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204638+0000", 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001247384 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204836+0000", 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019818799999999999 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205225+0000", 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038955000000000001 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207587+0000", 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023612590000000001 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029777940000000002 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210689+0000", 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012484200000000001 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210808+0000", 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118619 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.443 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136602397999994, 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:56:02.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:02.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.136536468000003, 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052038199999999996, 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:02.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203480+0000", 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203481+0000", 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.316e-06 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203487+0000", 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0100000000000001e-06 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203505+0000", 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819999999999999e-05 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203519+0000", 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4107000000000001e-05 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203633+0000", 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114115 2024-09-17T01:56:02.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203887+0000", 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025417799999999998 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208684+0000", 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047962739999999997 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:02.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:02.454 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:02.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:02.456 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:56:02.456 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:56:02.456 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:56:02.456 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:56:02.457 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:56:02.457 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T01:56:02.457 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:02.459+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:02.503 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T01:56:02.504 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:56:02.504 DEBUG:teuthology.orchestra.run.smithi063:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T01:56:02.555 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:02.557+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:02.560 INFO:tasks.workunit.client.0.smithi063.stderr:+ mkdir -p fsstress 2024-09-17T01:56:02.563 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd fsstress 2024-09-17T01:56:02.564 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:56:02.564 INFO:tasks.workunit.client.0.smithi063.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:56:02.590 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:02.590 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:02.590 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:56:02.590 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:02.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:02.656 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:02.659+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:02.726 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:56:02.726 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:56:02.726 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:02.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:02.787 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:02.791+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.586471488000001, 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016968304999999999, 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 113 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277732+0000", 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277733+0000", 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0529999999999999e-06 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277739+0000", 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6460000000000004e-06 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277749+0000", 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.027e-05 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277757+0000", 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6699999999999994e-06 2024-09-17T01:56:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289263+0000", 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011506041 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289418+0000", 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015454499999999999 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.289605+0000", 2024-09-17T01:56:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018774199999999999 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293409+0000", 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003803271 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294560+0000", 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011514279999999999 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294630+0000", 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9675e-05 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294700+0000", 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9963999999999996e-05 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.586432869000006, 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.586395281999998, 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:56:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:56:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:56:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.586243762999999, 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:56:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:56:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.586207443999996, 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:56:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:56:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.415056837999998, 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017107530999999999, 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 136 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449146+0000", 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449147+0000", 2024-09-17T01:56:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6400000000000001e-07 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449153+0000", 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.066e-06 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449165+0000", 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2089999999999999e-05 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449173+0000", 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8399999999999995e-06 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457811+0000", 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008638349 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.457954+0000", 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014281600000000001 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458159+0000", 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000204658 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464094+0000", 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059347749999999998 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466129+0000", 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020350310000000001 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466202+0000", 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2875999999999998e-05 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466254+0000", 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2166000000000002e-05 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.414991091999994, 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:56:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.414871413, 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:56:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:56:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.414834142999993, 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:56:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:56:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:56:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.414771419999994, 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:56:02.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:56:02.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.414654523999999, 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.974 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:56:02.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.979 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.074752434999994, 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:56:02.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:56:02.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.985 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.074599633000005, 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:56:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.074377687999998, 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:56:02.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:56:02.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:56:02.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:02.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.074302224999997, 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:56:02.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:56:03.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.074219878999997, 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:03.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:56:03.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:56:03.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:03.009 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.073933095000001, 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:56:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:56:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.073843498000002, 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:56:03.015 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:56:03.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:03.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:56:03.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.073730965999999, 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:56:03.021 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:56:03.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:03.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:03.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.073474000999994, 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:03.027 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:56:03.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:56:03.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:56:03.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:03.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:03.033 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:03.033 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:02.915+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:03.034 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:03.035 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:03.039+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:03.136 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:03.139+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:03.166 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:03.166 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:03.167 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:03.167 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:03.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:03.216 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:56:03.217 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:56:03.217 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-17T01:56:03.217 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-17T01:56:03.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:56:03.237 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:03.239+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:03.299 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:03.299 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:03.299 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:03.299 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:03.299 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:03.313 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:03.338 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:03.343+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:03.358 INFO:tasks.workunit.client.0.smithi063.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:56:03.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:03.422 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-17T01:56:03.439 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:03.439+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286611406999995, 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:56:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286511641000004, 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:56:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:56:03.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286467845000004, 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:56:03.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:56:03.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:03.512 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286389928999995, 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:56:03.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:56:03.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286308063000007, 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.518 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:03.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:56:03.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:56:03.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.523 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286257312999993, 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:56:03.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286196507, 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.529 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:56:03.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.533 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.286106574000002, 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:56:03.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 78.281721528000006, 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.538 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.539 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:56:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:56:03.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 59.285082557000003, 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:03.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:56:03.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:56:03.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:56:03.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:56:03.548 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.12866886199999999, 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.052538046999999997, 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.549 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 6 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.550 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368155+0000", 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7159999999999999e-06 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375086+0000", 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069303330000000003 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375126+0000", 2024-09-17T01:56:03.551 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9854999999999997e-05 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375144+0000", 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8006e-05 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375282+0000", 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013803900000000001 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375504+0000", 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022231900000000001 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375711+0000", 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000207238 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408034+0000", 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032322367999999997 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.553 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420591+0000", 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012557166 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420644+0000", 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2859000000000003e-05 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420691+0000", 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7148000000000003e-05 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9 4.26 4:658f2455:::100000001ff.00000000:head [write 0~3329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.379904+0000", 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.11691789800000001, 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051579850000000003, 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9 2024-09-17T01:56:03.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379904+0000", 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379904+0000", 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379906+0000", 2024-09-17T01:56:03.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6259999999999999e-06 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379925+0000", 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.842e-05 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379957+0000", 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2434999999999997e-05 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379977+0000", 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0222999999999999e-05 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.380092+0000", 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000114905 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.380253+0000", 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016075799999999999 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.558 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.380416+0000", 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016332900000000001 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.382204+0000", 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873159999999999 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.384888+0000", 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026842989999999998 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.559 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.384985+0000", 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7356999999999996e-05 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.385062+0000", 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6316999999999995e-05 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.560 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.387495+0000", 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.10932617, 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058418239999999998, 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 15 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.561 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387495+0000", 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387495+0000", 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387499+0000", 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2600000000000001e-06 2024-09-17T01:56:03.562 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387520+0000", 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1539000000000002e-05 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387554+0000", 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3485999999999998e-05 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387576+0000", 2024-09-17T01:56:03.563 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2314999999999999e-05 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387672+0000", 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6051000000000006e-05 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387851+0000", 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017861299999999999 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.564 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388025+0000", 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017475600000000001 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.389002+0000", 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00097624099999999998 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.393211+0000", 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042095279999999997 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.565 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.393278+0000", 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6960999999999998e-05 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.393337+0000", 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9073999999999997e-05 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:16 4.7 4:e15a914f:::10000000207.00000000:head [write 0~1320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.566 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.388592+0000", 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.108229426, 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0068994369999999996, 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 16 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.567 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388592+0000", 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388592+0000", 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388594+0000", 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9700000000000002e-06 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388605+0000", 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.093e-05 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388640+0000", 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5262000000000002e-05 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388661+0000", 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1129e-05 2024-09-17T01:56:03.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388751+0000", 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9117999999999996e-05 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388837+0000", 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6763999999999998e-05 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.570 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388931+0000", 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.3929000000000001e-05 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.389853+0000", 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00092194900000000003 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.395375+0000", 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055221669999999997 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.395440+0000", 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4258999999999996e-05 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.395492+0000", 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1959999999999997e-05 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.572 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:21 4.1e 4:789b801b:::1000000020c.00000000:head [write 0~2389] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.394107+0000", 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.102714556, 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0044710110000000004, 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.573 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 21 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394107+0000", 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394107+0000", 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394109+0000", 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3369999999999998e-06 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394138+0000", 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8152000000000001e-05 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394169+0000", 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1282000000000003e-05 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.575 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394205+0000", 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6232000000000001e-05 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394270+0000", 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4475999999999997e-05 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.576 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394401+0000", 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013149900000000001 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.394509+0000", 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107916 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.397704+0000", 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031952119999999998 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.398429+0000", 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00072506999999999997 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.398531+0000", 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101315 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.398578+0000", 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7519999999999999e-05 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.578 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:30 4.17 4:eace0b58:::10000000215.00000000:head [write 0~3744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.406200+0000", 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.090621879000000002, 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054194489999999998, 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 30 2024-09-17T01:56:03.579 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406200+0000", 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406200+0000", 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.580 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406201+0000", 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0559999999999999e-06 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406209+0000", 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4169999999999992e-06 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406223+0000", 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3984e-05 2024-09-17T01:56:03.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406238+0000", 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4712000000000001e-05 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406311+0000", 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3369999999999997e-05 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.582 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406430+0000", 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011851899999999999 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406558+0000", 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012830400000000001 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408382+0000", 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018239910000000001 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.583 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.411511+0000", 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031293060000000001 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.411566+0000", 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4774000000000001e-05 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.411619+0000", 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3016000000000002e-05 2024-09-17T01:56:03.584 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:41 4.4 4:2231e764:::10000000220.00000000:head [write 0~6536] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.422720+0000", 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.074101368000000001, 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038982639999999998, 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.585 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 41 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422720+0000", 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422720+0000", 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.586 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422722+0000", 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2729999999999999e-06 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422736+0000", 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4447000000000001e-05 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.587 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422755+0000", 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8865999999999999e-05 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422773+0000", 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8546000000000002e-05 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.422851+0000", 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7550000000000001e-05 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.588 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.423005+0000", 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015375 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.423154+0000", 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014981900000000001 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426484+0000", 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.003329331 2024-09-17T01:56:03.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426505+0000", 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1511000000000001e-05 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426571+0000", 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5549000000000005e-05 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426619+0000", 2024-09-17T01:56:03.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7621999999999999e-05 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:43 4.39 e45/17 4:9f1351c3:::10000000222.00000000:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.426421+0000", 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.070400553000000005, 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.005407434, 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.591 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426421+0000", 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426421+0000", 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426423+0000", 2024-09-17T01:56:03.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5099999999999999e-06 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426444+0000", 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1608999999999999e-05 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426488+0000", 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3584999999999997e-05 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426504+0000", 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6646e-05 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426586+0000", 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1536e-05 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426612+0000", 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5823e-05 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.431760+0000", 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051481019999999999 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.431828+0000", 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8622999999999997e-05 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.595 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:44 4.2c e45/17 4:35964134:::10000000223.00000000:head v 45'2, mlcod=0'0)", 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.427732+0000", 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.069089117000000005, 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0041158200000000001, 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427732+0000", 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427732+0000", 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427734+0000", 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.023e-06 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427743+0000", 2024-09-17T01:56:03.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1540000000000008e-06 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427761+0000", 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8589000000000001e-05 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427774+0000", 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3149999999999999e-05 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427829+0000", 2024-09-17T01:56:03.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4914000000000003e-05 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.427844+0000", 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4891e-05 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.431800+0000", 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039562759999999999 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.431848+0000", 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7822999999999999e-05 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:46 4.b 4:d0d26e50:::10000000225.00000000:head [write 0~1224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.429685+0000", 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.067136119999999994, 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050086849999999997, 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:03.600 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 46 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429685+0000", 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.601 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429685+0000", 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429688+0000", 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429699+0000", 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.134e-05 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429727+0000", 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8079e-05 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429743+0000", 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6249e-05 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429812+0000", 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8718000000000002e-05 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429927+0000", 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115308 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.430028+0000", 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100549 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.432907+0000", 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028791260000000001 2024-09-17T01:56:03.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.434599+0000", 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001691459 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.434637+0000", 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8537000000000001e-05 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:03.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.434694+0000", 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7129999999999997e-05 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:03.606 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:03.607 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:03.608 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:03.608 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:03.609 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:03.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:03.609 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:03.607+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:03.635 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:03.636 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:03.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-17T01:56:03.708 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:03.710+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:03.747 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:03.747 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:03.762 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:03.809 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:03.810+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:03.892 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:03.892 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:03.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:03.909 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:03.911+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:04.010 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:04.015+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:04.035 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:04.035 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:04.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:04.111 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:04.113+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:04.190 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:04.190 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:04.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:04.213 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:04.214+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:04.224 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:56:04.313 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:04.315+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:04.342 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:04.342 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:04.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:04.414 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:04.414+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:04.515 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:04.514+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:04.529 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:04.529 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:04.545 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:04.616 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:04.618+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:04.680 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:04.680 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:04.695 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:04.717 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:04.717+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:04.818 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:04.818+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:04.861 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:04.861 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:04.877 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:04.920 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:04.922+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:05.021 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:05.023+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:05.045 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:05.045 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:05.060 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:05.122 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:05.122+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:05.198 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:05.199 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:05.213 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:05.222 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:05.222+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:05.323 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:05.327+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:05.337 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:05.338 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:05.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:05.424 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:05.425+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:05.480 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:05.481 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:05.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:05.525 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:05.526+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:05.626 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:05.626+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:05.634 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:05.634 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:05.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:05.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:05.727 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:05.729+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:05.778 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:05.779 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:05.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:05.839 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:05.842+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:05.852 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:05.873 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:05.873 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:05.929 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:05.930+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.934 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.658269915999995, 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:56:05.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:56:05.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:56:05.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:56:05.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.658232329000001, 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:56:05.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:56:05.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:56:05.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.948 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.658080810000001, 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:56:05.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.658044490999998, 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.955 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:56:05.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:56:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.960 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.486828138999996, 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.961 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:56:05.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:56:05.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:56:05.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.486708460000003, 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:05.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:56:05.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.486671189999996, 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:56:05.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:56:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.979 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.486608466999996, 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:56:05.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:56:05.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.486491571000002, 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:56:05.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:56:05.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.146589481999996, 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:56:05.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:05.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:56:05.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.146436679999994, 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:56:05.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:56:06.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.146214735000001, 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.004 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:56:06.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:56:06.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.146139271999999, 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:56:06.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:56:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.146056926, 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:56:06.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.145770142000003, 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:56:06.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.145680545000005, 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.028 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:56:06.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.145568013000002, 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:56:06.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:56:06.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 91.145311047999996, 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:06.041 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:56:06.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:56:06.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:56:06.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.6478821730000002, 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.052680583000000003, 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288160+0000", 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6000000000000001e-06 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297452+0000", 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092915110000000006 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297495+0000", 2024-09-17T01:56:06.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3482999999999997e-05 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297514+0000", 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8998999999999999e-05 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297659+0000", 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014464999999999999 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297811+0000", 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015144799999999999 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.298065+0000", 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025416000000000002 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.328259+0000", 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030194163 2024-09-17T01:56:06.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340638+0000", 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012378747000000001 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340727+0000", 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9318000000000001e-05 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340838+0000", 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011150399999999999 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.569221191, 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020044474999999999, 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:06.053 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:06.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366822+0000", 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8499999999999998e-06 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369822+0000", 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030005909999999999 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369853+0000", 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0882e-05 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369869+0000", 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5325999999999999e-05 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370002+0000", 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133607 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370272+0000", 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026991199999999997 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370456+0000", 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000183535 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.382932+0000", 2024-09-17T01:56:06.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012476500999999999 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386715+0000", 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037825549999999999 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386796+0000", 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1396999999999993e-05 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:06.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386863+0000", 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7318999999999997e-05 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:06.059 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:06.061 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:06.061 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:06.061+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:06.162 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:06.162+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:06.201 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:06.201 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:06.201 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:06.201 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:06.216 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:06.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:56:06.262 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:06.265+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:06.363 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:06.362+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:06.393 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:06.394 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:06.394 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:06.394 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:06.394 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:06.409 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:06.463 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:06.466+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:06.564 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:06.566+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:06.590 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381740406000006, 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006602012, 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.591 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210210+0000", 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210214+0000", 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.72e-06 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210227+0000", 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3210000000000001e-05 2024-09-17T01:56:06.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210258+0000", 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0375999999999999e-05 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210274+0000", 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6846000000000001e-05 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210495+0000", 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022046899999999999 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210707+0000", 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000212108 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210908+0000", 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200822 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213883+0000", 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029748270000000002 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216611+0000", 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027288920000000001 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216719+0000", 2024-09-17T01:56:06.595 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107952 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216812+0000", 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2789999999999998e-05 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:06.596 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381640640000001, 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:56:06.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.601 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:19 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381596844000001, 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0052718189999999996, 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210354+0000", 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8700000000000005e-07 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210378+0000", 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4043e-05 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210393+0000", 2024-09-17T01:56:06.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210417+0000", 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4423e-05 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211408+0000", 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00099053599999999998 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211694+0000", 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00028602400000000001 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027283500000000003 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213923+0000", 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019560350000000001 2024-09-17T01:56:06.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215475+0000", 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001552468 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215565+0000", 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9481999999999995e-05 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215626+0000", 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0930000000000001e-05 2024-09-17T01:56:06.607 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381518928000006, 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0061981850000000002, 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210432+0000", 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210433+0000", 2024-09-17T01:56:06.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7699999999999992e-07 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210437+0000", 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2899999999999996e-06 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210484+0000", 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7185999999999999e-05 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210499+0000", 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5113000000000001e-05 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212581+0000", 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020821469999999999 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212787+0000", 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020603200000000001 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213060+0000", 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027284500000000002 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214934+0000", 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001873448 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216487+0000", 2024-09-17T01:56:06.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015529750000000001 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216565+0000", 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8596000000000004e-05 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.216630+0000", 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4576e-05 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.613 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381437062000003, 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:06.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:56:06.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381386312000004, 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.622 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:56:06.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:06.625 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381325505999996, 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.629 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.381235572999998, 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:56:06.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:56:06.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:21 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 81.376850527000002, 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045130509999999997, 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.634 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215100+0000", 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215102+0000", 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4500000000000001e-06 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215113+0000", 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.099e-05 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215130+0000", 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7538999999999999e-05 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215159+0000", 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9386999999999998e-05 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215246+0000", 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6942999999999997e-05 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.215294+0000", 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7752e-05 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219522+0000", 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042280470000000004 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219613+0000", 2024-09-17T01:56:06.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0943e-05 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 62.380211555999999, 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:56:06.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:56:06.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.223797861, 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.052538046999999997, 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 6 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.646 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.647 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368155+0000", 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7159999999999999e-06 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375086+0000", 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069303330000000003 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375126+0000", 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9854999999999997e-05 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375144+0000", 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8006e-05 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375282+0000", 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013803900000000001 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375504+0000", 2024-09-17T01:56:06.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022231900000000001 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375711+0000", 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000207238 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408034+0000", 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032322367999999997 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420591+0000", 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012557166 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420644+0000", 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2859000000000003e-05 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420691+0000", 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7148000000000003e-05 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.651 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9 4.26 4:658f2455:::100000001ff.00000000:head [write 0~3329] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.379904+0000", 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.212046897, 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051579850000000003, 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.652 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379904+0000", 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379904+0000", 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379906+0000", 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6259999999999999e-06 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379925+0000", 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.842e-05 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.654 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379957+0000", 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2434999999999997e-05 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.379977+0000", 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0222999999999999e-05 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.380092+0000", 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000114905 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.380253+0000", 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016075799999999999 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.380416+0000", 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016332900000000001 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.382204+0000", 2024-09-17T01:56:06.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873159999999999 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.384888+0000", 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026842989999999998 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.384985+0000", 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7356999999999996e-05 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.385062+0000", 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6316999999999995e-05 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.387495+0000", 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.204455169, 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058418239999999998, 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.658 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 15 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387495+0000", 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387495+0000", 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387499+0000", 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2600000000000001e-06 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387520+0000", 2024-09-17T01:56:06.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1539000000000002e-05 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387554+0000", 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3485999999999998e-05 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387576+0000", 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2314999999999999e-05 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.661 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387672+0000", 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6051000000000006e-05 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.387851+0000", 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017861299999999999 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388025+0000", 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017475600000000001 2024-09-17T01:56:06.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.389002+0000", 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00097624099999999998 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.393211+0000", 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0042095279999999997 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.393278+0000", 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6960999999999998e-05 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.393337+0000", 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9073999999999997e-05 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:16 4.7 4:e15a914f:::10000000207.00000000:head [write 0~1320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.664 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.388592+0000", 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.2033584250000002, 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0068994369999999996, 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 16 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388592+0000", 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388592+0000", 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388594+0000", 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9700000000000002e-06 2024-09-17T01:56:06.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388605+0000", 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.093e-05 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388640+0000", 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5262000000000002e-05 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388661+0000", 2024-09-17T01:56:06.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1129e-05 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388751+0000", 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9117999999999996e-05 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388837+0000", 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6763999999999998e-05 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.668 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.388931+0000", 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.3929000000000001e-05 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.389853+0000", 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00092194900000000003 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.395375+0000", 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0055221669999999997 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.395440+0000", 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4258999999999996e-05 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.395492+0000", 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1959999999999997e-05 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:30 4.17 4:eace0b58:::10000000215.00000000:head [write 0~3744] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.406200+0000", 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.1857508779999999, 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054194489999999998, 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 30 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.671 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406200+0000", 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406200+0000", 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406201+0000", 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0559999999999999e-06 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406209+0000", 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4169999999999992e-06 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406223+0000", 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3984e-05 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406238+0000", 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4712000000000001e-05 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406311+0000", 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3369999999999997e-05 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406430+0000", 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011851899999999999 2024-09-17T01:56:06.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.406558+0000", 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012830400000000001 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408382+0000", 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0018239910000000001 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.411511+0000", 2024-09-17T01:56:06.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031293060000000001 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.411566+0000", 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4774000000000001e-05 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.411619+0000", 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3016000000000002e-05 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:43 4.39 e45/17 4:9f1351c3:::10000000222.00000000:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.426421+0000", 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.1655295520000002, 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.005407434, 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426421+0000", 2024-09-17T01:56:06.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426421+0000", 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426423+0000", 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5099999999999999e-06 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426444+0000", 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1608999999999999e-05 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426488+0000", 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3584999999999997e-05 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426504+0000", 2024-09-17T01:56:06.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6646e-05 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426586+0000", 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1536e-05 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.426612+0000", 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5823e-05 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.431760+0000", 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051481019999999999 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.431828+0000", 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8622999999999997e-05 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:46 4.b 4:d0d26e50:::10000000225.00000000:head [write 0~1224] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.681 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.429685+0000", 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.1622651190000002, 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050086849999999997, 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 46 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429685+0000", 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429685+0000", 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429688+0000", 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:06.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429699+0000", 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.134e-05 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429727+0000", 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8079e-05 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429743+0000", 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6249e-05 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429812+0000", 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8718000000000002e-05 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.429927+0000", 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115308 2024-09-17T01:56:06.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.430028+0000", 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100549 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.432907+0000", 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0028791260000000001 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.434599+0000", 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001691459 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.434637+0000", 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8537000000000001e-05 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.434694+0000", 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7129999999999997e-05 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.687 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:110 4.36 e45/17 4:6c73e6f5:::10000000266.00000000:head v 45'4, mlcod=45'2)", 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.511804+0000", 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.0801462160000002, 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050937170000000002, 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511804+0000", 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511804+0000", 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511806+0000", 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1969999999999999e-06 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511819+0000", 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3474e-05 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511839+0000", 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0431000000000001e-05 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511851+0000", 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1182000000000001e-05 2024-09-17T01:56:06.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511941+0000", 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9901000000000005e-05 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.511972+0000", 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1365999999999998e-05 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.516856+0000", 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0048839520000000004 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.516898+0000", 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2213999999999999e-05 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:131 4.2d 4:b6f80e7a:::1000000027c.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:06.692 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.539693+0000", 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.0522572000000001, 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0048072119999999999, 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 131 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539693+0000", 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539693+0000", 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539694+0000", 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2399999999999996e-07 2024-09-17T01:56:06.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539699+0000", 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.9060000000000001e-06 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539712+0000", 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.261e-05 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539718+0000", 2024-09-17T01:56:06.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9209999999999997e-06 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539789+0000", 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0924000000000001e-05 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539888+0000", 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9219e-05 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.539989+0000", 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000101352 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.540768+0000", 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00077909400000000003 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.544426+0000", 2024-09-17T01:56:06.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0036575750000000001 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.544466+0000", 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9703000000000003e-05 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.544501+0000", 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4984000000000003e-05 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:57 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.372674267, 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013009569, 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219278+0000", 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.894e-06 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:06.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219406+0000", 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012822199999999999 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219424+0000", 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7091e-05 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219433+0000", 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2299999999999997e-06 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219604+0000", 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017164599999999999 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219764+0000", 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015926499999999999 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.224310+0000", 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045462749999999998 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.229006+0000", 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004696263 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232019+0000", 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0030129380000000002 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232168+0000", 2024-09-17T01:56:06.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014881200000000001 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232286+0000", 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117933 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:06.704 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:06.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:06.706 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:06.705+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:06.807 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:06.810+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:06.846 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:06.846 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:06.846 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:06.846 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:06.862 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:06.910 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:06.913+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:06.988 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:06.988 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:06.988 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:06.988 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:06.989 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:07.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:07.046 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:07.049+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:07.110 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:07.110+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:07.176 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 92.559559454999999, 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:56:07.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 92.558762247999994, 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.181 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:56:07.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.974428012000004, 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007595091, 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202912+0000", 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202916+0000", 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-06 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202931+0000", 2024-09-17T01:56:07.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5579000000000001e-05 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202955+0000", 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3176999999999998e-05 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.202971+0000", 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629e-05 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203115+0000", 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143573 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203320+0000", 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000204742 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203561+0000", 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000241248 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206693+0000", 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031317760000000002 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210285+0000", 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035923219999999998 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210400+0000", 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115572 2024-09-17T01:56:07.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210508+0000", 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107063 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.974324007000007, 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007626585, 2024-09-17T01:56:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203016+0000", 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203018+0000", 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203027+0000", 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7900000000000005e-06 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203048+0000", 2024-09-17T01:56:07.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1214000000000001e-05 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203063+0000", 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5455999999999999e-05 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203207+0000", 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014373899999999999 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203540+0000", 2024-09-17T01:56:07.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033292100000000002 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203878+0000", 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033786999999999999 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206707+0000", 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002828999 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210451+0000", 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037441779999999999 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210572+0000", 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012075500000000001 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210643+0000", 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1162999999999996e-05 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.196 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.974115835000006, 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:56:07.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.974052768999996, 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:56:07.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.973926629999994, 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.208 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:56:07.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:56:07.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:56:07.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:4 4.32 e45/17 4:4def72d4:::10000000003.00000000:head v 45'2, mlcod=0'0)", 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8829319330000001, 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.041759969000000001, 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294410+0000", 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8300000000000001e-06 2024-09-17T01:56:07.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306262+0000", 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011851788 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306295+0000", 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2799999999999998e-05 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306315+0000", 2024-09-17T01:56:07.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0387e-05 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306443+0000", 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012723500000000001 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306476+0000", 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3101e-05 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.336054+0000", 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029578282000000001 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.336168+0000", 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114546 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:5 4.13 e45/17 4:cbe72331:::10000000003.00000002:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:07.218 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8106562130000001, 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015729841000000001, 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:07.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366686+0000", 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3069999999999999e-06 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369873+0000", 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031876560000000001 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369905+0000", 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1911e-05 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369924+0000", 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8553e-05 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.370044+0000", 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012076199999999999 2024-09-17T01:56:07.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.370075+0000", 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0406999999999999e-05 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382291+0000", 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012216296999999999 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382414+0000", 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122948 2024-09-17T01:56:07.222 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:7 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~18007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.80591363, 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018697373, 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.223 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371429+0000", 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371526+0000", 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6809000000000001e-05 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371551+0000", 2024-09-17T01:56:07.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5230000000000001e-05 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371572+0000", 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786999999999999e-05 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371729+0000", 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157133 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371948+0000", 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021917900000000001 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372163+0000", 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021421400000000001 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.374525+0000", 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002362393 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389881+0000", 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015356274 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390010+0000", 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882200000000001 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390124+0000", 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114132 2024-09-17T01:56:07.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:6 4.10 e45/17 4:09a4c37f:::10000000003.00000001:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.804547962, 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044460135999999997, 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372794+0000", 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8330000000000001e-06 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389586+0000", 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016791724000000001 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389615+0000", 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389633+0000", 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8057e-05 2024-09-17T01:56:07.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389769+0000", 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013610599999999999 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389805+0000", 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5917000000000002e-05 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.417108+0000", 2024-09-17T01:56:07.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027303549999999999 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.417253+0000", 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014416599999999999 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:07.233 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8016812980000001, 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014547855, 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 8 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:07.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375661+0000", 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9970000000000001e-06 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375675+0000", 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3900000000000001e-05 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375704+0000", 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.87e-05 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375723+0000", 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9321e-05 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375844+0000", 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121212 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.376046+0000", 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020216599999999999 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.376245+0000", 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019880000000000001 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377667+0000", 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001421477 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390006+0000", 2024-09-17T01:56:07.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012338816000000001 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390139+0000", 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133905 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390207+0000", 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7560999999999999e-05 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.7995868599999998, 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012619790000000001, 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377756+0000", 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0310000000000001e-06 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377770+0000", 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.454e-05 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377806+0000", 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6127000000000002e-05 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377825+0000", 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8967e-05 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377980+0000", 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015457200000000001 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378230+0000", 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025009400000000002 2024-09-17T01:56:07.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378443+0000", 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021311 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380240+0000", 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017967580000000001 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390133+0000", 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098933440000000001 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390257+0000", 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012403499999999999 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390373+0000", 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116212 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.245 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.7985732109999999, 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011713062, 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.246 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 11 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378769+0000", 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4270000000000001e-06 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378781+0000", 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.205e-05 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378811+0000", 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0574000000000002e-05 2024-09-17T01:56:07.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378836+0000", 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4280000000000001e-05 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378967+0000", 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130965 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379287+0000", 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032058199999999997 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379712+0000", 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042445699999999999 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382898+0000", 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031866289999999999 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390217+0000", 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073188410000000004 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390369+0000", 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015169000000000001 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390480+0000", 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111567 2024-09-17T01:56:07.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.379940+0000", 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.7974008260000001, 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010876076, 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 12 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379940+0000", 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379940+0000", 2024-09-17T01:56:07.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379942+0000", 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379956+0000", 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4527e-05 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380003+0000", 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6653999999999998e-05 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380028+0000", 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4916999999999999e-05 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.381026+0000", 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099850200000000007 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.381270+0000", 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024338699999999999 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.381534+0000", 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026373800000000001 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.383395+0000", 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018610440000000001 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390579+0000", 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071842440000000002 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390718+0000", 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013895800000000001 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390816+0000", 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7864999999999999e-05 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.258 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:163 4.33 4:ce199014:::1000000029c.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.579103+0000", 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.598237176, 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085011270000000007, 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 163 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579103+0000", 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579103+0000", 2024-09-17T01:56:07.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579105+0000", 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7999999999999999e-06 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579115+0000", 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6299999999999993e-06 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579134+0000", 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536999999999999e-05 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579152+0000", 2024-09-17T01:56:07.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7767000000000001e-05 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579250+0000", 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8307999999999995e-05 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579461+0000", 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210903 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579686+0000", 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022514400000000001 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.581226+0000", 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001540044 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.587455+0000", 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062284239999999998 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.587540+0000", 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5638999999999998e-05 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.587604+0000", 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3930999999999995e-05 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:174 4.3b 4:dc5ce3d4:::100000002a7.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.590348+0000", 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.5869920239999997, 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092061299999999999, 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.267 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 174 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590348+0000", 2024-09-17T01:56:07.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590348+0000", 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590351+0000", 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1770000000000001e-06 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590361+0000", 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0467e-05 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590392+0000", 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1393000000000003e-05 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590407+0000", 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4781e-05 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590587+0000", 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017971900000000001 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590787+0000", 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020037599999999999 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590991+0000", 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020331 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.592553+0000", 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015620899999999999 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599339+0000", 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067858780000000004 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599439+0000", 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010085399999999999 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599555+0000", 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115085 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:175 4.2e 4:76dcb3a2:::100000002a8.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.591415+0000", 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.5859250139999999, 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080746859999999993, 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.274 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 175 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591415+0000", 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591415+0000", 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591422+0000", 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7259999999999996e-06 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591432+0000", 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0144e-05 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591464+0000", 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1457000000000001e-05 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591479+0000", 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5224e-05 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591630+0000", 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015143200000000001 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591845+0000", 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021497000000000001 2024-09-17T01:56:07.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.592041+0000", 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195179 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.593592+0000", 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015516709999999999 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599231+0000", 2024-09-17T01:56:07.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056386789999999997 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599377+0000", 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146246 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599490+0000", 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112958 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:58 3.14 e46/16 3:2e2fa760:::200.00000001:head v 46'19, mlcod=46'17)", 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:06.446454+0000", 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.730886217, 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081000519999999999, 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.446454+0000", 2024-09-17T01:56:07.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.446454+0000", 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.446456+0000", 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1260000000000001e-06 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447556+0000", 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010998939999999999 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447586+0000", 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9456999999999999e-05 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447599+0000", 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3283e-05 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447720+0000", 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120742 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447771+0000", 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1397000000000003e-05 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.454448+0000", 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066773789999999998 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.454554+0000", 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010577399999999999 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:61 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~829833 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.015400334, 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01138317, 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:07.284 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161942+0000", 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.53e-06 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163509+0000", 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015674090000000001 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163540+0000", 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1108000000000001e-05 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163564+0000", 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4179999999999999e-05 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163675+0000", 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111074 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163928+0000", 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025244699999999999 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.164262+0000", 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333911 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.171195+0000", 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069333720000000001 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173178+0000", 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019829539999999999 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173263+0000", 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5235000000000006e-05 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173323+0000", 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.995e-05 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:07.290 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:07.290 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:07.292 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:56:07.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:07.293 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:07.293+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:07.392 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:07.393+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:07.431 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:07.431 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:07.431 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:56:07.431 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:07.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:07.492 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:07.493+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:07.580 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:07.580 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:07.580 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:56:07.580 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:56:07.580 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:07.593 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:07.593+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:07.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:07.694 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:07.698+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:07.723 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:56:07.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.448218574999999, 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:56:07.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:56:07.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.448180988000004, 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.731 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:56:07.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:56:07.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:07.738 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.448029469000005, 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:56:07.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:56:07.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:56:07.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.745 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.447993150000002, 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.746 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:07.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:56:07.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.276776798, 2024-09-17T01:56:07.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:56:07.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:56:07.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.276657119000006, 2024-09-17T01:56:07.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:56:07.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:56:07.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.767 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.276619848999999, 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:56:07.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:56:07.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.276557126, 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.775 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:56:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.276440230000006, 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:56:07.782 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:56:07.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:56:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.936538141, 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:56:07.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:56:07.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:56:07.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:56:07.796 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.936385338999997, 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:56:07.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:56:07.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:56:07.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:56:07.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.936163394000005, 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.805 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:56:07.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:56:07.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.936087931000003, 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:56:07.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:56:07.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:56:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.936005585000004, 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.819 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:56:07.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.935718800999993, 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.826 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:56:07.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:56:07.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.935629203999994, 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.833 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:56:07.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:56:07.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:56:07.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.840 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.935516672000006, 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.841 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:56:07.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:56:07.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.935259707, 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.848 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:56:07.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4378308320000004, 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.052680583000000003, 2024-09-17T01:56:07.855 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:07.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288160+0000", 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6000000000000001e-06 2024-09-17T01:56:07.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297452+0000", 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092915110000000006 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297495+0000", 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3482999999999997e-05 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297514+0000", 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8998999999999999e-05 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297659+0000", 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014464999999999999 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297811+0000", 2024-09-17T01:56:07.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015144799999999999 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.298065+0000", 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025416000000000002 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.328259+0000", 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030194163 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340638+0000", 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012378747000000001 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340727+0000", 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9318000000000001e-05 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340838+0000", 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011150399999999999 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3591698499999998, 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020044474999999999, 2024-09-17T01:56:07.862 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:07.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366822+0000", 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8499999999999998e-06 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369822+0000", 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030005909999999999 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369853+0000", 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0882e-05 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:07.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369869+0000", 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5325999999999999e-05 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370002+0000", 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133607 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370272+0000", 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026991199999999997 2024-09-17T01:56:07.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370456+0000", 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000183535 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.382932+0000", 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012476500999999999 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386715+0000", 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037825549999999999 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386796+0000", 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1396999999999993e-05 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386863+0000", 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7318999999999997e-05 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:07.869 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:07.871 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:07.872 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:07.873+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:07.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:07.972 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:07.974+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.011 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:08.011 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:08.011 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:08.011 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:08.027 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:08.058 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:08.059 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:08.073 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:08.074+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:08.086 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:08.110 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:08.110 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:08.156 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:08.156 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:08.170 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:08.174 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:08.174+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.275 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:08.274+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:08.360 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:08.361 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:08.378 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:08.378 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:08.378+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.478 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:08.478+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.516 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:08.516 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:08.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:08.579 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:08.582+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.673 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:08.674 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:08.679 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:08.678+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:08.689 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:08.781 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:08.781+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:08.818 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:08.818 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:08.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:08.883 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:08.886+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.884 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:56:08.884 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:56:08.884 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T01:56:08.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T01:56:08.973 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:08.973 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:08.982 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:08.986+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:08.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:09.083 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:09.086+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:09.162 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:09.162 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:09.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:09.223 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:09.226+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 47, 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-17T01:54:21.836260+0000", 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-17T01:56:07.230716+0000", 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-17T01:54:31.869613+0000", 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-17T01:54:23.678756+0000", 2024-09-17T01:56:09.265 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5804032, 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "nodeep-scrub", 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T01:56:09.266 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 3, 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "luminous", 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:32.050776+0000", 2024-09-17T01:56:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:09.268 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.269 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "11", 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:09.270 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:09.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:56:09.272 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 2.9900000095367432, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 2.9900000095367432, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-17T01:56:09.273 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:38.032150+0000", 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:09.274 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:09.275 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:09.276 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 2, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 15, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:09.277 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:09.278 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-17T01:56:09.279 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.280 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.055353+0000", 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:09.281 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:09.282 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:09.283 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:09.284 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:09.285 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.558395+0000", 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:09.288 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:09.289 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "19", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:09.290 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:09.291 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:09.292 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:09.293 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.1299999952316284, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.1299999952316284, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.294 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "321981a6-5caa-44f3-b6ae-aa4e97947db6", 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6800", 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6801", 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:56:09.296 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6802", 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6803", 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:56:09.297 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6806", 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6807", 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.298 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6804", 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6805", 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.96:6801/1783419646", 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.96:6803/1783419646", 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.96:6807/1783419646", 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.96:6805/1783419646", 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "36930e57-781c-48b6-a499-40cb00df2f38", 2024-09-17T01:56:09.300 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 17, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6800", 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6801", 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6802", 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6803", 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:56:09.303 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6806", 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6807", 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6804", 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6805", 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.98:6801/3191117572", 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.98:6803/3191117572", 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3191117572", 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3191117572", 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5a5a5a07-1fcd-4160-a4b1-e8431052e44c", 2024-09-17T01:56:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 43, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6800", 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6801", 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:56:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6802", 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6803", 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6806", 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6807", 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6804", 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6805", 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.154:6801/495067980", 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.154:6803/495067980", 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.154:6807/495067980", 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.154:6805/495067980", 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-17T01:56:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.631084+0000", 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.623706+0000", 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:56:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.711322+0000", 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [ 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.2", 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: 2, 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: 1 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-17T01:56:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-17T01:56:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-17T01:56:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-17T01:56:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:09.318 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:56:09.318 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:56:09.320 INFO:tasks.thrashosds.thrasher:j is {'epoch': 47, 'fsid': '7af2c608-be6c-4ac4-a462-cff6aa13e357', 'created': '2024-09-17T01:54:21.836260+0000', 'modified': '2024-09-17T01:56:07.230716+0000', 'last_up_change': '2024-09-17T01:54:31.869613+0000', 'last_in_change': '2024-09-17T01:54:23.678756+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:54:32.050776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T01:54:38.032150+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T01:54:43.055353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T01:54:43.558395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '321981a6-5caa-44f3-b6ae-aa4e97947db6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6800', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6801', 'nonce': 1783419646}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 1783419646}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6806', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6807', 'nonce': 1783419646}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6804', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6805', 'nonce': 1783419646}]}, 'public_addr': '172.21.15.96:6801/1783419646', 'cluster_addr': '172.21.15.96:6803/1783419646', 'heartbeat_back_addr': '172.21.15.96:6807/1783419646', 'heartbeat_front_addr': '172.21.15.96:6805/1783419646', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '36930e57-781c-48b6-a499-40cb00df2f38', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3191117572}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3191117572}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3191117572}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3191117572}]}, 'public_addr': '172.21.15.98:6801/3191117572', 'cluster_addr': '172.21.15.98:6803/3191117572', 'heartbeat_back_addr': '172.21.15.98:6807/3191117572', 'heartbeat_front_addr': '172.21.15.98:6805/3191117572', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5a5a5a07-1fcd-4160-a4b1-e8431052e44c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 43, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 495067980}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 495067980}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 495067980}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 495067980}]}, 'public_addr': '172.21.15.154:6801/495067980', 'cluster_addr': '172.21.15.154:6803/495067980', 'heartbeat_back_addr': '172.21.15.154:6807/495067980', 'heartbeat_front_addr': '172.21.15.154:6805/495067980', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.631084+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.623706+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.711322+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.2', 'osds': [2, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T01:56:09.320 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:56:09.321 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:09.321+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:09.354 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:09.354 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:09.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:09.420 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:09.422+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:09.513 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:09.513 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:09.521 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:09.522+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:09.529 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:09.622 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:09.622+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:09.653 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:09.653 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:09.668 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:09.710 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:56:09.713 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:56:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-17T01:56:07.993793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23149396,"num_objects":2146,"num_object_clones":0,"num_object_copies":4292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2146,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":2396,"num_write_kb":26886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2341,"ondisk_log_size":2341,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":145528,"kb_used_data":39492,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":282969992,"statfs":{"total":289910292480,"available":289761271808,"internally_reserved":0,"allocated":40439808,"data_stored":41319761,"data_compressed":1527641,"data_compressed_allocated":2199552,"data_compressed_original":11218944,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22551656,"num_objects":2120,"num_object_clones":0,"num_object_copies":4240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2138,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.783666"},"pg_stats":[{"pgid":"4.3f","version":"46'24","reported_seq":88,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.706583+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:56:06.706583+0000","last_peered":"2024-09-17T01:56:06.706583+0000","last_clean":"2024-09-17T01:56:06.706583+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:56:06.706583+0000","last_undegraded":"2024-09-17T01:56:06.706583+0000","last_fullsized":"2024-09-17T01:56:06.706583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54782,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"46'30","reported_seq":94,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.666612+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:56:06.666612+0000","last_peered":"2024-09-17T01:56:06.666612+0000","last_clean":"2024-09-17T01:56:06.666612+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:56:06.666612+0000","last_undegraded":"2024-09-17T01:56:06.666612+0000","last_fullsized":"2024-09-17T01:56:06.666612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94845,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.851369+0000","last_change":"2024-09-17T01:54:45.107361+0000","last_active":"2024-09-17T01:56:06.851369+0000","last_peered":"2024-09-17T01:56:06.851369+0000","last_clean":"2024-09-17T01:56:06.851369+0000","last_became_active":"2024-09-17T01:54:45.105836+0000","last_became_peered":"2024-09-17T01:54:45.105836+0000","last_unstale":"2024-09-17T01:56:06.851369+0000","last_undegraded":"2024-09-17T01:56:06.851369+0000","last_fullsized":"2024-09-17T01:56:06.851369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121018,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"46'19","reported_seq":85,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.790632+0000","last_change":"2024-09-17T01:54:45.106353+0000","last_active":"2024-09-17T01:56:06.790632+0000","last_peered":"2024-09-17T01:56:06.790632+0000","last_clean":"2024-09-17T01:56:06.790632+0000","last_became_active":"2024-09-17T01:54:45.105469+0000","last_became_peered":"2024-09-17T01:54:45.105469+0000","last_unstale":"2024-09-17T01:56:06.790632+0000","last_undegraded":"2024-09-17T01:56:06.790632+0000","last_fullsized":"2024-09-17T01:56:06.790632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61250,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"46'40","reported_seq":104,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.793390+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:56:06.793390+0000","last_peered":"2024-09-17T01:56:06.793390+0000","last_clean":"2024-09-17T01:56:06.793390+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:56:06.793390+0000","last_undegraded":"2024-09-17T01:56:06.793390+0000","last_fullsized":"2024-09-17T01:56:06.793390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138591,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"46'29","reported_seq":95,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.792242+0000","last_change":"2024-09-17T01:54:45.113437+0000","last_active":"2024-09-17T01:56:06.792242+0000","last_peered":"2024-09-17T01:56:06.792242+0000","last_clean":"2024-09-17T01:56:06.792242+0000","last_became_active":"2024-09-17T01:54:45.112263+0000","last_became_peered":"2024-09-17T01:54:45.112263+0000","last_unstale":"2024-09-17T01:56:06.792242+0000","last_undegraded":"2024-09-17T01:56:06.792242+0000","last_fullsized":"2024-09-17T01:56:06.792242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100620,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"46'37","reported_seq":103,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.779287+0000","last_change":"2024-09-17T01:54:45.114136+0000","last_active":"2024-09-17T01:56:06.779287+0000","last_peered":"2024-09-17T01:56:06.779287+0000","last_clean":"2024-09-17T01:56:06.779287+0000","last_became_active":"2024-09-17T01:54:45.112641+0000","last_became_peered":"2024-09-17T01:54:45.112641+0000","last_unstale":"2024-09-17T01:56:06.779287+0000","last_undegraded":"2024-09-17T01:56:06.779287+0000","last_fullsized":"2024-09-17T01:56:06.779287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117250,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"46'27","reported_seq":93,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.665270+0000","last_change":"2024-09-17T01:54:45.106664+0000","last_active":"2024-09-17T01:56:06.665270+0000","last_peered":"2024-09-17T01:56:06.665270+0000","last_clean":"2024-09-17T01:56:06.665270+0000","last_became_active":"2024-09-17T01:54:45.105349+0000","last_became_peered":"2024-09-17T01:54:45.105349+0000","last_unstale":"2024-09-17T01:56:06.665270+0000","last_undegraded":"2024-09-17T01:56:06.665270+0000","last_fullsized":"2024-09-17T01:56:06.665270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102847,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"46'35","reported_seq":101,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.816394+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:56:06.816394+0000","last_peered":"2024-09-17T01:56:06.816394+0000","last_clean":"2024-09-17T01:56:06.816394+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:56:06.816394+0000","last_undegraded":"2024-09-17T01:56:06.816394+0000","last_fullsized":"2024-09-17T01:56:06.816394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139031,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"46'33","reported_seq":97,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.641708+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:56:06.641708+0000","last_peered":"2024-09-17T01:56:06.641708+0000","last_clean":"2024-09-17T01:56:06.641708+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:56:06.641708+0000","last_undegraded":"2024-09-17T01:56:06.641708+0000","last_fullsized":"2024-09-17T01:56:06.641708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139886,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"46'37","reported_seq":103,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.959149+0000","last_change":"2024-09-17T01:54:45.113374+0000","last_active":"2024-09-17T01:56:06.959149+0000","last_peered":"2024-09-17T01:56:06.959149+0000","last_clean":"2024-09-17T01:56:06.959149+0000","last_became_active":"2024-09-17T01:54:45.112444+0000","last_became_peered":"2024-09-17T01:54:45.112444+0000","last_unstale":"2024-09-17T01:56:06.959149+0000","last_undegraded":"2024-09-17T01:56:06.959149+0000","last_fullsized":"2024-09-17T01:56:06.959149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:48.543868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117622,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"46'24","reported_seq":88,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.775405+0000","last_change":"2024-09-17T01:54:45.092445+0000","last_active":"2024-09-17T01:56:06.775405+0000","last_peered":"2024-09-17T01:56:06.775405+0000","last_clean":"2024-09-17T01:56:06.775405+0000","last_became_active":"2024-09-17T01:54:45.090698+0000","last_became_peered":"2024-09-17T01:54:45.090698+0000","last_unstale":"2024-09-17T01:56:06.775405+0000","last_undegraded":"2024-09-17T01:56:06.775405+0000","last_fullsized":"2024-09-17T01:56:06.775405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96989,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"46'29","reported_seq":93,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.903783+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:56:06.903783+0000","last_peered":"2024-09-17T01:56:06.903783+0000","last_clean":"2024-09-17T01:56:06.903783+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:56:06.903783+0000","last_undegraded":"2024-09-17T01:56:06.903783+0000","last_fullsized":"2024-09-17T01:56:06.903783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118910,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.932022+0000","last_change":"2024-09-17T01:54:45.100869+0000","last_active":"2024-09-17T01:56:06.932022+0000","last_peered":"2024-09-17T01:56:06.932022+0000","last_clean":"2024-09-17T01:56:06.932022+0000","last_became_active":"2024-09-17T01:54:45.100281+0000","last_became_peered":"2024-09-17T01:54:45.100281+0000","last_unstale":"2024-09-17T01:56:06.932022+0000","last_undegraded":"2024-09-17T01:56:06.932022+0000","last_fullsized":"2024-09-17T01:56:06.932022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4355209,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":4276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"46'33","reported_seq":99,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:07.005935+0000","last_change":"2024-09-17T01:54:45.105984+0000","last_active":"2024-09-17T01:56:07.005935+0000","last_peered":"2024-09-17T01:56:07.005935+0000","last_clean":"2024-09-17T01:56:07.005935+0000","last_became_active":"2024-09-17T01:54:45.103896+0000","last_became_peered":"2024-09-17T01:54:45.103896+0000","last_unstale":"2024-09-17T01:56:07.005935+0000","last_undegraded":"2024-09-17T01:56:07.005935+0000","last_fullsized":"2024-09-17T01:56:07.005935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91962,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"46'38","reported_seq":104,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.647975+0000","last_change":"2024-09-17T01:54:45.106338+0000","last_active":"2024-09-17T01:56:06.647975+0000","last_peered":"2024-09-17T01:56:06.647975+0000","last_clean":"2024-09-17T01:56:06.647975+0000","last_became_active":"2024-09-17T01:54:45.105285+0000","last_became_peered":"2024-09-17T01:54:45.105285+0000","last_unstale":"2024-09-17T01:56:06.647975+0000","last_undegraded":"2024-09-17T01:56:06.647975+0000","last_fullsized":"2024-09-17T01:56:06.647975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125185,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"46'36","reported_seq":102,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.940771+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:56:06.940771+0000","last_peered":"2024-09-17T01:56:06.940771+0000","last_clean":"2024-09-17T01:56:06.940771+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:56:06.940771+0000","last_undegraded":"2024-09-17T01:56:06.940771+0000","last_fullsized":"2024-09-17T01:56:06.940771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104372,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"46'41","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.957573+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:56:06.957573+0000","last_peered":"2024-09-17T01:56:06.957573+0000","last_clean":"2024-09-17T01:56:06.957573+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:56:06.957573+0000","last_undegraded":"2024-09-17T01:56:06.957573+0000","last_fullsized":"2024-09-17T01:56:06.957573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98733,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"46'32","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.613014+0000","last_change":"2024-09-17T01:54:45.096215+0000","last_active":"2024-09-17T01:56:06.613014+0000","last_peered":"2024-09-17T01:56:06.613014+0000","last_clean":"2024-09-17T01:56:06.613014+0000","last_became_active":"2024-09-17T01:54:45.095420+0000","last_became_peered":"2024-09-17T01:54:45.095420+0000","last_unstale":"2024-09-17T01:56:06.613014+0000","last_undegraded":"2024-09-17T01:56:06.613014+0000","last_fullsized":"2024-09-17T01:56:06.613014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123596,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.876893+0000","last_change":"2024-09-17T01:54:45.114186+0000","last_active":"2024-09-17T01:56:06.876893+0000","last_peered":"2024-09-17T01:56:06.876893+0000","last_clean":"2024-09-17T01:56:06.876893+0000","last_became_active":"2024-09-17T01:54:45.112698+0000","last_became_peered":"2024-09-17T01:54:45.112698+0000","last_unstale":"2024-09-17T01:56:06.876893+0000","last_undegraded":"2024-09-17T01:56:06.876893+0000","last_fullsized":"2024-09-17T01:56:06.876893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110460,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.875502+0000","last_change":"2024-09-17T01:54:45.113896+0000","last_active":"2024-09-17T01:56:06.875502+0000","last_peered":"2024-09-17T01:56:06.875502+0000","last_clean":"2024-09-17T01:56:06.875502+0000","last_became_active":"2024-09-17T01:54:45.112504+0000","last_became_peered":"2024-09-17T01:54:45.112504+0000","last_unstale":"2024-09-17T01:56:06.875502+0000","last_undegraded":"2024-09-17T01:56:06.875502+0000","last_fullsized":"2024-09-17T01:56:06.875502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104463,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"46'36","reported_seq":100,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.935182+0000","last_change":"2024-09-17T01:54:45.092417+0000","last_active":"2024-09-17T01:56:06.935182+0000","last_peered":"2024-09-17T01:56:06.935182+0000","last_clean":"2024-09-17T01:56:06.935182+0000","last_became_active":"2024-09-17T01:54:45.090846+0000","last_became_peered":"2024-09-17T01:54:45.090846+0000","last_unstale":"2024-09-17T01:56:06.935182+0000","last_undegraded":"2024-09-17T01:56:06.935182+0000","last_fullsized":"2024-09-17T01:56:06.935182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:23.694347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207748,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"46'41","reported_seq":107,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.805940+0000","last_change":"2024-09-17T01:54:45.107050+0000","last_active":"2024-09-17T01:56:06.805940+0000","last_peered":"2024-09-17T01:56:06.805940+0000","last_clean":"2024-09-17T01:56:06.805940+0000","last_became_active":"2024-09-17T01:54:45.104653+0000","last_became_peered":"2024-09-17T01:54:45.104653+0000","last_unstale":"2024-09-17T01:56:06.805940+0000","last_undegraded":"2024-09-17T01:56:06.805940+0000","last_fullsized":"2024-09-17T01:56:06.805940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.840285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133505,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"46'31","reported_seq":95,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.496964+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:56:06.496964+0000","last_peered":"2024-09-17T01:56:06.496964+0000","last_clean":"2024-09-17T01:56:06.496964+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:56:06.496964+0000","last_undegraded":"2024-09-17T01:56:06.496964+0000","last_fullsized":"2024-09-17T01:56:06.496964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75901,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"46'40","reported_seq":104,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.987986+0000","last_change":"2024-09-17T01:54:45.092565+0000","last_active":"2024-09-17T01:56:06.987986+0000","last_peered":"2024-09-17T01:56:06.987986+0000","last_clean":"2024-09-17T01:56:06.987986+0000","last_became_active":"2024-09-17T01:54:45.088639+0000","last_became_peered":"2024-09-17T01:54:45.088639+0000","last_unstale":"2024-09-17T01:56:06.987986+0000","last_undegraded":"2024-09-17T01:56:06.987986+0000","last_fullsized":"2024-09-17T01:56:06.987986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111276,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"46'37","reported_seq":103,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.943972+0000","last_change":"2024-09-17T01:54:45.107241+0000","last_active":"2024-09-17T01:56:06.943972+0000","last_peered":"2024-09-17T01:56:06.943972+0000","last_clean":"2024-09-17T01:56:06.943972+0000","last_became_active":"2024-09-17T01:54:45.104793+0000","last_became_peered":"2024-09-17T01:54:45.104793+0000","last_unstale":"2024-09-17T01:56:06.943972+0000","last_undegraded":"2024-09-17T01:56:06.943972+0000","last_fullsized":"2024-09-17T01:56:06.943972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176695,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"46'31","reported_seq":97,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.915876+0000","last_change":"2024-09-17T01:54:45.107824+0000","last_active":"2024-09-17T01:56:06.915876+0000","last_peered":"2024-09-17T01:56:06.915876+0000","last_clean":"2024-09-17T01:56:06.915876+0000","last_became_active":"2024-09-17T01:54:45.106851+0000","last_became_peered":"2024-09-17T01:54:45.106851+0000","last_unstale":"2024-09-17T01:56:06.915876+0000","last_undegraded":"2024-09-17T01:56:06.915876+0000","last_fullsized":"2024-09-17T01:56:06.915876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:57.381013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133119,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"46'34","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.933476+0000","last_change":"2024-09-17T01:54:45.093130+0000","last_active":"2024-09-17T01:56:06.933476+0000","last_peered":"2024-09-17T01:56:06.933476+0000","last_clean":"2024-09-17T01:56:06.933476+0000","last_became_active":"2024-09-17T01:54:45.092455+0000","last_became_peered":"2024-09-17T01:54:45.092455+0000","last_unstale":"2024-09-17T01:56:06.933476+0000","last_undegraded":"2024-09-17T01:56:06.933476+0000","last_fullsized":"2024-09-17T01:56:06.933476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122258,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"46'27","reported_seq":93,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.832579+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:56:06.832579+0000","last_peered":"2024-09-17T01:56:06.832579+0000","last_clean":"2024-09-17T01:56:06.832579+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:56:06.832579+0000","last_undegraded":"2024-09-17T01:56:06.832579+0000","last_fullsized":"2024-09-17T01:56:06.832579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153331,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"46'46","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.874866+0000","last_change":"2024-09-17T01:54:45.081341+0000","last_active":"2024-09-17T01:56:06.874866+0000","last_peered":"2024-09-17T01:56:06.874866+0000","last_clean":"2024-09-17T01:56:06.874866+0000","last_became_active":"2024-09-17T01:54:45.080687+0000","last_became_peered":"2024-09-17T01:54:45.080687+0000","last_unstale":"2024-09-17T01:56:06.874866+0000","last_undegraded":"2024-09-17T01:56:06.874866+0000","last_fullsized":"2024-09-17T01:56:06.874866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185738,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"46'37","reported_seq":103,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.883788+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:56:06.883788+0000","last_peered":"2024-09-17T01:56:06.883788+0000","last_clean":"2024-09-17T01:56:06.883788+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:56:06.883788+0000","last_undegraded":"2024-09-17T01:56:06.883788+0000","last_fullsized":"2024-09-17T01:56:06.883788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155765,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.758077+0000","last_change":"2024-09-17T01:54:45.113885+0000","last_active":"2024-09-17T01:56:06.758077+0000","last_peered":"2024-09-17T01:56:06.758077+0000","last_clean":"2024-09-17T01:56:06.758077+0000","last_became_active":"2024-09-17T01:54:45.112631+0000","last_became_peered":"2024-09-17T01:54:45.112631+0000","last_unstale":"2024-09-17T01:56:06.758077+0000","last_undegraded":"2024-09-17T01:56:06.758077+0000","last_fullsized":"2024-09-17T01:56:06.758077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170502,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"46'27","reported_seq":91,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.961189+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:56:06.961189+0000","last_peered":"2024-09-17T01:56:06.961189+0000","last_clean":"2024-09-17T01:56:06.961189+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:56:06.961189+0000","last_undegraded":"2024-09-17T01:56:06.961189+0000","last_fullsized":"2024-09-17T01:56:06.961189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165512,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242442+0000","last_change":"2024-09-17T01:54:44.231592+0000","last_active":"2024-09-17T01:56:04.242442+0000","last_peered":"2024-09-17T01:56:04.242442+0000","last_clean":"2024-09-17T01:56:04.242442+0000","last_became_active":"2024-09-17T01:54:44.230951+0000","last_became_peered":"2024-09-17T01:54:44.230951+0000","last_unstale":"2024-09-17T01:56:04.242442+0000","last_undegraded":"2024-09-17T01:56:04.242442+0000","last_fullsized":"2024-09-17T01:56:04.242442+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"46'34","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.650484+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:56:06.650484+0000","last_peered":"2024-09-17T01:56:06.650484+0000","last_clean":"2024-09-17T01:56:06.650484+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:56:06.650484+0000","last_undegraded":"2024-09-17T01:56:06.650484+0000","last_fullsized":"2024-09-17T01:56:06.650484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131172,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.239628+0000","last_change":"2024-09-17T01:54:44.235432+0000","last_active":"2024-09-17T01:56:04.239628+0000","last_peered":"2024-09-17T01:56:04.239628+0000","last_clean":"2024-09-17T01:56:04.239628+0000","last_became_active":"2024-09-17T01:54:44.234595+0000","last_became_peered":"2024-09-17T01:54:44.234595+0000","last_unstale":"2024-09-17T01:56:04.239628+0000","last_undegraded":"2024-09-17T01:56:04.239628+0000","last_fullsized":"2024-09-17T01:56:04.239628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"46'34","reported_seq":100,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.959706+0000","last_change":"2024-09-17T01:54:45.101097+0000","last_active":"2024-09-17T01:56:06.959706+0000","last_peered":"2024-09-17T01:56:06.959706+0000","last_clean":"2024-09-17T01:56:06.959706+0000","last_became_active":"2024-09-17T01:54:45.096185+0000","last_became_peered":"2024-09-17T01:54:45.096185+0000","last_unstale":"2024-09-17T01:56:06.959706+0000","last_undegraded":"2024-09-17T01:56:06.959706+0000","last_fullsized":"2024-09-17T01:56:06.959706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162547,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.229311+0000","last_change":"2024-09-17T01:54:44.224349+0000","last_active":"2024-09-17T01:56:04.229311+0000","last_peered":"2024-09-17T01:56:04.229311+0000","last_clean":"2024-09-17T01:56:04.229311+0000","last_became_active":"2024-09-17T01:54:44.223761+0000","last_became_peered":"2024-09-17T01:54:44.223761+0000","last_unstale":"2024-09-17T01:56:04.229311+0000","last_undegraded":"2024-09-17T01:56:04.229311+0000","last_fullsized":"2024-09-17T01:56:04.229311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:08.333813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"46'33","reported_seq":99,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.844736+0000","last_change":"2024-09-17T01:54:45.113669+0000","last_active":"2024-09-17T01:56:06.844736+0000","last_peered":"2024-09-17T01:56:06.844736+0000","last_clean":"2024-09-17T01:56:06.844736+0000","last_became_active":"2024-09-17T01:54:45.112974+0000","last_became_peered":"2024-09-17T01:54:45.112974+0000","last_unstale":"2024-09-17T01:56:06.844736+0000","last_undegraded":"2024-09-17T01:56:06.844736+0000","last_fullsized":"2024-09-17T01:56:06.844736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88990,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":76,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.241655+0000","last_change":"2024-09-17T01:54:44.232085+0000","last_active":"2024-09-17T01:56:04.241655+0000","last_peered":"2024-09-17T01:56:04.241655+0000","last_clean":"2024-09-17T01:56:04.241655+0000","last_became_active":"2024-09-17T01:54:44.224925+0000","last_became_peered":"2024-09-17T01:54:44.224925+0000","last_unstale":"2024-09-17T01:56:04.241655+0000","last_undegraded":"2024-09-17T01:56:04.241655+0000","last_fullsized":"2024-09-17T01:56:04.241655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:22.248515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242787+0000","last_change":"2024-09-17T01:54:44.229770+0000","last_active":"2024-09-17T01:56:04.242787+0000","last_peered":"2024-09-17T01:56:04.242787+0000","last_clean":"2024-09-17T01:56:04.242787+0000","last_became_active":"2024-09-17T01:54:44.225105+0000","last_became_peered":"2024-09-17T01:54:44.225105+0000","last_unstale":"2024-09-17T01:56:04.242787+0000","last_undegraded":"2024-09-17T01:56:04.242787+0000","last_fullsized":"2024-09-17T01:56:04.242787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.410198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"46'26","reported_seq":90,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.538692+0000","last_change":"2024-09-17T01:54:45.092778+0000","last_active":"2024-09-17T01:56:06.538692+0000","last_peered":"2024-09-17T01:56:06.538692+0000","last_clean":"2024-09-17T01:56:06.538692+0000","last_became_active":"2024-09-17T01:54:45.091307+0000","last_became_peered":"2024-09-17T01:54:45.091307+0000","last_unstale":"2024-09-17T01:56:06.538692+0000","last_undegraded":"2024-09-17T01:56:06.538692+0000","last_fullsized":"2024-09-17T01:56:06.538692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.569642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58347,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.231265+0000","last_change":"2024-09-17T01:54:44.224046+0000","last_active":"2024-09-17T01:56:04.231265+0000","last_peered":"2024-09-17T01:56:04.231265+0000","last_clean":"2024-09-17T01:56:04.231265+0000","last_became_active":"2024-09-17T01:54:44.223325+0000","last_became_peered":"2024-09-17T01:54:44.223325+0000","last_unstale":"2024-09-17T01:56:04.231265+0000","last_undegraded":"2024-09-17T01:56:04.231265+0000","last_fullsized":"2024-09-17T01:56:04.231265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:22.367567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'37","reported_seq":101,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.838342+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:56:06.838342+0000","last_peered":"2024-09-17T01:56:06.838342+0000","last_clean":"2024-09-17T01:56:06.838342+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:56:06.838342+0000","last_undegraded":"2024-09-17T01:56:06.838342+0000","last_fullsized":"2024-09-17T01:56:06.838342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114739,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.243351+0000","last_change":"2024-09-17T01:54:44.230495+0000","last_active":"2024-09-17T01:56:04.243351+0000","last_peered":"2024-09-17T01:56:04.243351+0000","last_clean":"2024-09-17T01:56:04.243351+0000","last_became_active":"2024-09-17T01:54:44.226784+0000","last_became_peered":"2024-09-17T01:54:44.226784+0000","last_unstale":"2024-09-17T01:56:04.243351+0000","last_undegraded":"2024-09-17T01:56:04.243351+0000","last_fullsized":"2024-09-17T01:56:04.243351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.746570+0000","last_change":"2024-09-17T01:54:45.114150+0000","last_active":"2024-09-17T01:56:06.746570+0000","last_peered":"2024-09-17T01:56:06.746570+0000","last_clean":"2024-09-17T01:56:06.746570+0000","last_became_active":"2024-09-17T01:54:45.113420+0000","last_became_peered":"2024-09-17T01:54:45.113420+0000","last_unstale":"2024-09-17T01:56:06.746570+0000","last_undegraded":"2024-09-17T01:56:06.746570+0000","last_fullsized":"2024-09-17T01:56:06.746570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:58.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136107,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.243123+0000","last_change":"2024-09-17T01:54:44.225889+0000","last_active":"2024-09-17T01:56:04.243123+0000","last_peered":"2024-09-17T01:56:04.243123+0000","last_clean":"2024-09-17T01:56:04.243123+0000","last_became_active":"2024-09-17T01:54:44.225048+0000","last_became_peered":"2024-09-17T01:54:44.225048+0000","last_unstale":"2024-09-17T01:56:04.243123+0000","last_undegraded":"2024-09-17T01:56:04.243123+0000","last_fullsized":"2024-09-17T01:56:04.243123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"46'32","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.528862+0000","last_change":"2024-09-17T01:54:45.114765+0000","last_active":"2024-09-17T01:56:06.528862+0000","last_peered":"2024-09-17T01:56:06.528862+0000","last_clean":"2024-09-17T01:56:06.528862+0000","last_became_active":"2024-09-17T01:54:45.113908+0000","last_became_peered":"2024-09-17T01:54:45.113908+0000","last_unstale":"2024-09-17T01:56:06.528862+0000","last_undegraded":"2024-09-17T01:56:06.528862+0000","last_fullsized":"2024-09-17T01:56:06.528862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144395,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.238102+0000","last_change":"2024-09-17T01:54:44.236991+0000","last_active":"2024-09-17T01:56:04.238102+0000","last_peered":"2024-09-17T01:56:04.238102+0000","last_clean":"2024-09-17T01:56:04.238102+0000","last_became_active":"2024-09-17T01:54:44.236254+0000","last_became_peered":"2024-09-17T01:54:44.236254+0000","last_unstale":"2024-09-17T01:56:04.238102+0000","last_undegraded":"2024-09-17T01:56:04.238102+0000","last_fullsized":"2024-09-17T01:56:04.238102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:00.977633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"46'39","reported_seq":105,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.909976+0000","last_change":"2024-09-17T01:54:45.107737+0000","last_active":"2024-09-17T01:56:06.909976+0000","last_peered":"2024-09-17T01:56:06.909976+0000","last_clean":"2024-09-17T01:56:06.909976+0000","last_became_active":"2024-09-17T01:54:45.107077+0000","last_became_peered":"2024-09-17T01:54:45.107077+0000","last_unstale":"2024-09-17T01:56:06.909976+0000","last_undegraded":"2024-09-17T01:56:06.909976+0000","last_fullsized":"2024-09-17T01:56:06.909976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:23.963848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162760,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242544+0000","last_change":"2024-09-17T01:54:44.231059+0000","last_active":"2024-09-17T01:56:04.242544+0000","last_peered":"2024-09-17T01:56:04.242544+0000","last_clean":"2024-09-17T01:56:04.242544+0000","last_became_active":"2024-09-17T01:54:44.230164+0000","last_became_peered":"2024-09-17T01:54:44.230164+0000","last_unstale":"2024-09-17T01:56:04.242544+0000","last_undegraded":"2024-09-17T01:56:04.242544+0000","last_fullsized":"2024-09-17T01:56:04.242544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.030043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'31","reported_seq":97,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.830897+0000","last_change":"2024-09-17T01:54:45.108194+0000","last_active":"2024-09-17T01:56:06.830897+0000","last_peered":"2024-09-17T01:56:06.830897+0000","last_clean":"2024-09-17T01:56:06.830897+0000","last_became_active":"2024-09-17T01:54:45.107317+0000","last_became_peered":"2024-09-17T01:54:45.107317+0000","last_unstale":"2024-09-17T01:56:06.830897+0000","last_undegraded":"2024-09-17T01:56:06.830897+0000","last_fullsized":"2024-09-17T01:56:06.830897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:11:12.349380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136977,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.229622+0000","last_change":"2024-09-17T01:54:44.225185+0000","last_active":"2024-09-17T01:56:04.229622+0000","last_peered":"2024-09-17T01:56:04.229622+0000","last_clean":"2024-09-17T01:56:04.229622+0000","last_became_active":"2024-09-17T01:54:44.224094+0000","last_became_peered":"2024-09-17T01:54:44.224094+0000","last_unstale":"2024-09-17T01:56:04.229622+0000","last_undegraded":"2024-09-17T01:56:04.229622+0000","last_fullsized":"2024-09-17T01:56:04.229622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:01.152945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"46'16","reported_seq":82,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.408483+0000","last_change":"2024-09-17T01:54:45.104511+0000","last_active":"2024-09-17T01:56:06.408483+0000","last_peered":"2024-09-17T01:56:06.408483+0000","last_clean":"2024-09-17T01:56:06.408483+0000","last_became_active":"2024-09-17T01:54:45.103829+0000","last_became_peered":"2024-09-17T01:54:45.103829+0000","last_unstale":"2024-09-17T01:56:06.408483+0000","last_undegraded":"2024-09-17T01:56:06.408483+0000","last_fullsized":"2024-09-17T01:56:06.408483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":66,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.229119+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:56:04.229119+0000","last_peered":"2024-09-17T01:56:04.229119+0000","last_clean":"2024-09-17T01:56:04.229119+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:56:04.229119+0000","last_undegraded":"2024-09-17T01:56:04.229119+0000","last_fullsized":"2024-09-17T01:56:04.229119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"46'29","reported_seq":95,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.732536+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:56:06.732536+0000","last_peered":"2024-09-17T01:56:06.732536+0000","last_clean":"2024-09-17T01:56:06.732536+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:56:06.732536+0000","last_undegraded":"2024-09-17T01:56:06.732536+0000","last_fullsized":"2024-09-17T01:56:06.732536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100371,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":278,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.241761+0000","last_change":"2024-09-17T01:54:33.902821+0000","last_active":"2024-09-17T01:56:04.241761+0000","last_peered":"2024-09-17T01:56:04.241761+0000","last_clean":"2024-09-17T01:56:04.241761+0000","last_became_active":"2024-09-17T01:54:33.900465+0000","last_became_peered":"2024-09-17T01:54:33.900465+0000","last_unstale":"2024-09-17T01:56:04.241761+0000","last_undegraded":"2024-09-17T01:56:04.241761+0000","last_fullsized":"2024-09-17T01:56:04.241761+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":82,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242686+0000","last_change":"2024-09-17T01:54:42.052537+0000","last_active":"2024-09-17T01:56:04.242686+0000","last_peered":"2024-09-17T01:56:04.242686+0000","last_clean":"2024-09-17T01:56:04.242686+0000","last_became_active":"2024-09-17T01:54:40.025915+0000","last_became_peered":"2024-09-17T01:54:40.025915+0000","last_unstale":"2024-09-17T01:56:04.242686+0000","last_undegraded":"2024-09-17T01:56:04.242686+0000","last_fullsized":"2024-09-17T01:56:04.242686+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:52.462218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027409890000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242190+0000","last_change":"2024-09-17T01:55:59.210644+0000","last_active":"2024-09-17T01:56:04.242190+0000","last_peered":"2024-09-17T01:56:04.242190+0000","last_clean":"2024-09-17T01:56:04.242190+0000","last_became_active":"2024-09-17T01:55:59.210102+0000","last_became_peered":"2024-09-17T01:55:59.210102+0000","last_unstale":"2024-09-17T01:56:04.242190+0000","last_undegraded":"2024-09-17T01:56:04.242190+0000","last_fullsized":"2024-09-17T01:56:04.242190+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"46'30","reported_seq":96,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.598164+0000","last_change":"2024-09-17T01:54:45.109812+0000","last_active":"2024-09-17T01:56:06.598164+0000","last_peered":"2024-09-17T01:56:06.598164+0000","last_clean":"2024-09-17T01:56:06.598164+0000","last_became_active":"2024-09-17T01:54:45.109015+0000","last_became_peered":"2024-09-17T01:54:45.109015+0000","last_unstale":"2024-09-17T01:56:06.598164+0000","last_undegraded":"2024-09-17T01:56:06.598164+0000","last_fullsized":"2024-09-17T01:56:06.598164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88196,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.241734+0000","last_change":"2024-09-17T01:54:42.050495+0000","last_active":"2024-09-17T01:56:04.241734+0000","last_peered":"2024-09-17T01:56:04.241734+0000","last_clean":"2024-09-17T01:56:04.241734+0000","last_became_active":"2024-09-17T01:54:40.026316+0000","last_became_peered":"2024-09-17T01:54:40.026316+0000","last_unstale":"2024-09-17T01:56:04.241734+0000","last_undegraded":"2024-09-17T01:56:04.241734+0000","last_fullsized":"2024-09-17T01:56:04.241734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088141399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.240190+0000","last_change":"2024-09-17T01:54:44.234743+0000","last_active":"2024-09-17T01:56:04.240190+0000","last_peered":"2024-09-17T01:56:04.240190+0000","last_clean":"2024-09-17T01:56:04.240190+0000","last_became_active":"2024-09-17T01:54:44.233879+0000","last_became_peered":"2024-09-17T01:54:44.233879+0000","last_unstale":"2024-09-17T01:56:04.240190+0000","last_undegraded":"2024-09-17T01:56:04.240190+0000","last_fullsized":"2024-09-17T01:56:04.240190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:59.528492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"46'34","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.834556+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:56:06.834556+0000","last_peered":"2024-09-17T01:56:06.834556+0000","last_clean":"2024-09-17T01:56:06.834556+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:56:06.834556+0000","last_undegraded":"2024-09-17T01:56:06.834556+0000","last_fullsized":"2024-09-17T01:56:06.834556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129735,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.240463+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:56:04.240463+0000","last_peered":"2024-09-17T01:56:04.240463+0000","last_clean":"2024-09-17T01:56:04.240463+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:56:04.240463+0000","last_undegraded":"2024-09-17T01:56:04.240463+0000","last_fullsized":"2024-09-17T01:56:04.240463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.229141+0000","last_change":"2024-09-17T01:54:44.228922+0000","last_active":"2024-09-17T01:56:04.229141+0000","last_peered":"2024-09-17T01:56:04.229141+0000","last_clean":"2024-09-17T01:56:04.229141+0000","last_became_active":"2024-09-17T01:54:44.228088+0000","last_became_peered":"2024-09-17T01:54:44.228088+0000","last_unstale":"2024-09-17T01:56:04.229141+0000","last_undegraded":"2024-09-17T01:56:04.229141+0000","last_fullsized":"2024-09-17T01:56:04.229141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:06.454620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"46'34","reported_seq":100,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.885442+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:56:06.885442+0000","last_peered":"2024-09-17T01:56:06.885442+0000","last_clean":"2024-09-17T01:56:06.885442+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:56:06.885442+0000","last_undegraded":"2024-09-17T01:56:06.885442+0000","last_fullsized":"2024-09-17T01:56:06.885442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116697,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":83,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242839+0000","last_change":"2024-09-17T01:54:42.052209+0000","last_active":"2024-09-17T01:56:04.242839+0000","last_peered":"2024-09-17T01:56:04.242839+0000","last_clean":"2024-09-17T01:56:04.242839+0000","last_became_active":"2024-09-17T01:54:40.026298+0000","last_became_peered":"2024-09-17T01:54:40.026298+0000","last_unstale":"2024-09-17T01:56:04.242839+0000","last_undegraded":"2024-09-17T01:56:04.242839+0000","last_fullsized":"2024-09-17T01:56:04.242839+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:05.545768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024644549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242576+0000","last_change":"2024-09-17T01:54:44.231415+0000","last_active":"2024-09-17T01:56:04.242576+0000","last_peered":"2024-09-17T01:56:04.242576+0000","last_clean":"2024-09-17T01:56:04.242576+0000","last_became_active":"2024-09-17T01:54:44.230529+0000","last_became_peered":"2024-09-17T01:54:44.230529+0000","last_unstale":"2024-09-17T01:56:04.242576+0000","last_undegraded":"2024-09-17T01:56:04.242576+0000","last_fullsized":"2024-09-17T01:56:04.242576+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:07.873699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"46'29","reported_seq":95,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.789964+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:56:06.789964+0000","last_peered":"2024-09-17T01:56:06.789964+0000","last_clean":"2024-09-17T01:56:06.789964+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:56:06.789964+0000","last_undegraded":"2024-09-17T01:56:06.789964+0000","last_fullsized":"2024-09-17T01:56:06.789964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145887,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.243388+0000","last_change":"2024-09-17T01:54:44.230578+0000","last_active":"2024-09-17T01:56:04.243388+0000","last_peered":"2024-09-17T01:56:04.243388+0000","last_clean":"2024-09-17T01:56:04.243388+0000","last_became_active":"2024-09-17T01:54:44.225895+0000","last_became_peered":"2024-09-17T01:54:44.225895+0000","last_unstale":"2024-09-17T01:56:04.243388+0000","last_undegraded":"2024-09-17T01:56:04.243388+0000","last_fullsized":"2024-09-17T01:56:04.243388+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:18.806022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.240326+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:56:04.240326+0000","last_peered":"2024-09-17T01:56:04.240326+0000","last_clean":"2024-09-17T01:56:04.240326+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:56:04.240326+0000","last_undegraded":"2024-09-17T01:56:04.240326+0000","last_fullsized":"2024-09-17T01:56:04.240326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'30","reported_seq":94,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.830571+0000","last_change":"2024-09-17T01:54:45.090777+0000","last_active":"2024-09-17T01:56:06.830571+0000","last_peered":"2024-09-17T01:56:06.830571+0000","last_clean":"2024-09-17T01:56:06.830571+0000","last_became_active":"2024-09-17T01:54:45.088767+0000","last_became_peered":"2024-09-17T01:54:45.088767+0000","last_unstale":"2024-09-17T01:56:06.830571+0000","last_undegraded":"2024-09-17T01:56:06.830571+0000","last_fullsized":"2024-09-17T01:56:06.830571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:23.588427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99929,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.237956+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:56:04.237956+0000","last_peered":"2024-09-17T01:56:04.237956+0000","last_clean":"2024-09-17T01:56:04.237956+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:56:04.237956+0000","last_undegraded":"2024-09-17T01:56:04.237956+0000","last_fullsized":"2024-09-17T01:56:04.237956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.231021+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:56:04.231021+0000","last_peered":"2024-09-17T01:56:04.231021+0000","last_clean":"2024-09-17T01:56:04.231021+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:56:04.231021+0000","last_undegraded":"2024-09-17T01:56:04.231021+0000","last_fullsized":"2024-09-17T01:56:04.231021+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"46'26","reported_seq":90,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.910281+0000","last_change":"2024-09-17T01:54:45.088780+0000","last_active":"2024-09-17T01:56:06.910281+0000","last_peered":"2024-09-17T01:56:06.910281+0000","last_clean":"2024-09-17T01:56:06.910281+0000","last_became_active":"2024-09-17T01:54:45.087964+0000","last_became_peered":"2024-09-17T01:54:45.087964+0000","last_unstale":"2024-09-17T01:56:06.910281+0000","last_undegraded":"2024-09-17T01:56:06.910281+0000","last_fullsized":"2024-09-17T01:56:06.910281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:11.447557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50729,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.237999+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:56:04.237999+0000","last_peered":"2024-09-17T01:56:04.237999+0000","last_clean":"2024-09-17T01:56:04.237999+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:56:04.237999+0000","last_undegraded":"2024-09-17T01:56:04.237999+0000","last_fullsized":"2024-09-17T01:56:04.237999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.241334+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:56:04.241334+0000","last_peered":"2024-09-17T01:56:04.241334+0000","last_clean":"2024-09-17T01:56:04.241334+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:56:04.241334+0000","last_undegraded":"2024-09-17T01:56:04.241334+0000","last_fullsized":"2024-09-17T01:56:04.241334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"46'27","reported_seq":93,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.711939+0000","last_change":"2024-09-17T01:54:45.100496+0000","last_active":"2024-09-17T01:56:06.711939+0000","last_peered":"2024-09-17T01:56:06.711939+0000","last_clean":"2024-09-17T01:56:06.711939+0000","last_became_active":"2024-09-17T01:54:45.098721+0000","last_became_peered":"2024-09-17T01:54:45.098721+0000","last_unstale":"2024-09-17T01:56:06.711939+0000","last_undegraded":"2024-09-17T01:56:06.711939+0000","last_fullsized":"2024-09-17T01:56:06.711939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132557,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"46'7","reported_seq":75,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:05.229916+0000","last_change":"2024-09-17T01:54:44.234490+0000","last_active":"2024-09-17T01:56:05.229916+0000","last_peered":"2024-09-17T01:56:05.229916+0000","last_clean":"2024-09-17T01:56:05.229916+0000","last_became_active":"2024-09-17T01:54:44.232948+0000","last_became_peered":"2024-09-17T01:54:44.232948+0000","last_unstale":"2024-09-17T01:56:05.229916+0000","last_undegraded":"2024-09-17T01:56:05.229916+0000","last_fullsized":"2024-09-17T01:56:05.229916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.045793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242784+0000","last_change":"2024-09-17T01:54:42.050525+0000","last_active":"2024-09-17T01:56:04.242784+0000","last_peered":"2024-09-17T01:56:04.242784+0000","last_clean":"2024-09-17T01:56:04.242784+0000","last_became_active":"2024-09-17T01:54:40.026061+0000","last_became_peered":"2024-09-17T01:54:40.026061+0000","last_unstale":"2024-09-17T01:56:04.242784+0000","last_undegraded":"2024-09-17T01:56:04.242784+0000","last_fullsized":"2024-09-17T01:56:04.242784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.116081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079306400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'28","reported_seq":92,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.859719+0000","last_change":"2024-09-17T01:54:45.091447+0000","last_active":"2024-09-17T01:56:06.859719+0000","last_peered":"2024-09-17T01:56:06.859719+0000","last_clean":"2024-09-17T01:56:06.859719+0000","last_became_active":"2024-09-17T01:54:45.090443+0000","last_became_peered":"2024-09-17T01:54:45.090443+0000","last_unstale":"2024-09-17T01:56:06.859719+0000","last_undegraded":"2024-09-17T01:56:06.859719+0000","last_fullsized":"2024-09-17T01:56:06.859719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72695,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"46'32","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.690154+0000","last_change":"2024-09-17T01:54:45.099872+0000","last_active":"2024-09-17T01:56:06.690154+0000","last_peered":"2024-09-17T01:56:06.690154+0000","last_clean":"2024-09-17T01:56:06.690154+0000","last_became_active":"2024-09-17T01:54:45.099008+0000","last_became_peered":"2024-09-17T01:54:45.099008+0000","last_unstale":"2024-09-17T01:56:06.690154+0000","last_undegraded":"2024-09-17T01:56:06.690154+0000","last_fullsized":"2024-09-17T01:56:06.690154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.900561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449710,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":2411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"46'20","reported_seq":88,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.459021+0000","last_change":"2024-09-17T01:54:44.225856+0000","last_active":"2024-09-17T01:56:06.459021+0000","last_peered":"2024-09-17T01:56:06.459021+0000","last_clean":"2024-09-17T01:56:06.459021+0000","last_became_active":"2024-09-17T01:54:44.224999+0000","last_became_peered":"2024-09-17T01:54:44.224999+0000","last_unstale":"2024-09-17T01:56:06.459021+0000","last_undegraded":"2024-09-17T01:56:06.459021+0000","last_fullsized":"2024-09-17T01:56:06.459021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:19.796453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"46'34","reported_seq":100,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.413312+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:56:06.413312+0000","last_peered":"2024-09-17T01:56:06.413312+0000","last_clean":"2024-09-17T01:56:06.413312+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:56:06.413312+0000","last_undegraded":"2024-09-17T01:56:06.413312+0000","last_fullsized":"2024-09-17T01:56:06.413312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92504,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.230833+0000","last_change":"2024-09-17T01:54:44.228682+0000","last_active":"2024-09-17T01:56:04.230833+0000","last_peered":"2024-09-17T01:56:04.230833+0000","last_clean":"2024-09-17T01:56:04.230833+0000","last_became_active":"2024-09-17T01:54:44.227962+0000","last_became_peered":"2024-09-17T01:54:44.227962+0000","last_unstale":"2024-09-17T01:56:04.230833+0000","last_undegraded":"2024-09-17T01:56:04.230833+0000","last_fullsized":"2024-09-17T01:56:04.230833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:34.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242936+0000","last_change":"2024-09-17T01:54:44.231017+0000","last_active":"2024-09-17T01:56:04.242936+0000","last_peered":"2024-09-17T01:56:04.242936+0000","last_clean":"2024-09-17T01:56:04.242936+0000","last_became_active":"2024-09-17T01:54:44.230331+0000","last_became_peered":"2024-09-17T01:54:44.230331+0000","last_unstale":"2024-09-17T01:56:04.242936+0000","last_undegraded":"2024-09-17T01:56:04.242936+0000","last_fullsized":"2024-09-17T01:56:04.242936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.148426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"46'31","reported_seq":97,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.968584+0000","last_change":"2024-09-17T01:54:45.103779+0000","last_active":"2024-09-17T01:56:06.968584+0000","last_peered":"2024-09-17T01:56:06.968584+0000","last_clean":"2024-09-17T01:56:06.968584+0000","last_became_active":"2024-09-17T01:54:45.099274+0000","last_became_peered":"2024-09-17T01:54:45.099274+0000","last_unstale":"2024-09-17T01:56:06.968584+0000","last_undegraded":"2024-09-17T01:56:06.968584+0000","last_fullsized":"2024-09-17T01:56:06.968584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80900,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.238501+0000","last_change":"2024-09-17T01:54:44.236527+0000","last_active":"2024-09-17T01:56:04.238501+0000","last_peered":"2024-09-17T01:56:04.238501+0000","last_clean":"2024-09-17T01:56:04.238501+0000","last_became_active":"2024-09-17T01:54:44.235922+0000","last_became_peered":"2024-09-17T01:54:44.235922+0000","last_unstale":"2024-09-17T01:56:04.238501+0000","last_undegraded":"2024-09-17T01:56:04.238501+0000","last_fullsized":"2024-09-17T01:56:04.238501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:28.972797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"46'35","reported_seq":101,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.965959+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:56:06.965959+0000","last_peered":"2024-09-17T01:56:06.965959+0000","last_clean":"2024-09-17T01:56:06.965959+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:56:06.965959+0000","last_undegraded":"2024-09-17T01:56:06.965959+0000","last_fullsized":"2024-09-17T01:56:06.965959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4362313,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"46'37","reported_seq":101,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.744757+0000","last_change":"2024-09-17T01:54:45.084323+0000","last_active":"2024-09-17T01:56:06.744757+0000","last_peered":"2024-09-17T01:56:06.744757+0000","last_clean":"2024-09-17T01:56:06.744757+0000","last_became_active":"2024-09-17T01:54:45.083701+0000","last_became_peered":"2024-09-17T01:54:45.083701+0000","last_unstale":"2024-09-17T01:56:06.744757+0000","last_undegraded":"2024-09-17T01:56:06.744757+0000","last_fullsized":"2024-09-17T01:56:06.744757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108740,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.237862+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:56:04.237862+0000","last_peered":"2024-09-17T01:56:04.237862+0000","last_clean":"2024-09-17T01:56:04.237862+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:56:04.237862+0000","last_undegraded":"2024-09-17T01:56:04.237862+0000","last_fullsized":"2024-09-17T01:56:04.237862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"46'31","reported_seq":97,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:07.003203+0000","last_change":"2024-09-17T01:54:45.107341+0000","last_active":"2024-09-17T01:56:07.003203+0000","last_peered":"2024-09-17T01:56:07.003203+0000","last_clean":"2024-09-17T01:56:07.003203+0000","last_became_active":"2024-09-17T01:54:45.106253+0000","last_became_peered":"2024-09-17T01:54:45.106253+0000","last_unstale":"2024-09-17T01:56:07.003203+0000","last_undegraded":"2024-09-17T01:56:07.003203+0000","last_fullsized":"2024-09-17T01:56:07.003203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178965,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.239929+0000","last_change":"2024-09-17T01:54:44.236574+0000","last_active":"2024-09-17T01:56:04.239929+0000","last_peered":"2024-09-17T01:56:04.239929+0000","last_clean":"2024-09-17T01:56:04.239929+0000","last_became_active":"2024-09-17T01:54:44.234008+0000","last_became_peered":"2024-09-17T01:54:44.234008+0000","last_unstale":"2024-09-17T01:56:04.239929+0000","last_undegraded":"2024-09-17T01:56:04.239929+0000","last_fullsized":"2024-09-17T01:56:04.239929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:56.432146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"46'34","reported_seq":98,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:07.008715+0000","last_change":"2024-09-17T01:54:45.083699+0000","last_active":"2024-09-17T01:56:07.008715+0000","last_peered":"2024-09-17T01:56:07.008715+0000","last_clean":"2024-09-17T01:56:07.008715+0000","last_became_active":"2024-09-17T01:54:45.082901+0000","last_became_peered":"2024-09-17T01:54:45.082901+0000","last_unstale":"2024-09-17T01:56:07.008715+0000","last_undegraded":"2024-09-17T01:56:07.008715+0000","last_fullsized":"2024-09-17T01:56:07.008715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:32.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110382,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.229697+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:56:04.229697+0000","last_peered":"2024-09-17T01:56:04.229697+0000","last_clean":"2024-09-17T01:56:04.229697+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:56:04.229697+0000","last_undegraded":"2024-09-17T01:56:04.229697+0000","last_fullsized":"2024-09-17T01:56:04.229697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"46'30","reported_seq":94,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.967289+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:56:06.967289+0000","last_peered":"2024-09-17T01:56:06.967289+0000","last_clean":"2024-09-17T01:56:06.967289+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:56:06.967289+0000","last_undegraded":"2024-09-17T01:56:06.967289+0000","last_fullsized":"2024-09-17T01:56:06.967289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88696,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.231820+0000","last_change":"2024-09-17T01:54:44.224221+0000","last_active":"2024-09-17T01:56:04.231820+0000","last_peered":"2024-09-17T01:56:04.231820+0000","last_clean":"2024-09-17T01:56:04.231820+0000","last_became_active":"2024-09-17T01:54:44.223204+0000","last_became_peered":"2024-09-17T01:54:44.223204+0000","last_unstale":"2024-09-17T01:56:04.231820+0000","last_undegraded":"2024-09-17T01:56:04.231820+0000","last_fullsized":"2024-09-17T01:56:04.231820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:30.933518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"46'35","reported_seq":101,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.982707+0000","last_change":"2024-09-17T01:54:45.112045+0000","last_active":"2024-09-17T01:56:06.982707+0000","last_peered":"2024-09-17T01:56:06.982707+0000","last_clean":"2024-09-17T01:56:06.982707+0000","last_became_active":"2024-09-17T01:54:45.109665+0000","last_became_peered":"2024-09-17T01:54:45.109665+0000","last_unstale":"2024-09-17T01:56:06.982707+0000","last_undegraded":"2024-09-17T01:56:06.982707+0000","last_fullsized":"2024-09-17T01:56:06.982707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:26.250691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116863,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.242984+0000","last_change":"2024-09-17T01:54:44.230590+0000","last_active":"2024-09-17T01:56:04.242984+0000","last_peered":"2024-09-17T01:56:04.242984+0000","last_clean":"2024-09-17T01:56:04.242984+0000","last_became_active":"2024-09-17T01:54:44.228155+0000","last_became_peered":"2024-09-17T01:54:44.228155+0000","last_unstale":"2024-09-17T01:56:04.242984+0000","last_undegraded":"2024-09-17T01:56:04.242984+0000","last_fullsized":"2024-09-17T01:56:04.242984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:47.621370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"46'30","reported_seq":96,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.986400+0000","last_change":"2024-09-17T01:54:45.114112+0000","last_active":"2024-09-17T01:56:06.986400+0000","last_peered":"2024-09-17T01:56:06.986400+0000","last_clean":"2024-09-17T01:56:06.986400+0000","last_became_active":"2024-09-17T01:54:45.112586+0000","last_became_peered":"2024-09-17T01:54:45.112586+0000","last_unstale":"2024-09-17T01:56:06.986400+0000","last_undegraded":"2024-09-17T01:56:06.986400+0000","last_fullsized":"2024-09-17T01:56:06.986400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:39.987123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79937,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"46'3","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.230656+0000","last_change":"2024-09-17T01:54:44.229207+0000","last_active":"2024-09-17T01:56:04.230656+0000","last_peered":"2024-09-17T01:56:04.230656+0000","last_clean":"2024-09-17T01:56:04.230656+0000","last_became_active":"2024-09-17T01:54:44.228395+0000","last_became_peered":"2024-09-17T01:54:44.228395+0000","last_unstale":"2024-09-17T01:56:04.230656+0000","last_undegraded":"2024-09-17T01:56:04.230656+0000","last_fullsized":"2024-09-17T01:56:04.230656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:48.994265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"46'35","reported_seq":99,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.974633+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:56:06.974633+0000","last_peered":"2024-09-17T01:56:06.974633+0000","last_clean":"2024-09-17T01:56:06.974633+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:56:06.974633+0000","last_undegraded":"2024-09-17T01:56:06.974633+0000","last_fullsized":"2024-09-17T01:56:06.974633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97586,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.238001+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:56:04.238001+0000","last_peered":"2024-09-17T01:56:04.238001+0000","last_clean":"2024-09-17T01:56:04.238001+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:56:04.238001+0000","last_undegraded":"2024-09-17T01:56:04.238001+0000","last_fullsized":"2024-09-17T01:56:04.238001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"46'43","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:06.929728+0000","last_change":"2024-09-17T01:54:45.113510+0000","last_active":"2024-09-17T01:56:06.929728+0000","last_peered":"2024-09-17T01:56:06.929728+0000","last_clean":"2024-09-17T01:56:06.929728+0000","last_became_active":"2024-09-17T01:54:45.112204+0000","last_became_peered":"2024-09-17T01:54:45.112204+0000","last_unstale":"2024-09-17T01:56:06.929728+0000","last_undegraded":"2024-09-17T01:56:06.929728+0000","last_fullsized":"2024-09-17T01:56:06.929728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115126,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-17T01:56:04.238366+0000","last_change":"2024-09-17T01:54:44.237357+0000","last_active":"2024-09-17T01:56:04.238366+0000","last_peered":"2024-09-17T01:56:04.238366+0000","last_clean":"2024-09-17T01:56:04.238366+0000","last_became_active":"2024-09-17T01:54:44.236613+0000","last_became_peered":"2024-09-17T01:54:44.236613+0000","last_unstale":"2024-09-17T01:56:04.238366+0000","last_undegraded":"2024-09-17T01:56:04.238366+0000","last_fullsized":"2024-09-17T01:56:04.238366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:08.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":18363235,"num_objects":2120,"num_object_clones":0,"num_object_copies":4240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2120,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2120,"num_write_kb":19163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":42565632,"data_stored":36725337,"data_compressed":1363110,"data_compressed_allocated":1818624,"data_compressed_original":5070848,"omap_allocated":0,"internal_metadata":0},"log_size":2121,"ondisk_log_size":2121,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4195774,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1179648,"data_stored":8391548,"data_compressed":621178,"data_compressed_allocated":1032192,"data_compressed_original":8298496,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738391,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":12300,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":12595200,"data_stored":14063838,"data_compressed":577364,"data_compressed_allocated":843776,"data_compressed_original":4845568,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738390,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51912,"kb_used_data":16568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319928,"statfs":{"total":96636764160,"available":96583606272,"internally_reserved":0,"allocated":16965632,"data_stored":18388931,"data_compressed":631195,"data_compressed_allocated":917504,"data_compressed_original":4972544,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45972,"kb_used_data":10624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325868,"statfs":{"total":96636764160,"available":96589688832,"internally_reserved":0,"allocated":10878976,"data_stored":8866992,"data_compressed":319082,"data_compressed_allocated":438272,"data_compressed_original":1400832,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":4195158,"data_compressed":310589,"data_compressed_allocated":516096,"data_compressed_original":4149248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":4195774,"data_compressed":310589,"data_compressed_allocated":516096,"data_compressed_original":4149248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11747328,"data_stored":9662501,"data_compressed":414256,"data_compressed_allocated":573440,"data_compressed_original":1728512,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17469440,"data_stored":15641489,"data_compressed":513295,"data_compressed_allocated":675840,"data_compressed_original":1773568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13348864,"data_stored":11421347,"data_compressed":435559,"data_compressed_allocated":569344,"data_compressed_original":1568768,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:56:09.737 INFO:tasks.thrashosds.thrasher:Setting 4.2d to [1, 0] 2024-09-17T01:56:09.737 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.2d', '1', '0'] 2024-09-17T01:56:09.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.2d 1 0 2024-09-17T01:56:09.756 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:09.758+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:09.824 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:09.825+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:09.854 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:09.854 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:09.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:09.925 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:09.926+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:10.010 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:10.010 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:10.026 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:10.026+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:10.026 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:10.127 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:10.130+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:10.129 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:10.157 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:10.158 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:10.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:10.228 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:10.230+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:10.246 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:56:10.251 INFO:teuthology.orchestra.run.smithi063.stderr:set 4.2d pg_upmap mapping to [1,0] 2024-09-17T01:56:10.283 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:10.284 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:10.306 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:10.306 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 95.692173978, 2024-09-17T01:56:10.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086258840000000003, 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617781+0000", 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617782+0000", 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3200000000000001e-06 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617881+0000", 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8466000000000002e-05 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617901+0000", 2024-09-17T01:56:10.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9760000000000001e-05 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617911+0000", 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0276e-05 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.617983+0000", 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2123e-05 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618011+0000", 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.853e-05 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626278+0000", 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082661999999999996 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626407+0000", 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129209 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.315 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4147.0:156 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'110, mlcod=10'105)", 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 95.691376770999995, 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007877406, 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:10.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618578+0000", 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618580+0000", 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7969999999999999e-06 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618592+0000", 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1579999999999999e-05 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618620+0000", 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8486000000000001e-05 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618637+0000", 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7180000000000002e-05 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618884+0000", 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024710200000000002 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.618924+0000", 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9779e-05 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626410+0000", 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074859829999999999 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:34.626456+0000", 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5498999999999999e-05 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.106730357999993, 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081349279999999996, 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.320 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203225+0000", 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203226+0000", 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7659999999999999e-06 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203234+0000", 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2799999999999998e-06 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203253+0000", 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9063999999999999e-05 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203267+0000", 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4543e-05 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204238+0000", 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097101299999999995 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204437+0000", 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019864500000000001 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204761+0000", 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000323648 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207465+0000", 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027040649999999999 2024-09-17T01:56:10.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210802+0000", 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033374239999999999 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210933+0000", 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130946 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211360+0000", 2024-09-17T01:56:10.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042653400000000001 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:31 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.106667291999997, 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076901180000000001, 2024-09-17T01:56:10.326 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203288+0000", 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203289+0000", 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2640000000000001e-06 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203295+0000", 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.533e-06 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203313+0000", 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7397e-05 2024-09-17T01:56:10.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203327+0000", 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3973e-05 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204491+0000", 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001163828 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204666+0000", 2024-09-17T01:56:10.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017508500000000001 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.204923+0000", 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025712800000000002 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.207546+0000", 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026234959999999999 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210748+0000", 2024-09-17T01:56:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032012719999999998 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210875+0000", 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000127749 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.210978+0000", 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010239299999999999 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.106541152999995, 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008148911, 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203414+0000", 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203415+0000", 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.424e-06 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203422+0000", 2024-09-17T01:56:10.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5629999999999997e-06 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203440+0000", 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8207e-05 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.203459+0000", 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9326000000000001e-05 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205404+0000", 2024-09-17T01:56:10.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001945085 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.205786+0000", 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038181400000000001 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.206039+0000", 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025270099999999998 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.208575+0000", 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025361099999999998 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211436+0000", 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002860872 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211511+0000", 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5329999999999999e-05 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:54:45.211563+0000", 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1479e-05 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:4 4.32 e45/17 4:4def72d4:::10000000003.00000000:head v 45'2, mlcod=0'0)", 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.015546456, 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.041759969000000001, 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294410+0000", 2024-09-17T01:56:10.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8300000000000001e-06 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306262+0000", 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011851788 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306295+0000", 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2799999999999998e-05 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306315+0000", 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0387e-05 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306443+0000", 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012723500000000001 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306476+0000", 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3101e-05 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.336054+0000", 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029578282000000001 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.336168+0000", 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114546 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:5 4.13 e45/17 4:cbe72331:::10000000003.00000002:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:10.341 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.9432707359999997, 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015729841000000001, 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366686+0000", 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3069999999999999e-06 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369873+0000", 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031876560000000001 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369905+0000", 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1911e-05 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369924+0000", 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8553e-05 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.370044+0000", 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012076199999999999 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.370075+0000", 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0406999999999999e-05 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382291+0000", 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012216296999999999 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382414+0000", 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122948 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:7 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~18007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.938528153, 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018697373, 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371429+0000", 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371526+0000", 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6809000000000001e-05 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371551+0000", 2024-09-17T01:56:10.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5230000000000001e-05 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371572+0000", 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786999999999999e-05 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371729+0000", 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157133 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371948+0000", 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021917900000000001 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372163+0000", 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021421400000000001 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.374525+0000", 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002362393 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389881+0000", 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015356274 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390010+0000", 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882200000000001 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390124+0000", 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114132 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:6 4.10 e45/17 4:09a4c37f:::10000000003.00000001:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:10.352 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.937162485, 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044460135999999997, 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:10.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372794+0000", 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8330000000000001e-06 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389586+0000", 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016791724000000001 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389615+0000", 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389633+0000", 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8057e-05 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389769+0000", 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013610599999999999 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389805+0000", 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5917000000000002e-05 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.417108+0000", 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027303549999999999 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.417253+0000", 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014416599999999999 2024-09-17T01:56:10.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:10.357 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.9342958210000001, 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014547855, 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 8 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.358 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375661+0000", 2024-09-17T01:56:10.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9970000000000001e-06 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375675+0000", 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3900000000000001e-05 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375704+0000", 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.87e-05 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375723+0000", 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9321e-05 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375844+0000", 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121212 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.376046+0000", 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020216599999999999 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.376245+0000", 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019880000000000001 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377667+0000", 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001421477 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390006+0000", 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012338816000000001 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390139+0000", 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133905 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390207+0000", 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7560999999999999e-05 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.363 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.9322013829999998, 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012619790000000001, 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10 2024-09-17T01:56:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377756+0000", 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0310000000000001e-06 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377770+0000", 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.454e-05 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377806+0000", 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6127000000000002e-05 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377825+0000", 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8967e-05 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377980+0000", 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015457200000000001 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378230+0000", 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025009400000000002 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378443+0000", 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021311 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380240+0000", 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017967580000000001 2024-09-17T01:56:10.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390133+0000", 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098933440000000001 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390257+0000", 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012403499999999999 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390373+0000", 2024-09-17T01:56:10.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116212 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.9311877339999999, 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011713062, 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.370 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 11 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378769+0000", 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4270000000000001e-06 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378781+0000", 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.205e-05 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378811+0000", 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0574000000000002e-05 2024-09-17T01:56:10.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378836+0000", 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4280000000000001e-05 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378967+0000", 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130965 2024-09-17T01:56:10.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379287+0000", 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032058199999999997 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379712+0000", 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042445699999999999 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382898+0000", 2024-09-17T01:56:10.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031866289999999999 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390217+0000", 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073188410000000004 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390369+0000", 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015169000000000001 2024-09-17T01:56:10.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390480+0000", 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111567 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.379940+0000", 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.9300153489999996, 2024-09-17T01:56:10.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010876076, 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 12 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379940+0000", 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379940+0000", 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379942+0000", 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-17T01:56:10.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379956+0000", 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4527e-05 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380003+0000", 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6653999999999998e-05 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380028+0000", 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4916999999999999e-05 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.381026+0000", 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099850200000000007 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.381270+0000", 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024338699999999999 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.381534+0000", 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026373800000000001 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.383395+0000", 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018610440000000001 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390579+0000", 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071842440000000002 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390718+0000", 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013895800000000001 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390816+0000", 2024-09-17T01:56:10.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7864999999999999e-05 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:163 4.33 4:ce199014:::1000000029c.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.579103+0000", 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.7308516990000005, 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085011270000000007, 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.383 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 163 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579103+0000", 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579103+0000", 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579105+0000", 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7999999999999999e-06 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579115+0000", 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6299999999999993e-06 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579134+0000", 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536999999999999e-05 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579152+0000", 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7767000000000001e-05 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579250+0000", 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8307999999999995e-05 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579461+0000", 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210903 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.579686+0000", 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022514400000000001 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.581226+0000", 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001540044 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.587455+0000", 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062284239999999998 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.587540+0000", 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5638999999999998e-05 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.587604+0000", 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3930999999999995e-05 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.389 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:174 4.3b 4:dc5ce3d4:::100000002a7.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.590348+0000", 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.7196065469999997, 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092061299999999999, 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 174 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590348+0000", 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590348+0000", 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590351+0000", 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1770000000000001e-06 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590361+0000", 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0467e-05 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590392+0000", 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1393000000000003e-05 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590407+0000", 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4781e-05 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590587+0000", 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017971900000000001 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590787+0000", 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020037599999999999 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.590991+0000", 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020331 2024-09-17T01:56:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.592553+0000", 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015620899999999999 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599339+0000", 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067858780000000004 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599439+0000", 2024-09-17T01:56:10.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010085399999999999 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599555+0000", 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115085 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:175 4.2e 4:76dcb3a2:::100000002a8.00000000:head [write 0~111] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.591415+0000", 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.7185395369999998, 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080746859999999993, 2024-09-17T01:56:10.395 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 175 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591415+0000", 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591415+0000", 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591422+0000", 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7259999999999996e-06 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591432+0000", 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0144e-05 2024-09-17T01:56:10.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591464+0000", 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1457000000000001e-05 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591479+0000", 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5224e-05 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591630+0000", 2024-09-17T01:56:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015143200000000001 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.591845+0000", 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021497000000000001 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.592041+0000", 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195179 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.593592+0000", 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015516709999999999 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599231+0000", 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056386789999999997 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599377+0000", 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146246 2024-09-17T01:56:10.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.599490+0000", 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112958 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:58 3.14 e46/16 3:2e2fa760:::200.00000001:head v 46'19, mlcod=46'17)", 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:06.446454+0000", 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8635007400000001, 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081000519999999999, 2024-09-17T01:56:10.401 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.446454+0000", 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.446454+0000", 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.446456+0000", 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1260000000000001e-06 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447556+0000", 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010998939999999999 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447586+0000", 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9456999999999999e-05 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447599+0000", 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3283e-05 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447720+0000", 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120742 2024-09-17T01:56:10.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.447771+0000", 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1397000000000003e-05 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.454448+0000", 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066773789999999998 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:06.454554+0000", 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010577399999999999 2024-09-17T01:56:10.405 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:61 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~829833 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.1480148570000002, 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01138317, 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161942+0000", 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.53e-06 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163509+0000", 2024-09-17T01:56:10.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015674090000000001 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163540+0000", 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1108000000000001e-05 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163564+0000", 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4179999999999999e-05 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163675+0000", 2024-09-17T01:56:10.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111074 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163928+0000", 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025244699999999999 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.164262+0000", 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333911 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.171195+0000", 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069333720000000001 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173178+0000", 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019829539999999999 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173263+0000", 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5235000000000006e-05 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173323+0000", 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.995e-05 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:07.481816+0000", 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.8281393239999999, 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010909623, 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2315 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.481816+0000", 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.481816+0000", 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.481818+0000", 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.482781+0000", 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096276499999999997 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.482814+0000", 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3574000000000001e-05 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.482838+0000", 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3966000000000001e-05 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.483025+0000", 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000187073 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.483237+0000", 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021168200000000001 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.483442+0000", 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020535700000000001 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.492037+0000", 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085948510000000006 2024-09-17T01:56:10.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.492542+0000", 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050452299999999999 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.492630+0000", 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8554000000000006e-05 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.492725+0000", 2024-09-17T01:56:10.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5035000000000001e-05 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 829833~1056288 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:07.961776+0000", 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.3481792399999999, 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011050506999999999, 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:10.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.961776+0000", 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.961776+0000", 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.961778+0000", 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2539999999999999e-06 2024-09-17T01:56:10.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963005+0000", 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012273010000000001 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963035+0000", 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963049+0000", 2024-09-17T01:56:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963181+0000", 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131669 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963317+0000", 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013630099999999999 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963561+0000", 2024-09-17T01:56:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024344300000000001 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.971144+0000", 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075834869999999999 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.972615+0000", 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001470751 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.972706+0000", 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1045000000000007e-05 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.972826+0000", 2024-09-17T01:56:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120232 2024-09-17T01:56:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:10.424 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:10.425 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:10.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:10.427 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:10.425+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:10.427 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:10.526 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:10.529+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:4622 4.25 4:a70dc028:::100000015c1.00000000:head [write 0~468 in=468b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:10.569499+0000", 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001466172, 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015072810000000001, 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.564 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4622 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569499+0000", 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569499+0000", 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569501+0000", 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8840000000000001e-06 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569511+0000", 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5130000000000002e-06 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569540+0000", 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9445999999999999e-05 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569554+0000", 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569626+0000", 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1230999999999996e-05 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569758+0000", 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013198600000000001 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:10.569885+0000", 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127558 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.568 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-17T01:56:10.569 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 1 2024-09-17T01:56:10.569 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:10.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:10.627 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:10.626+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:10.710 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:56:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:56:10.710 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:10.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:10.728 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:10.730+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:10.829 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:10.830+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:10.867 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:10.867 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:56:10.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:56:10.867 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:10.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.592518720000001, 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.868 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:56:10.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.873 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.592481133000007, 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:56:10.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:56:10.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.592329613999993, 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:10.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:56:10.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.592293295000005, 2024-09-17T01:56:10.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:56:10.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.421076943000003, 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017279767000000001, 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.891 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 137 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449212+0000", 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449213+0000", 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0130000000000001e-06 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449295+0000", 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1760000000000003e-05 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449307+0000", 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2496e-05 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449316+0000", 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0440000000000001e-06 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.458876+0000", 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095600119999999997 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459124+0000", 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024821799999999997 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.459484+0000", 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035948099999999998 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464107+0000", 2024-09-17T01:56:10.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046232840000000001 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466350+0000", 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022426030000000001 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466429+0000", 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8776000000000006e-05 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466492+0000", 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3079999999999999e-05 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.420957263999995, 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.897 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:10.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:56:10.902 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.420919994000002, 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.903 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:56:10.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.420857271000003, 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:56:10.914 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.420740374999994, 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.915 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:56:10.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:56:10.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.080838286000002, 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:56:10.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:56:10.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:56:10.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.080685484, 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:10.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:56:10.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:56:10.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.080463538999993, 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:56:10.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:56:10.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.080388076000006, 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:56:10.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:56:10.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.944 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.080305730000006, 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:56:10.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:56:10.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.080018945999996, 2024-09-17T01:56:10.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:56:10.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.079929348999997, 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.956 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:56:10.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.079816816999994, 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:56:10.962 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:56:10.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.079559852000003, 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.968 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:56:10.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:56:10.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.5821309770000003, 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.052680583000000003, 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288160+0000", 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6000000000000001e-06 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297452+0000", 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092915110000000006 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297495+0000", 2024-09-17T01:56:10.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3482999999999997e-05 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297514+0000", 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8998999999999999e-05 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297659+0000", 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014464999999999999 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297811+0000", 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015144799999999999 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.298065+0000", 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025416000000000002 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.328259+0000", 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030194163 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340638+0000", 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012378747000000001 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340727+0000", 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9318000000000001e-05 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340838+0000", 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011150399999999999 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.979 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.5034699949999997, 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020044474999999999, 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:10.980 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366822+0000", 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8499999999999998e-06 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369822+0000", 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030005909999999999 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369853+0000", 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0882e-05 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369869+0000", 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5325999999999999e-05 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370002+0000", 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133607 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370272+0000", 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026991199999999997 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370456+0000", 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000183535 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.382932+0000", 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012476500999999999 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386715+0000", 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037825549999999999 2024-09-17T01:56:10.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386796+0000", 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1396999999999993e-05 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386863+0000", 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7318999999999997e-05 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:10.985 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:10.987 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:10.990+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:10.987 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:11.088 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:11.090+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:11.130 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:11.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:11.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.130 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5081 4.2f 4:f6660bde:::100000017b8.00000000:head [write 0~1667 in=1667b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.130 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.134835+0000", 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.001341737, 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014057919999999999, 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5081 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134835+0000", 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134835+0000", 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134837+0000", 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7239999999999999e-06 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134845+0000", 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3829999999999992e-06 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134873+0000", 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7982000000000001e-05 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134885+0000", 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2097e-05 2024-09-17T01:56:11.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.134971+0000", 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5434999999999998e-05 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.135138+0000", 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016757299999999999 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.135269+0000", 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013026699999999999 2024-09-17T01:56:11.134 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.135 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.135 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.135 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.135 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:11.135 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 1 2024-09-17T01:56:11.135 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:11.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:11.189 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:11.189+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:11.269 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:11.269 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:11.269 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:11.269 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:11.269 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:11.285 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:11.291 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:11.294+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:11.391 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:11.390+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:11.421 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 86.215354632, 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084399939999999993, 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210310+0000", 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210311+0000", 2024-09-17T01:56:11.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6299999999999993e-07 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210317+0000", 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.117e-06 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210332+0000", 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.468e-05 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210340+0000", 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5900000000000008e-06 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211440+0000", 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010999269999999999 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211642+0000", 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020143900000000001 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.425 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211967+0000", 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032498100000000001 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213905+0000", 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001937851 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218594+0000", 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046890639999999997 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218682+0000", 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8689000000000004e-05 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218750+0000", 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7693000000000004e-05 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 86.215151054000003, 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0084998339999999995, 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210514+0000", 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6700000000000002e-07 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210533+0000", 2024-09-17T01:56:11.432 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8125999999999999e-05 2024-09-17T01:56:11.432 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.432 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.432 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.432 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210545+0000", 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.259e-05 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210553+0000", 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0199999999999994e-06 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212620+0000", 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0020673240000000002 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.433 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.212899+0000", 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000278745 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213197+0000", 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000298194 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214985+0000", 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0017873800000000001 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218865+0000", 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0038800089999999998 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218942+0000", 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7570000000000004e-05 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219013+0000", 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1008999999999997e-05 2024-09-17T01:56:11.435 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 86.215100304000003, 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079813079999999995, 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210564+0000", 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210565+0000", 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0359999999999999e-06 2024-09-17T01:56:11.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210579+0000", 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.397e-05 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210596+0000", 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6756999999999999e-05 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210604+0000", 2024-09-17T01:56:11.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210719+0000", 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115229 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210964+0000", 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024442099999999998 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211148+0000", 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018447599999999999 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213261+0000", 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021129199999999999 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218378+0000", 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0051174059999999997 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218481+0000", 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010293699999999999 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218546+0000", 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4165999999999995e-05 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.441 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 86.215039497999996, 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081236099999999999, 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210625+0000", 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210626+0000", 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210631+0000", 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3040000000000004e-06 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210649+0000", 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7972999999999999e-05 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210664+0000", 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4279e-05 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211624+0000", 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00096001699999999997 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.211862+0000", 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000238638 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.218749+0000", 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.006886316 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.445 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:29 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 86.214949564999998, 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085127699999999994, 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210715+0000", 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210716+0000", 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2929999999999999e-06 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210722+0000", 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9370000000000001e-06 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210741+0000", 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8513e-05 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.210755+0000", 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4056000000000001e-05 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.213978+0000", 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0032233819999999999 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.214159+0000", 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018066800000000001 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:54:45.219228+0000", 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050689209999999997 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:56:11.449 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 67.213925548000006, 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:56:11.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:56:11.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.0575118529999994, 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.052538046999999997, 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 6 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.456 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368155+0000", 2024-09-17T01:56:11.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7159999999999999e-06 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375086+0000", 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069303330000000003 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375126+0000", 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9854999999999997e-05 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375144+0000", 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8006e-05 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375282+0000", 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013803900000000001 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375504+0000", 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022231900000000001 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:11.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375711+0000", 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000207238 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408034+0000", 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032322367999999997 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420591+0000", 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012557166 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420644+0000", 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2859000000000003e-05 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420691+0000", 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7148000000000003e-05 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:57 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:11.461 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.2063882589999997, 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013009569, 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219278+0000", 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.894e-06 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219406+0000", 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012822199999999999 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219424+0000", 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7091e-05 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219433+0000", 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2299999999999997e-06 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219604+0000", 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017164599999999999 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219764+0000", 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015926499999999999 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.224310+0000", 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045462749999999998 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.229006+0000", 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004696263 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232019+0000", 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0030129380000000002 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232168+0000", 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014881200000000001 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232286+0000", 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117933 2024-09-17T01:56:11.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:62 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.2038755950000004, 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015833152, 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221792+0000", 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.61e-06 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222028+0000", 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000236295 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222057+0000", 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9246000000000001e-05 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222080+0000", 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2408999999999998e-05 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222197+0000", 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117106 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222331+0000", 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134342 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.228794+0000", 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0064630290000000003 2024-09-17T01:56:11.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.236744+0000", 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079497960000000003 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237468+0000", 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00072368699999999998 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237559+0000", 2024-09-17T01:56:11.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1583999999999996e-05 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237622+0000", 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3047999999999997e-05 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4434 4.21 4:841906fb:::100000014f3.00000000:head [write 0~2088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.334904+0000", 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.090760325, 2024-09-17T01:56:11.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085421460000000005, 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4434 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334904+0000", 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334904+0000", 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334906+0000", 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1440000000000001e-06 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334919+0000", 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2703e-05 2024-09-17T01:56:11.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334947+0000", 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7725e-05 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334966+0000", 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9089999999999998e-05 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.335090+0000", 2024-09-17T01:56:11.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012416 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.335352+0000", 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026236500000000003 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.335608+0000", 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025570600000000002 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.339050+0000", 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034418040000000001 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.343195+0000", 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004145307 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.343340+0000", 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000145072 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.343446+0000", 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010607000000000001 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4549 4.7 4:e1be17ce:::10000001570.00000000:head [write 0~1689] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.452756+0000", 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.97290885699999996, 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0077088399999999998, 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.478 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4549 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452756+0000", 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452756+0000", 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452758+0000", 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2170000000000001e-06 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452771+0000", 2024-09-17T01:56:11.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3149999999999999e-05 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452796+0000", 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5242e-05 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452820+0000", 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4002000000000002e-05 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.452957+0000", 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013655300000000001 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.453295+0000", 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000338177 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.453652+0000", 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000357289 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.455127+0000", 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014750500000000001 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.460148+0000", 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0050209069999999998 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.460310+0000", 2024-09-17T01:56:11.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161461 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.460465+0000", 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154792 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:71 3.b 3:d5c7a900:::200.00000003:head [write 1714465~2273320 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.94073564700000001, 2024-09-17T01:56:11.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019288186999999998, 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:11.485 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484931+0000", 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7430000000000001e-06 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489029+0000", 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040978919999999997 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489059+0000", 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0786e-05 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489074+0000", 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4603000000000001e-05 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489213+0000", 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139429 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489353+0000", 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979199999999999 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489551+0000", 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019731800000000001 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.503369+0000", 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013818833000000001 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504053+0000", 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00068402899999999995 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504146+0000", 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2138000000000005e-05 2024-09-17T01:56:11.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504217+0000", 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1624000000000004e-05 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4950 4.f 4:f05bdaa4:::10000001734.00000000:head [write 0~1535] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.978485+0000", 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.44717922399999999, 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0080822350000000001, 2024-09-17T01:56:11.490 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4950 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978485+0000", 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978485+0000", 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978487+0000", 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8729999999999999e-06 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978498+0000", 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.041e-05 2024-09-17T01:56:11.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978521+0000", 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3298999999999998e-05 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978534+0000", 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3383e-05 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978656+0000", 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012211000000000001 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.978897+0000", 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024053900000000001 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.979091+0000", 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000194291 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.980402+0000", 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001310454 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.986399+0000", 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.005997161 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.986506+0000", 2024-09-17T01:56:11.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107291 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.986568+0000", 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1424e-05 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4955 4.0 4:00f67c88:::10000001739.00000000:head [write 0~1718] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.984504+0000", 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.44116086700000001, 2024-09-17T01:56:11.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007552932, 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4955 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984504+0000", 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984504+0000", 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984506+0000", 2024-09-17T01:56:11.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984517+0000", 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1486e-05 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984549+0000", 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1729000000000001e-05 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984563+0000", 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4032999999999999e-05 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984695+0000", 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000131913 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.984915+0000", 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021999000000000001 2024-09-17T01:56:11.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.985116+0000", 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200514 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.986833+0000", 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001717529 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991810+0000", 2024-09-17T01:56:11.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0049769289999999997 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991953+0000", 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014306200000000001 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.992057+0000", 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000103557 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4961 4.26 4:65609dde:::1000000173f.00000000:head [write 0~1997] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.991061+0000", 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.43460404499999999, 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0083962240000000007, 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4961 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.503 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991061+0000", 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991061+0000", 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991063+0000", 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.193e-06 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991074+0000", 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.147e-05 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991106+0000", 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1296e-05 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991120+0000", 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4185999999999999e-05 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991290+0000", 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000170235 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991511+0000", 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022081999999999999 2024-09-17T01:56:11.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.991820+0000", 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030912700000000002 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.993348+0000", 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001528228 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.999207+0000", 2024-09-17T01:56:11.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0058592959999999999 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.999344+0000", 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013684600000000001 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.999457+0000", 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000112527 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.508 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4966 4.16 4:6a5623fa:::10000001744.00000000:head [write 0~1681] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.42833343800000001, 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095897110000000008, 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4966 2024-09-17T01:56:11.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997333+0000", 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9829999999999999e-06 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997342+0000", 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9740000000000008e-06 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997362+0000", 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0146e-05 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997373+0000", 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0783e-05 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997456+0000", 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.318e-05 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997689+0000", 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023306999999999999 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997876+0000", 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000186508 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.000413+0000", 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002537381 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006653+0000", 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062398439999999996 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006808+0000", 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154692 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006921+0000", 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011315 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.514 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5062 4.2f 4:f6a8aa0e:::100000017a5.00000000:head [write 0~1333] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.108349+0000", 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.31731576099999997, 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0076975689999999996, 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5062 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108349+0000", 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108349+0000", 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108351+0000", 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4099999999999998e-06 2024-09-17T01:56:11.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108363+0000", 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1483e-05 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108387+0000", 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4658999999999999e-05 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108401+0000", 2024-09-17T01:56:11.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.376e-05 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108498+0000", 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7065999999999995e-05 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108652+0000", 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015427799999999999 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:11.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.108785+0000", 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013212900000000001 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.110625+0000", 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001839998 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.115945+0000", 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0053203249999999999 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.116002+0000", 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6681000000000002e-05 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.116046+0000", 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.4780000000000002e-05 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5118 4.11 4:89fef040:::100000017dd.00000000:head [write 0~1722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.520 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.187515+0000", 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.238149999, 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0081861940000000008, 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5118 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187515+0000", 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187515+0000", 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187516+0000", 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.147e-06 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187522+0000", 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.2430000000000002e-06 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187538+0000", 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5772000000000001e-05 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187549+0000", 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1005999999999999e-05 2024-09-17T01:56:11.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187597+0000", 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8578000000000001e-05 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187688+0000", 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.0989999999999994e-05 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.187780+0000", 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1681999999999994e-05 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.188365+0000", 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00058467600000000001 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.195642+0000", 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072772219999999999 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.195676+0000", 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3691e-05 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.195701+0000", 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5187000000000001e-05 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5120 4.b 4:d0c4bbd3:::100000017df.00000000:head [write 0~1333] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:11.526 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.190621+0000", 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.23504323199999999, 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0088958790000000006, 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5120 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190621+0000", 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190621+0000", 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190622+0000", 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.071e-06 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190628+0000", 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5790000000000003e-06 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190644+0000", 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5650000000000001e-05 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190653+0000", 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8370000000000003e-06 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190727+0000", 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4381999999999994e-05 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190894+0000", 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016745400000000001 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.191073+0000", 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017895000000000001 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.191901+0000", 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00082762999999999999 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.199458+0000", 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007557144 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.199492+0000", 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3982000000000001e-05 2024-09-17T01:56:11.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.199517+0000", 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5199999999999999e-05 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:74 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.192994895, 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018559200000000001, 2024-09-17T01:56:11.532 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232672+0000", 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0729999999999999e-06 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232768+0000", 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5841000000000006e-05 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232795+0000", 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7362e-05 2024-09-17T01:56:11.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232809+0000", 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3959e-05 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232883+0000", 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4086999999999997e-05 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.233004+0000", 2024-09-17T01:56:11.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120629 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.239248+0000", 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062448319999999996 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.244891+0000", 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056420919999999996 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251167+0000", 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062759410000000002 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251201+0000", 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4143999999999997e-05 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251229+0000", 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8240000000000001e-05 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.537 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:11.538 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:11.538 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:11.539 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:11.540 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:11.542+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:11.640 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:11.642+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:11.677 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:5427 4.13 e49/17 4:ca011d63:::10000001912.00000000:head v 49'85, mlcod=49'83)", 2024-09-17T01:56:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:11.679698+0000", 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00080758299999999996, 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082653999999999996, 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679698+0000", 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679698+0000", 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679699+0000", 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1999999999999998e-07 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679710+0000", 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1136e-05 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679729+0000", 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8936999999999998e-05 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679745+0000", 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5627000000000001e-05 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679862+0000", 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011696099999999999 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.679894+0000", 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2456999999999998e-05 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:5428 4.3 4:c178d270:::10000001913.00000000:head [write 0~1722 in=1722b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:11.680344+0000", 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00016217, 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023298599999999999, 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5428 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680344+0000", 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680344+0000", 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680345+0000", 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7999999999999999e-06 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680355+0000", 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6500000000000008e-06 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680376+0000", 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0523999999999999e-05 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680393+0000", 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7393000000000001e-05 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.680528+0000", 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013485799999999999 2024-09-17T01:56:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 2 2024-09-17T01:56:11.685 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:11.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:11.741 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:11.742+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:11.823 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:11.823 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:11.823 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:11.823 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:11.823 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:11.839 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:11.842 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:11.842+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:11.942 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:11.942+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:4 4.32 e45/17 4:4def72d4:::10000000003.00000000:head v 45'2, mlcod=0'0)", 2024-09-17T01:56:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.6710035120000004, 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.041759969000000001, 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294408+0000", 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.294410+0000", 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8300000000000001e-06 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306262+0000", 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011851788 2024-09-17T01:56:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306295+0000", 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2799999999999998e-05 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306315+0000", 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0387e-05 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306443+0000", 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012723500000000001 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.306476+0000", 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3101e-05 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.336054+0000", 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029578282000000001 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.336168+0000", 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114546 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:5 4.13 e45/17 4:cbe72331:::10000000003.00000002:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.598727792, 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015729841000000001, 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366684+0000", 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.366686+0000", 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3069999999999999e-06 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369873+0000", 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031876560000000001 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369905+0000", 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1911e-05 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.369924+0000", 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8553e-05 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.370044+0000", 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012076199999999999 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.370075+0000", 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0406999999999999e-05 2024-09-17T01:56:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382291+0000", 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012216296999999999 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382414+0000", 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122948 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:7 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~18007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5939852089999995, 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018697373, 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371427+0000", 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371429+0000", 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371526+0000", 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6809000000000001e-05 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371551+0000", 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5230000000000001e-05 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371572+0000", 2024-09-17T01:56:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786999999999999e-05 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371729+0000", 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157133 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.371948+0000", 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021917900000000001 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372163+0000", 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021421400000000001 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.374525+0000", 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002362393 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389881+0000", 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015356274 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390010+0000", 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882200000000001 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390124+0000", 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114132 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.981 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:6 4.10 e45/17 4:09a4c37f:::10000000003.00000001:head v 45'1, mlcod=0'0)", 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5926195409999995, 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044460135999999997, 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372792+0000", 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.372794+0000", 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8330000000000001e-06 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389586+0000", 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016791724000000001 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389615+0000", 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8782999999999999e-05 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389633+0000", 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8057e-05 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389769+0000", 2024-09-17T01:56:11.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013610599999999999 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.389805+0000", 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5917000000000002e-05 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.417108+0000", 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027303549999999999 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:11.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.417253+0000", 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014416599999999999 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:8 4.3b 4:deccbd37:::100000001fe.00000000:head [write 0~2428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5897528770000005, 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014547855, 2024-09-17T01:56:11.986 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 8 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375659+0000", 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375661+0000", 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9970000000000001e-06 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375675+0000", 2024-09-17T01:56:11.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3900000000000001e-05 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375704+0000", 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.87e-05 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375723+0000", 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9321e-05 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.375844+0000", 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121212 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.376046+0000", 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020216599999999999 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.376245+0000", 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019880000000000001 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377667+0000", 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001421477 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390006+0000", 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012338816000000001 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390139+0000", 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133905 2024-09-17T01:56:11.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390207+0000", 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7560999999999999e-05 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5876584390000001, 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012619790000000001, 2024-09-17T01:56:11.992 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377754+0000", 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377756+0000", 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0310000000000001e-06 2024-09-17T01:56:11.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377770+0000", 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.454e-05 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377806+0000", 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6127000000000002e-05 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:11.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377825+0000", 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8967e-05 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.377980+0000", 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015457200000000001 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378230+0000", 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025009400000000002 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378443+0000", 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021311 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.380240+0000", 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0017967580000000001 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390133+0000", 2024-09-17T01:56:11.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098933440000000001 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390257+0000", 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012403499999999999 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390373+0000", 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116212 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:11.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5866447899999994, 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011713062, 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:11.999 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 11 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378767+0000", 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378769+0000", 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4270000000000001e-06 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378781+0000", 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.205e-05 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378811+0000", 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0574000000000002e-05 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378836+0000", 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4280000000000001e-05 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.378967+0000", 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130965 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379287+0000", 2024-09-17T01:56:12.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032058199999999997 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.379712+0000", 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042445699999999999 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.382898+0000", 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031866289999999999 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390217+0000", 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073188410000000004 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390369+0000", 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015169000000000001 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:03.390480+0000", 2024-09-17T01:56:12.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111567 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:61 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~829833 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8034719130000001, 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01138317, 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161940+0000", 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.161942+0000", 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.53e-06 2024-09-17T01:56:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163509+0000", 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015674090000000001 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163540+0000", 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1108000000000001e-05 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163564+0000", 2024-09-17T01:56:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4179999999999999e-05 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163675+0000", 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111074 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.163928+0000", 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025244699999999999 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.164262+0000", 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333911 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.171195+0000", 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069333720000000001 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173178+0000", 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019829539999999999 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173263+0000", 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5235000000000006e-05 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.173323+0000", 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.995e-05 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 829833~1056288 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:07.961776+0000", 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.0036362959999998, 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011050506999999999, 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.961776+0000", 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.961776+0000", 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.961778+0000", 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2539999999999999e-06 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963005+0000", 2024-09-17T01:56:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012273010000000001 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963035+0000", 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963049+0000", 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4066999999999999e-05 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963181+0000", 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131669 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963317+0000", 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013630099999999999 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.963561+0000", 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024344300000000001 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.971144+0000", 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075834869999999999 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.972615+0000", 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001470751 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.972706+0000", 2024-09-17T01:56:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1045000000000007e-05 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:07.972826+0000", 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120232 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.591613934, 2024-09-17T01:56:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4600 4.2d 4:b73d992a:::100000015aa.00000000:head [write 0~6267] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.4211712429999999, 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.728534024, 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4600 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544250+0000", 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6600000000000007e-06 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544274+0000", 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4006999999999999e-05 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544303+0000", 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8637e-05 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544322+0000", 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9357000000000001e-05 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544546+0000", 2024-09-17T01:56:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223802 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544564+0000", 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8199999999999999e-05 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268542+0000", 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.723977961 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268794+0000", 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025118900000000002 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.269025+0000", 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023119199999999999 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272537+0000", 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035122629999999998 2024-09-17T01:56:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272634+0000", 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7201000000000007e-05 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272721+0000", 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6567e-05 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272775+0000", 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3987999999999999e-05 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4672 4.2d 4:b407c00e:::100000015f9.00000000:head [write 0~1753] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.3442597860000001, 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.65541383900000005, 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4672 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621154+0000", 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.607e-06 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621180+0000", 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5882999999999999e-05 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621204+0000", 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4573999999999999e-05 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621217+0000", 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2456999999999999e-05 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621326+0000", 2024-09-17T01:56:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109175 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621344+0000", 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.789e-05 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270061+0000", 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.64871766600000003 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270254+0000", 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000192392 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270517+0000", 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026355699999999998 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276295+0000", 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005777412 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276427+0000", 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131958 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276501+0000", 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4051e-05 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276566+0000", 2024-09-17T01:56:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5216999999999996e-05 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4714 4.2d 4:b437e665:::10000001628.00000000:head [write 0~1699] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.2899484779999999, 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.60310710899999997, 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4714 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675466+0000", 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675478+0000", 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1956999999999999e-05 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675499+0000", 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1761000000000001e-05 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675518+0000", 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8810000000000001e-05 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675656+0000", 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013773799999999999 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675672+0000", 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6079999999999999e-05 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272928+0000", 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.59725582399999999 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273261+0000", 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033340099999999999 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273625+0000", 2024-09-17T01:56:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036354300000000003 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276407+0000", 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027817190000000002 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278409+0000", 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020029039999999998 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278502+0000", 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2263999999999996e-05 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278571+0000", 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8918000000000007e-05 2024-09-17T01:56:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4788 4.2d 4:b4cc316c:::1000000167e.00000000:head [write 0~2170] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1926522399999999, 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50757323899999995, 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4788 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772762+0000", 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772774+0000", 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2086000000000001e-05 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772802+0000", 2024-09-17T01:56:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8197000000000001e-05 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772821+0000", 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8301e-05 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773010+0000", 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189588 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773042+0000", 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1643999999999997e-05 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274751+0000", 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50170971099999995 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274979+0000", 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022755299999999999 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.275278+0000", 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029924999999999998 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278717+0000", 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003438998 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280135+0000", 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001417349 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280219+0000", 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4036999999999995e-05 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280333+0000", 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011435800000000001 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4798 4.2d 4:b79c5810:::10000001688.00000000:head [write 0~6996] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1808513789999999, 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49795705400000001, 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4798 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784562+0000", 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.59e-06 2024-09-17T01:56:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784584+0000", 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1997999999999998e-05 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784604+0000", 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9383000000000001e-05 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784618+0000", 2024-09-17T01:56:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4250000000000001e-05 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784740+0000", 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012229400000000001 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784756+0000", 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5741000000000001e-05 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276635+0000", 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49187889699999998 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276961+0000", 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032572999999999999 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277323+0000", 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036245400000000001 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282372+0000", 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050488490000000002 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282393+0000", 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-17T01:56:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282463+0000", 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9694000000000001e-05 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282518+0000", 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5090999999999998e-05 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4799 4.2d 4:b4576620:::10000001689.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1795912390000001, 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49814391800000002, 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4799 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785823+0000", 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2069999999999998e-06 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785834+0000", 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0864e-05 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785865+0000", 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1513000000000001e-05 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785880+0000", 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4966999999999999e-05 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785988+0000", 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107394 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.786003+0000", 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5554e-05 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278859+0000", 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49285563100000002 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279204+0000", 2024-09-17T01:56:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034552600000000003 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279412+0000", 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020742199999999999 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282607+0000", 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031956229999999999 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283821+0000", 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012134260000000001 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283902+0000", 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0851000000000002e-05 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283965+0000", 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2940000000000004e-05 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4916 4.2d 4:b65c07c8:::1000000170f.00000000:head [write 0~2630] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.033720263, 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.354345823, 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4916 2024-09-17T01:56:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931694+0000", 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.807e-06 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931703+0000", 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8530000000000004e-06 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931721+0000", 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7997000000000001e-05 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931734+0000", 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2286999999999999e-05 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931828+0000", 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4470999999999997e-05 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931844+0000", 2024-09-17T01:56:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5424e-05 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280474+0000", 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34863022399999999 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280767+0000", 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029277300000000002 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.281100+0000", 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333374 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285614+0000", 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004514176 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285870+0000", 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025610299999999998 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285966+0000", 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5474000000000001e-05 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286038+0000", 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1860000000000007e-05 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4923 4.2d 4:b7aaf913:::10000001717.00000000:head [write 0~1965] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.0237872139999999, 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34469107700000001, 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4923 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941627+0000", 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7269999999999999e-06 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941636+0000", 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3959999999999995e-06 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941658+0000", 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2198e-05 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941670+0000", 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2353e-05 2024-09-17T01:56:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941792+0000", 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012115799999999999 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941809+0000", 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282679+0000", 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34086941199999998 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282852+0000", 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000173492 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283094+0000", 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024125899999999999 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285850+0000", 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002755904 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286185+0000", 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033567800000000001 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286249+0000", 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3847e-05 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286316+0000", 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6829999999999995e-05 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4929 4.2d 4:b5acf001:::1000000171e.00000000:head [write 0~1676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.0156759769999999, 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33680069299999998, 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4929 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949738+0000", 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999998e-06 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949791+0000", 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2660000000000001e-05 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949822+0000", 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853999999999997e-05 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949841+0000", 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8994000000000001e-05 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950037+0000", 2024-09-17T01:56:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019598799999999999 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950068+0000", 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0644e-05 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284073+0000", 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33400524700000001 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284415+0000", 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034212100000000003 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284770+0000", 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035503999999999999 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286401+0000", 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00163072 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286418+0000", 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6293000000000001e-05 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286482+0000", 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4734999999999996e-05 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286537+0000", 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4477e-05 2024-09-17T01:56:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:5174 4.1d 4:b98e09c9:::10000001815.00000000:head [write 0~2441] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:11.277027+0000", 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.68838459500000004, 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014157177999999999, 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5174 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277027+0000", 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277027+0000", 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277029+0000", 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.793e-06 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277044+0000", 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.489e-05 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277067+0000", 2024-09-17T01:56:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3079999999999999e-05 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277081+0000", 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4147e-05 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285763+0000", 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086813930000000008 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286220+0000", 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045715099999999999 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286466+0000", 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024571 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.288087+0000", 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001621326 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.291015+0000", 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002928277 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.291101+0000", 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6256999999999998e-05 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.291185+0000", 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3153999999999997e-05 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:12.093 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:12.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:12.095 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:12.094+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:12.195 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:12.198+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:12.236 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:12.236 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:56:12.236 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:12.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:12.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:56:12.297 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:12.297+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:12.397 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:12.398+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:12.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:12.428 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:56:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-17T01:56:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-17T01:56:12.429 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:12.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:12.498 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:12.501+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:12.587 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:12.599 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:12.598+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:12.613 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:12.613 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:12.617 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:56:12.617 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.344504284999999, 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018026397, 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277770+0000", 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277771+0000", 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.02e-06 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277778+0000", 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277788+0000", 2024-09-17T01:56:12.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6099999999999995e-06 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277796+0000", 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5699999999999993e-06 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.290883+0000", 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013086518 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291004+0000", 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012100900000000001 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291254+0000", 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025012400000000001 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294712+0000", 2024-09-17T01:56:12.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034580269999999998 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295650+0000", 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093817599999999998 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295733+0000", 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3063000000000001e-05 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295797+0000", 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3202999999999998e-05 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.344466698000005, 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018273134, 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.625 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 115 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277808+0000", 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277809+0000", 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3300000000000001e-07 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277918+0000", 2024-09-17T01:56:12.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-17T01:56:12.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277934+0000", 2024-09-17T01:56:12.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5933000000000001e-05 2024-09-17T01:56:12.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277943+0000", 2024-09-17T01:56:12.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3270000000000001e-06 2024-09-17T01:56:12.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291856+0000", 2024-09-17T01:56:12.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013913045000000001 2024-09-17T01:56:12.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.291975+0000", 2024-09-17T01:56:12.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.292168+0000", 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019276100000000001 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295815+0000", 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036468920000000001 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295933+0000", 2024-09-17T01:56:12.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117873 2024-09-17T01:56:12.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296016+0000", 2024-09-17T01:56:12.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3035999999999996e-05 2024-09-17T01:56:12.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296081+0000", 2024-09-17T01:56:12.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5269000000000001e-05 2024-09-17T01:56:12.635 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.635 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.636 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.636 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:12.636 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.344315179000006, 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018585892, 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.637 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277959+0000", 2024-09-17T01:56:12.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277960+0000", 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4e-07 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277966+0000", 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5459999999999999e-06 2024-09-17T01:56:12.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277977+0000", 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1673e-05 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277984+0000", 2024-09-17T01:56:12.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293503+0000", 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015518482 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293733+0000", 2024-09-17T01:56:12.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022988500000000001 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.293946+0000", 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021311499999999999 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295826+0000", 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001880276 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296418+0000", 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059147900000000001 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296492+0000", 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4022000000000004e-05 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296545+0000", 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3550000000000001e-05 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.344278860000003, 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018967547000000001, 2024-09-17T01:56:12.645 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 117 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.277996+0000", 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5300000000000003e-07 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278003+0000", 2024-09-17T01:56:12.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6370000000000002e-06 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278015+0000", 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.239e-05 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.278045+0000", 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0049999999999999e-05 2024-09-17T01:56:12.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294803+0000", 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016757836000000002 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.294929+0000", 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012608300000000001 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.295122+0000", 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000192781 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296584+0000", 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001462159 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296820+0000", 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023539899999999999 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296913+0000", 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3442000000000004e-05 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.296963+0000", 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0016999999999999e-05 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.652 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.172942828999993, 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017340843000000002, 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449332+0000", 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5300000000000003e-07 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449338+0000", 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7100000000000004e-06 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449348+0000", 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8439999999999993e-06 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449357+0000", 2024-09-17T01:56:12.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4730000000000006e-06 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.460879+0000", 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011521744 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461008+0000", 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128529 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.461215+0000", 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020750900000000001 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466271+0000", 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050556400000000001 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466558+0000", 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000286898 2024-09-17T01:56:12.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466625+0000", 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7306999999999998e-05 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466672+0000", 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7336000000000002e-05 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.172905559, 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017515135000000001, 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 139 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449369+0000", 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449370+0000", 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1999999999999999e-07 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449375+0000", 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1830000000000002e-06 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449387+0000", 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2717e-05 2024-09-17T01:56:12.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449395+0000", 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0570000000000004e-06 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462558+0000", 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013163263999999999 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.462775+0000", 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021730600000000001 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.463099+0000", 2024-09-17T01:56:12.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032401400000000002 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466752+0000", 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036528379999999998 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466770+0000", 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8465999999999999e-05 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466834+0000", 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3932999999999999e-05 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466884+0000", 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9636999999999999e-05 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:12.667 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.172842836000001, 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.02017039, 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 140 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449432+0000", 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8000000000000005e-07 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449514+0000", 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1959000000000006e-05 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449527+0000", 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2274e-05 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449535+0000", 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0229999999999992e-06 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464201+0000", 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014666235999999999 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464336+0000", 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134766 2024-09-17T01:56:12.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.464526+0000", 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019080200000000001 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467891+0000", 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003364087 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469482+0000", 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001591051 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469551+0000", 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9163000000000002e-05 2024-09-17T01:56:12.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469602+0000", 2024-09-17T01:56:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1248999999999997e-05 2024-09-17T01:56:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.172725940000007, 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020467094000000002, 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 141 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449548+0000", 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449550+0000", 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0300000000000001e-06 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449555+0000", 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8900000000000004e-06 2024-09-17T01:56:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449565+0000", 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6190000000000006e-06 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.449572+0000", 2024-09-17T01:56:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9500000000000004e-06 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.466982+0000", 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017409593000000001 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467123+0000", 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171499999999999 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.467317+0000", 2024-09-17T01:56:12.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390799999999999 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.468736+0000", 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014190229999999999 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469903+0000", 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011662809999999999 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.469969+0000", 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6629000000000002e-05 2024-09-17T01:56:12.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.470016+0000", 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6455999999999997e-05 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.685 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:181 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.685 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:12.685 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.832823851000001, 2024-09-17T01:56:12.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018726316, 2024-09-17T01:56:12.685 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 181 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789451+0000", 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789452+0000", 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3170000000000001e-06 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789462+0000", 2024-09-17T01:56:12.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7829999999999993e-06 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789480+0000", 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8773000000000001e-05 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789495+0000", 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4497e-05 2024-09-17T01:56:12.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798268+0000", 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087733689999999996 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798405+0000", 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136506 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.798633+0000", 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022803799999999999 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806580+0000", 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079476219999999997 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808039+0000", 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001458439 2024-09-17T01:56:12.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808116+0000", 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7021999999999995e-05 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808177+0000", 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0949999999999998e-05 2024-09-17T01:56:12.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:182 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.832671048999998, 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018896720999999998, 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 182 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789603+0000", 2024-09-17T01:56:12.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789605+0000", 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.934e-06 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789755+0000", 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014921199999999999 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789777+0000", 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2113e-05 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789794+0000", 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7142999999999998e-05 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799290+0000", 2024-09-17T01:56:12.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009496127 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799410+0000", 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120136 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.799591+0000", 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018134499999999999 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806588+0000", 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069967299999999996 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808308+0000", 2024-09-17T01:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001720107 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808397+0000", 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808500+0000", 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010316500000000001 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:183 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.832449104000005, 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018924384999999998, 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183 2024-09-17T01:56:12.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789825+0000", 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789827+0000", 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7770000000000001e-06 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789838+0000", 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0547000000000001e-05 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789857+0000", 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9619999999999998e-05 2024-09-17T01:56:12.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789877+0000", 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9936e-05 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800682+0000", 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010804385999999999 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800795+0000", 2024-09-17T01:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112916 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.800989+0000", 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194382 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808520+0000", 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075307619999999999 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808585+0000", 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5500000000000006e-05 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808659+0000", 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3663000000000003e-05 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808750+0000", 2024-09-17T01:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0896000000000005e-05 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.832373641000004, 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019206402000000001, 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 184 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789901+0000", 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789902+0000", 2024-09-17T01:56:12.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.223e-06 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789912+0000", 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7100000000000002e-06 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789930+0000", 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8649999999999999e-05 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789957+0000", 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6817000000000001e-05 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802076+0000", 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012119066 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802187+0000", 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110703 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.802368+0000", 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018098100000000001 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808527+0000", 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061590869999999997 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808891+0000", 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036405999999999998 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808996+0000", 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105356 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809107+0000", 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011074900000000001 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.832291295000005, 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020385952999999998, 2024-09-17T01:56:12.712 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 185 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789983+0000", 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.789985+0000", 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.407e-06 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790154+0000", 2024-09-17T01:56:12.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169075 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790215+0000", 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1136000000000006e-05 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790234+0000", 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8960000000000001e-05 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803141+0000", 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012907474 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803251+0000", 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109783 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.803427+0000", 2024-09-17T01:56:12.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175608 2024-09-17T01:56:12.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808768+0000", 2024-09-17T01:56:12.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005341859 2024-09-17T01:56:12.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810226+0000", 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014573990000000001 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810310+0000", 2024-09-17T01:56:12.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4552e-05 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810369+0000", 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8699999999999997e-05 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.832004510999994, 2024-09-17T01:56:12.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020321097, 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:12.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790270+0000", 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790272+0000", 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790283+0000", 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1253999999999999e-05 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790308+0000", 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5508999999999999e-05 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790330+0000", 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1263999999999998e-05 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804578+0000", 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014248194 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804700+0000", 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122232 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.804893+0000", 2024-09-17T01:56:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019289200000000001 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.808779+0000", 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038855560000000001 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810435+0000", 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016567769999999999 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810505+0000", 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9746999999999995e-05 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810591+0000", 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5982000000000004e-05 2024-09-17T01:56:12.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.831914913999995, 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020777126, 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 187 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790360+0000", 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790361+0000", 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790370+0000", 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3899999999999999e-06 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790408+0000", 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7453000000000002e-05 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790442+0000", 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805639+0000", 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015197240000000001 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805761+0000", 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122069 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.805958+0000", 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019656200000000001 2024-09-17T01:56:12.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.810679+0000", 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047205759999999998 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811005+0000", 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032607099999999999 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811077+0000", 2024-09-17T01:56:12.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1896000000000004e-05 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811137+0000", 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0053000000000003e-05 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:12.732 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.831802382000006, 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021648589999999999, 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 188 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:12.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790472+0000", 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790473+0000", 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790603+0000", 2024-09-17T01:56:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012931299999999999 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790628+0000", 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4830000000000001e-05 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790649+0000", 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1066000000000001e-05 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806672+0000", 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016023336999999999 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806797+0000", 2024-09-17T01:56:12.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542900000000001 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.806996+0000", 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199018 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811148+0000", 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515780000000004 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.811918+0000", 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00077044799999999997 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812005+0000", 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6265000000000002e-05 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.812121+0000", 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115963 2024-09-17T01:56:12.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4147.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:12.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.831545417000001, 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023542441000000001, 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4147", 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.63:0/376518805", 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 189 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790729+0000", 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790731+0000", 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.733e-06 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790741+0000", 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.058e-05 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790764+0000", 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.298e-05 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.790779+0000", 2024-09-17T01:56:12.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4843e-05 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809189+0000", 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018409852000000001 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809321+0000", 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013248900000000001 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.809515+0000", 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019390499999999999 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.813627+0000", 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041119579999999998 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814123+0000", 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049531300000000005 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814211+0000", 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7918999999999996e-05 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:54:34.814271+0000", 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0869000000000003e-05 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.745 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3341165420000003, 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.052680583000000003, 2024-09-17T01:56:12.746 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288158+0000", 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.288160+0000", 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6000000000000001e-06 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297452+0000", 2024-09-17T01:56:12.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092915110000000006 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297495+0000", 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3482999999999997e-05 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297514+0000", 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8998999999999999e-05 2024-09-17T01:56:12.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297659+0000", 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014464999999999999 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.297811+0000", 2024-09-17T01:56:12.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015144799999999999 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.298065+0000", 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025416000000000002 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.328259+0000", 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030194163 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340638+0000", 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012378747000000001 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340727+0000", 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9318000000000001e-05 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.340838+0000", 2024-09-17T01:56:12.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011150399999999999 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4468.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.2554555599999997, 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020044474999999999, 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-17T01:56:12.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4468", 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366819+0000", 2024-09-17T01:56:12.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.366822+0000", 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8499999999999998e-06 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369822+0000", 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030005909999999999 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369853+0000", 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0882e-05 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.369869+0000", 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5325999999999999e-05 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370002+0000", 2024-09-17T01:56:12.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133607 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370272+0000", 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026991199999999997 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.370456+0000", 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000183535 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.382932+0000", 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012476500999999999 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386715+0000", 2024-09-17T01:56:12.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037825549999999999 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386796+0000", 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1396999999999993e-05 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:03.386863+0000", 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7318999999999997e-05 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:75 3.1f e49/16 3:f83d65d8:::200.00000004:head v 49'5, mlcod=18'3)", 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-17T01:56:11.853859+0000", 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.76841558200000004, 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019995485, 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-17T01:56:12.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-17T01:56:12.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.853859+0000", 2024-09-17T01:56:12.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.853859+0000", 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.853861+0000", 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2060000000000001e-06 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.858095+0000", 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042339939999999996 2024-09-17T01:56:12.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.858128+0000", 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2656e-05 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.858142+0000", 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3823e-05 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.858267+0000", 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012524699999999999 2024-09-17T01:56:12.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.858301+0000", 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4598999999999999e-05 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.873758+0000", 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015456368999999999 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-17T01:56:12.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-17T01:56:11.873854+0000", 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6590999999999997e-05 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-17T01:56:12.765 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:56:12.766 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:12.768 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:12.770+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:12.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:12.769 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:12.868 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:12.870+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:12.906 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:12.907 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:12.923 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:12.968 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:12.969+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:13.052 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:13.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:13.069 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:13.070+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:13.171 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:13.170+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:13.192 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:13.192 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:13.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:13.263 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:56:13.271 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:13.273+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:13.350 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:13.350 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:13.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:13.372 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:13.374+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:13.473 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:13.473+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:13.533 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:13.533 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:13.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:13.574 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:13.574+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:13.675 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:13.678+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:13.723 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:13.723 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:13.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:56:13.775 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:13.774+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:13.876 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:13.877 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:13.877 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:13.878+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:13.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T01:56:13.978 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:13.978+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:14.061 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:14.061 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:14.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T01:56:14.079 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:14.078+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:14.180 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:14.182+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:14.208 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:14.208 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:14.223 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:14.280 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:14.282+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:14.361 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:14.361 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:14.375 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:14.381 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:14.381+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:14.482 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:14.485+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:14.497 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:14.497 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:14.512 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:14.584 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:14.586+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:14.631 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:14.631 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:14.646 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:14.685 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:14.686+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:14.770 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:14.781 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:14.782 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:14.785 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:14.785+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:14.796 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:14.886 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:14.890+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:14.944 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:14.945 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:14.968 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:14.968 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:14.972 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:14.972 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:14.972 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:14.987 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:14.988 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:56:14.990+0000 7fd0f160a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22997) UID: 0 2024-09-17T01:56:14.990 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:14.990 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:15.089 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:15.090+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:15.123 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7476422520000003, 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.125 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:15.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.126 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:15.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:15.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:15.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:15.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:15.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:15.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:15.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:15.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:15.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:15.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:15.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.137 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4600 4.2d 4:b73d992a:::100000015aa.00000000:head [write 0~6267] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.5771995610000005, 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.728534024, 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4600 2024-09-17T01:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544250+0000", 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6600000000000007e-06 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544274+0000", 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4006999999999999e-05 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544303+0000", 2024-09-17T01:56:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8637e-05 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544322+0000", 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9357000000000001e-05 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544546+0000", 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223802 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544564+0000", 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8199999999999999e-05 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268542+0000", 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.723977961 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268794+0000", 2024-09-17T01:56:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025118900000000002 2024-09-17T01:56:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.269025+0000", 2024-09-17T01:56:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023119199999999999 2024-09-17T01:56:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272537+0000", 2024-09-17T01:56:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035122629999999998 2024-09-17T01:56:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272634+0000", 2024-09-17T01:56:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7201000000000007e-05 2024-09-17T01:56:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272721+0000", 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6567e-05 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272775+0000", 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3987999999999999e-05 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4672 4.2d 4:b407c00e:::100000015f9.00000000:head [write 0~1753] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.500288104, 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.65541383900000005, 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4672 2024-09-17T01:56:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621154+0000", 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.607e-06 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621180+0000", 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5882999999999999e-05 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621204+0000", 2024-09-17T01:56:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4573999999999999e-05 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621217+0000", 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2456999999999999e-05 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621326+0000", 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109175 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621344+0000", 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.789e-05 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270061+0000", 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.64871766600000003 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270254+0000", 2024-09-17T01:56:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000192392 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270517+0000", 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026355699999999998 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276295+0000", 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005777412 2024-09-17T01:56:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276427+0000", 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131958 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276501+0000", 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4051e-05 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276566+0000", 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5216999999999996e-05 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4714 4.2d 4:b437e665:::10000001628.00000000:head [write 0~1699] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4459767960000001, 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.60310710899999997, 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4714 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675466+0000", 2024-09-17T01:56:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675478+0000", 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1956999999999999e-05 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675499+0000", 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1761000000000001e-05 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675518+0000", 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8810000000000001e-05 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675656+0000", 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013773799999999999 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675672+0000", 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6079999999999999e-05 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272928+0000", 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.59725582399999999 2024-09-17T01:56:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273261+0000", 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033340099999999999 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273625+0000", 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036354300000000003 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276407+0000", 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027817190000000002 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278409+0000", 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020029039999999998 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278502+0000", 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2263999999999996e-05 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278571+0000", 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8918000000000007e-05 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4788 4.2d 4:b4cc316c:::1000000167e.00000000:head [write 0~2170] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3486805579999999, 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50757323899999995, 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4788 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772762+0000", 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772774+0000", 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2086000000000001e-05 2024-09-17T01:56:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772802+0000", 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8197000000000001e-05 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772821+0000", 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8301e-05 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773010+0000", 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189588 2024-09-17T01:56:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773042+0000", 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1643999999999997e-05 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274751+0000", 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50170971099999995 2024-09-17T01:56:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274979+0000", 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022755299999999999 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.275278+0000", 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029924999999999998 2024-09-17T01:56:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278717+0000", 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003438998 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280135+0000", 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001417349 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280219+0000", 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4036999999999995e-05 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280333+0000", 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011435800000000001 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4798 4.2d 4:b79c5810:::10000001688.00000000:head [write 0~6996] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3368796969999996, 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49795705400000001, 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4798 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784562+0000", 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.59e-06 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784584+0000", 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1997999999999998e-05 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784604+0000", 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9383000000000001e-05 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784618+0000", 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4250000000000001e-05 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784740+0000", 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012229400000000001 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784756+0000", 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5741000000000001e-05 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276635+0000", 2024-09-17T01:56:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49187889699999998 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276961+0000", 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032572999999999999 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277323+0000", 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036245400000000001 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282372+0000", 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050488490000000002 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282393+0000", 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282463+0000", 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9694000000000001e-05 2024-09-17T01:56:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282518+0000", 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5090999999999998e-05 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4799 4.2d 4:b4576620:::10000001689.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3356195570000002, 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49814391800000002, 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4799 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785823+0000", 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2069999999999998e-06 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785834+0000", 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0864e-05 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785865+0000", 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1513000000000001e-05 2024-09-17T01:56:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785880+0000", 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4966999999999999e-05 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785988+0000", 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107394 2024-09-17T01:56:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.786003+0000", 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5554e-05 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278859+0000", 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49285563100000002 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279204+0000", 2024-09-17T01:56:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034552600000000003 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279412+0000", 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020742199999999999 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282607+0000", 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031956229999999999 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283821+0000", 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012134260000000001 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283902+0000", 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0851000000000002e-05 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283965+0000", 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2940000000000004e-05 2024-09-17T01:56:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4916 4.2d 4:b65c07c8:::1000000170f.00000000:head [write 0~2630] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1897485809999999, 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.354345823, 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4916 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931694+0000", 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.807e-06 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931703+0000", 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8530000000000004e-06 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931721+0000", 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7997000000000001e-05 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931734+0000", 2024-09-17T01:56:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2286999999999999e-05 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931828+0000", 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4470999999999997e-05 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931844+0000", 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5424e-05 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280474+0000", 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34863022399999999 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280767+0000", 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029277300000000002 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.281100+0000", 2024-09-17T01:56:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333374 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285614+0000", 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004514176 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285870+0000", 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025610299999999998 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285966+0000", 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5474000000000001e-05 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286038+0000", 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1860000000000007e-05 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4923 4.2d 4:b7aaf913:::10000001717.00000000:head [write 0~1965] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1798155320000001, 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34469107700000001, 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4923 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941627+0000", 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7269999999999999e-06 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941636+0000", 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3959999999999995e-06 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941658+0000", 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2198e-05 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941670+0000", 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2353e-05 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941792+0000", 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012115799999999999 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941809+0000", 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282679+0000", 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34086941199999998 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282852+0000", 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000173492 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283094+0000", 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024125899999999999 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285850+0000", 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002755904 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286185+0000", 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033567800000000001 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286249+0000", 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3847e-05 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286316+0000", 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6829999999999995e-05 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4929 4.2d 4:b5acf001:::1000000171e.00000000:head [write 0~1676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1717042949999996, 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33680069299999998, 2024-09-17T01:56:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4929 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949738+0000", 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999998e-06 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949791+0000", 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2660000000000001e-05 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949822+0000", 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853999999999997e-05 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949841+0000", 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8994000000000001e-05 2024-09-17T01:56:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950037+0000", 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019598799999999999 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950068+0000", 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0644e-05 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284073+0000", 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33400524700000001 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284415+0000", 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034212100000000003 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284770+0000", 2024-09-17T01:56:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035503999999999999 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286401+0000", 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00163072 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286418+0000", 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6293000000000001e-05 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286482+0000", 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4734999999999996e-05 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286537+0000", 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4477e-05 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:126 3.1a 3:5e41ab69:::200.00000005:head [write 223054~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.212 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.9576055139999999, 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082452368999999998, 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:15.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163836+0000", 2024-09-17T01:56:15.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0240000000000001e-06 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163846+0000", 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0530000000000001e-05 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163861+0000", 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4656e-05 2024-09-17T01:56:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163870+0000", 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.524e-06 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234115+0000", 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.070245611999999999 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234345+0000", 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023027799999999999 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234701+0000", 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035562400000000002 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.238686+0000", 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039847320000000004 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246154+0000", 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074686639999999999 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246230+0000", 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6001000000000006e-05 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246287+0000", 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6724000000000001e-05 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:127 3.1a 3:5e41ab69:::200.00000005:head [write 224458~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.957560264, 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082535662999999995, 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163881+0000", 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7400000000000003e-07 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163885+0000", 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0260000000000001e-06 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163894+0000", 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3640000000000005e-06 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163902+0000", 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4359999999999996e-06 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.235648+0000", 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.071746889999999994 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.235901+0000", 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025289600000000001 2024-09-17T01:56:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.236241+0000", 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033998900000000001 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246136+0000", 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098946160000000002 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246301+0000", 2024-09-17T01:56:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016531099999999999 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246366+0000", 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5151e-05 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246416+0000", 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9310000000000001e-05 2024-09-17T01:56:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:128 3.1a 3:5e41ab69:::200.00000005:head [write 225858~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.957528097, 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082823128999999995, 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163913+0000", 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7999999999999995e-07 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163922+0000", 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.38e-06 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163932+0000", 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7370000000000001e-06 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163939+0000", 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3939999999999998e-06 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237512+0000", 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073573019000000003 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237635+0000", 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012272699999999999 2024-09-17T01:56:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237904+0000", 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026857699999999999 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246511+0000", 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086073959999999998 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246619+0000", 2024-09-17T01:56:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107831 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246684+0000", 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5284999999999996e-05 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246735+0000", 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1103000000000002e-05 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 247133~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.9479715080000002, 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.088075537999999995, 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173470+0000", 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.37e-06 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173489+0000", 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9127000000000002e-05 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173513+0000", 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3577000000000001e-05 2024-09-17T01:56:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173538+0000", 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4774e-05 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246939+0000", 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073401026999999994 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.247276+0000", 2024-09-17T01:56:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033744299999999999 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.247472+0000", 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000196052 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256084+0000", 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086122999999999998 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261238+0000", 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051537049999999997 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261423+0000", 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018525799999999999 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261544+0000", 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120905 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 249061~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.9478745499999999, 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.088312648999999993, 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173567+0000", 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173577+0000", 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0267e-05 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173620+0000", 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173642+0000", 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1511000000000001e-05 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248205+0000", 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074563144999999997 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248339+0000", 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133974 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248524+0000", 2024-09-17T01:56:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018483200000000001 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256095+0000", 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075709640000000003 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261651+0000", 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055564209999999998 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261768+0000", 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117135 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261878+0000", 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109967 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 250990~3883 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.9470853030000002, 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.087972380000000003, 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174358+0000", 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174381+0000", 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2836999999999998e-05 2024-09-17T01:56:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174406+0000", 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4879999999999999e-05 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174429+0000", 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3686999999999999e-05 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250532+0000", 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076102515999999995 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250667+0000", 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013468200000000001 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250956+0000", 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028952900000000001 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256101+0000", 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005145401 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262086+0000", 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005984975 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262222+0000", 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013510200000000001 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262327+0000", 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010585400000000001 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 254873~3883 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.9442030699999999, 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.085393837, 2024-09-17T01:56:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177240+0000", 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.604e-06 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177280+0000", 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0521e-05 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177324+0000", 2024-09-17T01:56:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4039999999999998e-05 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177382+0000", 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7500000000000002e-05 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.251935+0000", 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074552713000000007 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.252158+0000", 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223265 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.252436+0000", 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027832600000000002 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261128+0000", 2024-09-17T01:56:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086915900000000008 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262449+0000", 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013208060000000001 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262528+0000", 2024-09-17T01:56:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9686999999999998e-05 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262631+0000", 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102785 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 258756~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.9415507380000001, 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.083075610999999994, 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179897+0000", 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4499999999999998e-06 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179917+0000", 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9979999999999998e-05 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179942+0000", 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5449999999999999e-05 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179964+0000", 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1897999999999999e-05 2024-09-17T01:56:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.253718+0000", 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073753604 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.253863+0000", 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145422 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.254047+0000", 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018408699999999999 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261923+0000", 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078755700000000001 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262765+0000", 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084215799999999997 2024-09-17T01:56:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262861+0000", 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5864000000000002e-05 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262965+0000", 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104128 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 262711~5209 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.939186329, 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.081020272000000004, 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182271+0000", 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629999999999998e-05 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182307+0000", 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6773000000000002e-05 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182335+0000", 2024-09-17T01:56:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7373999999999999e-05 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182393+0000", 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7890000000000003e-05 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.254933+0000", 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072540224 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.255061+0000", 2024-09-17T01:56:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012768100000000001 2024-09-17T01:56:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.255249+0000", 2024-09-17T01:56:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188665 2024-09-17T01:56:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261941+0000", 2024-09-17T01:56:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066919019999999996 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263076+0000", 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011343740000000001 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263185+0000", 2024-09-17T01:56:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010982800000000001 2024-09-17T01:56:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263274+0000", 2024-09-17T01:56:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8931000000000006e-05 2024-09-17T01:56:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 267920~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.939010471, 2024-09-17T01:56:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.081300400999999994, 2024-09-17T01:56:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182431+0000", 2024-09-17T01:56:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5629999999999999e-06 2024-09-17T01:56:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182442+0000", 2024-09-17T01:56:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0747000000000001e-05 2024-09-17T01:56:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182464+0000", 2024-09-17T01:56:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1756999999999999e-05 2024-09-17T01:56:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182480+0000", 2024-09-17T01:56:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.594e-05 2024-09-17T01:56:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256227+0000", 2024-09-17T01:56:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073747264000000007 2024-09-17T01:56:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256393+0000", 2024-09-17T01:56:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000165565 2024-09-17T01:56:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256707+0000", 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031433299999999997 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263375+0000", 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066677990000000003 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263574+0000", 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198865 2024-09-17T01:56:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263656+0000", 2024-09-17T01:56:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2169999999999994e-05 2024-09-17T01:56:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263730+0000", 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4398000000000002e-05 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:15.282 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:15.283 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-17T01:56:15.283 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:56:15.283 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-09-17T01:56:15.283 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:56:15.283 INFO:teuthology.orchestra.console.smithi154:Power off 2024-09-17T01:56:15.284 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-17T01:56:15.295 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:15.286+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:15.296 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:15.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:56:15.308 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-09-17T01:56:15.384 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:15.386+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:15.442 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:7310 4.14 e50/17 4:295cf825:::1000000215c.00000000:head v 50'104, mlcod=50'102)", 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.446854+0000", 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0013738069999999999, 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014254490000000001, 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446854+0000", 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446854+0000", 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446856+0000", 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7999999999999999e-06 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446868+0000", 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1904e-05 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446891+0000", 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2792000000000001e-05 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446903+0000", 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2417e-05 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.447055+0000", 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000152256 2024-09-17T01:56:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.447110+0000", 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4181000000000002e-05 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:7311 4.1e 4:7826e4be:::1000000215d.00000000:head [write 0~133 in=133b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.446952+0000", 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0012759959999999999, 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001442505, 2024-09-17T01:56:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.448 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.448 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 7311 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446952+0000", 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446952+0000", 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446954+0000", 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0200000000000001e-06 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446965+0000", 2024-09-17T01:56:15.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0806e-05 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.446992+0000", 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7287000000000001e-05 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.447007+0000", 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4582e-05 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.447203+0000", 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019655200000000001 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.447633+0000", 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000429715 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.448106+0000", 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000473444 2024-09-17T01:56:15.452 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.453 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.453 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.453 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.453 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:15.453 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 2 2024-09-17T01:56:15.453 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:15.460 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:15.485 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:15.485+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:15.586 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:15.589+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:15.635 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:15.635 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:15.635 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:15.635 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:15.635 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:15.650 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:15.687 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:15.689+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:15.784 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:15.784 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:15.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:15.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:15.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.784 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 71.572621986000001, 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:56:15.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:56:15.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 12.416208291, 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.052538046999999997, 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.791 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 6 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368155+0000", 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7159999999999999e-06 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375086+0000", 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069303330000000003 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375126+0000", 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9854999999999997e-05 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375144+0000", 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8006e-05 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375282+0000", 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013803900000000001 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375504+0000", 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022231900000000001 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375711+0000", 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000207238 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408034+0000", 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032322367999999997 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420591+0000", 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012557166 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420644+0000", 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2859000000000003e-05 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420691+0000", 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7148000000000003e-05 2024-09-17T01:56:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:57 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.5650846969999996, 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013009569, 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219278+0000", 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.894e-06 2024-09-17T01:56:15.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219406+0000", 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012822199999999999 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219424+0000", 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7091e-05 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219433+0000", 2024-09-17T01:56:15.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2299999999999997e-06 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219604+0000", 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017164599999999999 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219764+0000", 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015926499999999999 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.224310+0000", 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045462749999999998 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.229006+0000", 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004696263 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232019+0000", 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0030129380000000002 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232168+0000", 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014881200000000001 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232286+0000", 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117933 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.802 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:62 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 8.5625720330000004, 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015833152, 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221792+0000", 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.61e-06 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222028+0000", 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000236295 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222057+0000", 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9246000000000001e-05 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222080+0000", 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2408999999999998e-05 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222197+0000", 2024-09-17T01:56:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117106 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222331+0000", 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134342 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.228794+0000", 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0064630290000000003 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.236744+0000", 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079497960000000003 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237468+0000", 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00072368699999999998 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237559+0000", 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1583999999999996e-05 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237622+0000", 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3047999999999997e-05 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4434 4.21 4:841906fb:::100000014f3.00000000:head [write 0~2088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.334904+0000", 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4494567629999997, 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0085421460000000005, 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.808 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4434 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334904+0000", 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334904+0000", 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334906+0000", 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1440000000000001e-06 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334919+0000", 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2703e-05 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334947+0000", 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7725e-05 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.334966+0000", 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9089999999999998e-05 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.335090+0000", 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012416 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.335352+0000", 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026236500000000003 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.335608+0000", 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025570600000000002 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.339050+0000", 2024-09-17T01:56:15.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0034418040000000001 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.343195+0000", 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004145307 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.343340+0000", 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000145072 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.343446+0000", 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010607000000000001 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:71 3.b 3:d5c7a900:::200.00000003:head [write 1714465~2273320 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.2994320850000003, 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019288186999999998, 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.814 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484931+0000", 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7430000000000001e-06 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489029+0000", 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040978919999999997 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489059+0000", 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0786e-05 2024-09-17T01:56:15.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489074+0000", 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4603000000000001e-05 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489213+0000", 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139429 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489353+0000", 2024-09-17T01:56:15.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979199999999999 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489551+0000", 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019731800000000001 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.503369+0000", 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013818833000000001 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504053+0000", 2024-09-17T01:56:15.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00068402899999999995 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504146+0000", 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2138000000000005e-05 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504217+0000", 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1624000000000004e-05 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4966 4.16 4:6a5623fa:::10000001744.00000000:head [write 0~1681] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.7870298760000001, 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095897110000000008, 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4966 2024-09-17T01:56:15.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997333+0000", 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9829999999999999e-06 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997342+0000", 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9740000000000008e-06 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997362+0000", 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0146e-05 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997373+0000", 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0783e-05 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997456+0000", 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.318e-05 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997689+0000", 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023306999999999999 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997876+0000", 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000186508 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.000413+0000", 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002537381 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006653+0000", 2024-09-17T01:56:15.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062398439999999996 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006808+0000", 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154692 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006921+0000", 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011315 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5120 4.b 4:d0c4bbd3:::100000017df.00000000:head [write 0~1333] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.190621+0000", 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.5937396699999997, 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0088958790000000006, 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5120 2024-09-17T01:56:15.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190621+0000", 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190621+0000", 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190622+0000", 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.071e-06 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190628+0000", 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5790000000000003e-06 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190644+0000", 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5650000000000001e-05 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190653+0000", 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8370000000000003e-06 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190727+0000", 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4381999999999994e-05 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.190894+0000", 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016745400000000001 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.191073+0000", 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017895000000000001 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.191901+0000", 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00082762999999999999 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.199458+0000", 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007557144 2024-09-17T01:56:15.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.199492+0000", 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3982000000000001e-05 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.199517+0000", 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5199999999999999e-05 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:74 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.551691333, 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018559200000000001, 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232672+0000", 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0729999999999999e-06 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232768+0000", 2024-09-17T01:56:15.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5841000000000006e-05 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232795+0000", 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7362e-05 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232809+0000", 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3959e-05 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232883+0000", 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4086999999999997e-05 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.233004+0000", 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120629 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.239248+0000", 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062448319999999996 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.244891+0000", 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056420919999999996 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251167+0000", 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062759410000000002 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251201+0000", 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4143999999999997e-05 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251229+0000", 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8240000000000001e-05 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:75 3.1f 3:f83d65d8:::200.00000004:head [write 0~2723841 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.847751+0000", 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.93660999, 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025605569000000002, 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.837 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.847751+0000", 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.847751+0000", 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.847753+0000", 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3300000000000001e-06 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852115+0000", 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004361307 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852149+0000", 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3946000000000003e-05 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852164+0000", 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4946000000000001e-05 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852269+0000", 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000105407 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852394+0000", 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012504000000000001 2024-09-17T01:56:15.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852592+0000", 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019763699999999999 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.869601+0000", 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.017009064000000001 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.873277+0000", 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0036760730000000002 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.873320+0000", 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3458000000000003e-05 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.873357+0000", 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6361e-05 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.842 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:76 3.1f 3:f83d65d8:::200.00000004:head [write 2723841~1470463 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.024127+0000", 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.7602339970000003, 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016415272000000002, 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.024127+0000", 2024-09-17T01:56:15.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.024127+0000", 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.024129+0000", 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1270000000000001e-06 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026433+0000", 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023038440000000002 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026480+0000", 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7132000000000002e-05 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026503+0000", 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2736000000000001e-05 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026651+0000", 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000148436 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026792+0000", 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014033900000000001 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026987+0000", 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019518700000000001 2024-09-17T01:56:15.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.039274+0000", 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012286742999999999 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.040296+0000", 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010224850000000001 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.040426+0000", 2024-09-17T01:56:15.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129956 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.040542+0000", 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011628700000000001 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:152 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.236611+0000", 2024-09-17T01:56:15.848 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.5477502960000002, 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025623394000000001, 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236611+0000", 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236611+0000", 2024-09-17T01:56:15.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236662+0000", 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1619000000000002e-05 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236736+0000", 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3651000000000003e-05 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236759+0000", 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2506000000000001e-05 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236772+0000", 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3803e-05 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236918+0000", 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014584900000000001 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.237073+0000", 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015463900000000001 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.244297+0000", 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072244190000000002 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.255291+0000", 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010993921 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262045+0000", 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0067536289999999997 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262170+0000", 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000124874 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262234+0000", 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4484000000000001e-05 2024-09-17T01:56:15.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:134 3.1a e49/16 3:5e41ab69:::200.00000005:head v 49'58, mlcod=49'52)", 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.250578+0000", 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.53378331, 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011695084, 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250578+0000", 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250578+0000", 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250579+0000", 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5370000000000001e-06 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250590+0000", 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0512e-05 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250614+0000", 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4297000000000001e-05 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250627+0000", 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2835e-05 2024-09-17T01:56:15.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250800+0000", 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017289900000000001 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250866+0000", 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6278000000000005e-05 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262184+0000", 2024-09-17T01:56:15.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011317745000000001 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262273+0000", 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8980999999999994e-05 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:135 3.1a e49/16 3:5e41ab69:::200.00000005:head v 49'59, mlcod=49'52)", 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.251558+0000", 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.5328035209999999, 2024-09-17T01:56:15.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012132980999999999, 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251558+0000", 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251558+0000", 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251559+0000", 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.319e-06 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251569+0000", 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.028e-05 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251587+0000", 2024-09-17T01:56:15.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7535999999999999e-05 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251598+0000", 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.166e-05 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251656+0000", 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7371999999999999e-05 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251683+0000", 2024-09-17T01:56:15.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7012000000000002e-05 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263547+0000", 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011864483 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263690+0000", 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014331899999999999 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:136 3.1a e49/16 3:5e41ab69:::200.00000005:head v 49'60, mlcod=49'55)", 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.253994+0000", 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.5303670710000001, 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0097702989999999997, 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.253994+0000", 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.253994+0000", 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.253995+0000", 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254008+0000", 2024-09-17T01:56:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2666e-05 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254027+0000", 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9660000000000002e-05 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254039+0000", 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1158999999999999e-05 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254120+0000", 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1483999999999994e-05 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254148+0000", 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.779e-05 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263697+0000", 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095495819999999992 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263764+0000", 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6874999999999999e-05 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5640 4.21 4:87d83c18:::100000019f6.00000000:head [write 0~1612] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.264913+0000", 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.519448315, 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0091076249999999994, 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.867 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5640 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264913+0000", 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264913+0000", 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264922+0000", 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8060000000000001e-06 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264932+0000", 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0967e-05 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264956+0000", 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3859e-05 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264970+0000", 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3166999999999999e-05 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.265125+0000", 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015500799999999999 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.265385+0000", 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026015000000000001 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.265601+0000", 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021609999999999999 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.268271+0000", 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00266987 2024-09-17T01:56:15.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.273759+0000", 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054878990000000001 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.273911+0000", 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000152876 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.274020+0000", 2024-09-17T01:56:15.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000108923 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5735 4.11 4:88c45c07:::10000001a61.00000000:head [write 0~7806] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.431910+0000", 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 3.3524508079999999, 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0087129170000000006, 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.873 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5735 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.431910+0000", 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.431910+0000", 2024-09-17T01:56:15.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.431918+0000", 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7700000000000001e-06 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.431940+0000", 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1679e-05 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.431972+0000", 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2521999999999998e-05 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.431991+0000", 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.914e-05 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.432102+0000", 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000110744 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.432309+0000", 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020642999999999999 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.432587+0000", 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00027818299999999999 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.434136+0000", 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015494949999999999 2024-09-17T01:56:15.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.440457+0000", 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0063211420000000001 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.440540+0000", 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2740999999999999e-05 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.440623+0000", 2024-09-17T01:56:15.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3071000000000005e-05 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:164 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.244900+0000", 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.53946070899999998, 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016673107999999999, 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.879 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.244900+0000", 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.244900+0000", 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.244903+0000", 2024-09-17T01:56:15.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1030000000000002e-06 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245025+0000", 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012193000000000001 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245058+0000", 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2363000000000002e-05 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245072+0000", 2024-09-17T01:56:15.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4646e-05 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245262+0000", 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018997799999999999 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245440+0000", 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000177665 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.248229+0000", 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027889389999999998 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.260089+0000", 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011859553 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261314+0000", 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001225571 2024-09-17T01:56:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261455+0000", 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000141216 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261573+0000", 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000118144 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:7233 4.16 4:68bcb57e:::10000002107.00000000:head [write 0~2960] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.251568+0000", 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.53279331100000005, 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010011466, 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 7233 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.885 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251568+0000", 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251568+0000", 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251570+0000", 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.917e-06 2024-09-17T01:56:15.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251581+0000", 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1813e-05 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251609+0000", 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7512999999999999e-05 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251628+0000", 2024-09-17T01:56:15.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8895000000000001e-05 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251761+0000", 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013284399999999999 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.252235+0000", 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00047385400000000001 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:15.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.252716+0000", 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00048142999999999998 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.254698+0000", 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019815140000000002 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261352+0000", 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066547860000000002 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261487+0000", 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134719 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261579+0000", 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2181000000000004e-05 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:165 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4136374 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-17T01:56:15.890 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.359547+0000", 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.424813885, 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.036379124999999998, 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.359547+0000", 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.359547+0000", 2024-09-17T01:56:15.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.359549+0000", 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4759999999999999e-06 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363536+0000", 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039875120000000003 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363563+0000", 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7362e-05 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363575+0000", 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1068e-05 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363727+0000", 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015276600000000001 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363808+0000", 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0587999999999995e-05 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363925+0000", 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011665100000000001 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.385999+0000", 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022074755000000001 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.395791+0000", 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0097921580000000005 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.395867+0000", 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5826000000000002e-05 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.395926+0000", 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8962999999999998e-05 2024-09-17T01:56:15.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.896 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:15.896 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:15.896 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:15.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:15.898 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:15.898+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:15.998 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:15.998+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:16.034 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:7670 4.7 e50/17 4:e14f905f:::100000022ef.00000000:head v 50'120, mlcod=50'118)", 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:16.036627+0000", 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0011707289999999999, 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001211925, 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036627+0000", 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036627+0000", 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036629+0000", 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5859999999999999e-06 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036657+0000", 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7681000000000001e-05 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036683+0000", 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6610000000000001e-05 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036696+0000", 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2614e-05 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036809+0000", 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113694 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:16.036844+0000", 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4780000000000002e-05 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-17T01:56:16.038 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:16.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:16.099 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:16.101+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:16.173 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:16.173 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:16.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:16.200 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:16.202+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:16.295 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:56:16.301 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:16.301+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:16.373 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9968105019999998, 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.374 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:16.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:16.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4600 4.2d 4:b73d992a:::100000015aa.00000000:head [write 0~6267] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8263678109999999, 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.728534024, 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4600 2024-09-17T01:56:16.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544250+0000", 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6600000000000007e-06 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544274+0000", 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4006999999999999e-05 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544303+0000", 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8637e-05 2024-09-17T01:56:16.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544322+0000", 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9357000000000001e-05 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544546+0000", 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223802 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544564+0000", 2024-09-17T01:56:16.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8199999999999999e-05 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268542+0000", 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.723977961 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268794+0000", 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025118900000000002 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.269025+0000", 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023119199999999999 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272537+0000", 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035122629999999998 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272634+0000", 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7201000000000007e-05 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272721+0000", 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6567e-05 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272775+0000", 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3987999999999999e-05 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.388 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4672 4.2d 4:b407c00e:::100000015f9.00000000:head [write 0~1753] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7494563540000003, 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.65541383900000005, 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4672 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621154+0000", 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.607e-06 2024-09-17T01:56:16.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621180+0000", 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5882999999999999e-05 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621204+0000", 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4573999999999999e-05 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621217+0000", 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2456999999999999e-05 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621326+0000", 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109175 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621344+0000", 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.789e-05 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270061+0000", 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.64871766600000003 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270254+0000", 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000192392 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270517+0000", 2024-09-17T01:56:16.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026355699999999998 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276295+0000", 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005777412 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276427+0000", 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131958 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276501+0000", 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4051e-05 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276566+0000", 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5216999999999996e-05 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4714 4.2d 4:b437e665:::10000001628.00000000:head [write 0~1699] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.395 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.6951450460000004, 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.60310710899999997, 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4714 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675466+0000", 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675478+0000", 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1956999999999999e-05 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675499+0000", 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1761000000000001e-05 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675518+0000", 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8810000000000001e-05 2024-09-17T01:56:16.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675656+0000", 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013773799999999999 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675672+0000", 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6079999999999999e-05 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272928+0000", 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.59725582399999999 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273261+0000", 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033340099999999999 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273625+0000", 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036354300000000003 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276407+0000", 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027817190000000002 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278409+0000", 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020029039999999998 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278502+0000", 2024-09-17T01:56:16.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2263999999999996e-05 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278571+0000", 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8918000000000007e-05 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4788 4.2d 4:b4cc316c:::1000000167e.00000000:head [write 0~2170] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5978488080000002, 2024-09-17T01:56:16.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50757323899999995, 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4788 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:16.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772762+0000", 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772774+0000", 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2086000000000001e-05 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772802+0000", 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8197000000000001e-05 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772821+0000", 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8301e-05 2024-09-17T01:56:16.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773010+0000", 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189588 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773042+0000", 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1643999999999997e-05 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274751+0000", 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50170971099999995 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274979+0000", 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022755299999999999 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.275278+0000", 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029924999999999998 2024-09-17T01:56:16.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278717+0000", 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003438998 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280135+0000", 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001417349 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280219+0000", 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4036999999999995e-05 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280333+0000", 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011435800000000001 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4798 4.2d 4:b79c5810:::10000001688.00000000:head [write 0~6996] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.409 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.586047947, 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49795705400000001, 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4798 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784562+0000", 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.59e-06 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784584+0000", 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1997999999999998e-05 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784604+0000", 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9383000000000001e-05 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784618+0000", 2024-09-17T01:56:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4250000000000001e-05 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784740+0000", 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012229400000000001 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784756+0000", 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5741000000000001e-05 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276635+0000", 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49187889699999998 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276961+0000", 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032572999999999999 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277323+0000", 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036245400000000001 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282372+0000", 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050488490000000002 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282393+0000", 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282463+0000", 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9694000000000001e-05 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282518+0000", 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5090999999999998e-05 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4799 4.2d 4:b4576620:::10000001689.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5847878069999997, 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49814391800000002, 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4799 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785823+0000", 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2069999999999998e-06 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785834+0000", 2024-09-17T01:56:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0864e-05 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785865+0000", 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1513000000000001e-05 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785880+0000", 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4966999999999999e-05 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785988+0000", 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107394 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.786003+0000", 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5554e-05 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278859+0000", 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49285563100000002 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279204+0000", 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034552600000000003 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279412+0000", 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020742199999999999 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282607+0000", 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031956229999999999 2024-09-17T01:56:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283821+0000", 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012134260000000001 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283902+0000", 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0851000000000002e-05 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283965+0000", 2024-09-17T01:56:16.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2940000000000004e-05 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4916 4.2d 4:b65c07c8:::1000000170f.00000000:head [write 0~2630] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4389168310000002, 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.354345823, 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4916 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931694+0000", 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.807e-06 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931703+0000", 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8530000000000004e-06 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931721+0000", 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7997000000000001e-05 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931734+0000", 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2286999999999999e-05 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931828+0000", 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4470999999999997e-05 2024-09-17T01:56:16.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931844+0000", 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5424e-05 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280474+0000", 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34863022399999999 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280767+0000", 2024-09-17T01:56:16.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029277300000000002 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.281100+0000", 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333374 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285614+0000", 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004514176 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285870+0000", 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025610299999999998 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285966+0000", 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5474000000000001e-05 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286038+0000", 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1860000000000007e-05 2024-09-17T01:56:16.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4923 4.2d 4:b7aaf913:::10000001717.00000000:head [write 0~1965] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4289837819999995, 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34469107700000001, 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.430 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4923 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941627+0000", 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7269999999999999e-06 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941636+0000", 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3959999999999995e-06 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941658+0000", 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2198e-05 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941670+0000", 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2353e-05 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941792+0000", 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012115799999999999 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941809+0000", 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282679+0000", 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34086941199999998 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282852+0000", 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000173492 2024-09-17T01:56:16.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283094+0000", 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024125899999999999 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285850+0000", 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002755904 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286185+0000", 2024-09-17T01:56:16.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033567800000000001 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286249+0000", 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3847e-05 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286316+0000", 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6829999999999995e-05 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4929 4.2d 4:b5acf001:::1000000171e.00000000:head [write 0~1676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4208725449999999, 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33680069299999998, 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4929 2024-09-17T01:56:16.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949738+0000", 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999998e-06 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949791+0000", 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2660000000000001e-05 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949822+0000", 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853999999999997e-05 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949841+0000", 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8994000000000001e-05 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950037+0000", 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019598799999999999 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950068+0000", 2024-09-17T01:56:16.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0644e-05 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284073+0000", 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33400524700000001 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284415+0000", 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034212100000000003 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284770+0000", 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035503999999999999 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286401+0000", 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00163072 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286418+0000", 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6293000000000001e-05 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286482+0000", 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4734999999999996e-05 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286537+0000", 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4477e-05 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:126 3.1a 3:5e41ab69:::200.00000005:head [write 223054~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.443 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2067737640000002, 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082452368999999998, 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163836+0000", 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0240000000000001e-06 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163846+0000", 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0530000000000001e-05 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163861+0000", 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4656e-05 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163870+0000", 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.524e-06 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234115+0000", 2024-09-17T01:56:16.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.070245611999999999 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234345+0000", 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023027799999999999 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234701+0000", 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035562400000000002 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.238686+0000", 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039847320000000004 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246154+0000", 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074686639999999999 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246230+0000", 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6001000000000006e-05 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246287+0000", 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6724000000000001e-05 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:127 3.1a 3:5e41ab69:::200.00000005:head [write 224458~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2067285139999999, 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082535662999999995, 2024-09-17T01:56:16.449 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163881+0000", 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7400000000000003e-07 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163885+0000", 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0260000000000001e-06 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163894+0000", 2024-09-17T01:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3640000000000005e-06 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163902+0000", 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4359999999999996e-06 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.235648+0000", 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.071746889999999994 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.235901+0000", 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025289600000000001 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.236241+0000", 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033998900000000001 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246136+0000", 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098946160000000002 2024-09-17T01:56:16.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246301+0000", 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016531099999999999 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246366+0000", 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5151e-05 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246416+0000", 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9310000000000001e-05 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:128 3.1a 3:5e41ab69:::200.00000005:head [write 225858~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2066963470000003, 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082823128999999995, 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163913+0000", 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7999999999999995e-07 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163922+0000", 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.38e-06 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163932+0000", 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7370000000000001e-06 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163939+0000", 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3939999999999998e-06 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237512+0000", 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073573019000000003 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237635+0000", 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012272699999999999 2024-09-17T01:56:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237904+0000", 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026857699999999999 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246511+0000", 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086073959999999998 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246619+0000", 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107831 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246684+0000", 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5284999999999996e-05 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246735+0000", 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1103000000000002e-05 2024-09-17T01:56:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 247133~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1971397579999996, 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.088075537999999995, 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173470+0000", 2024-09-17T01:56:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.37e-06 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173489+0000", 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9127000000000002e-05 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173513+0000", 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3577000000000001e-05 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173538+0000", 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4774e-05 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246939+0000", 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073401026999999994 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.247276+0000", 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033744299999999999 2024-09-17T01:56:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.247472+0000", 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000196052 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256084+0000", 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086122999999999998 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261238+0000", 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051537049999999997 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261423+0000", 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018525799999999999 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261544+0000", 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120905 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 249061~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1970428000000002, 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.088312648999999993, 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173567+0000", 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173577+0000", 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0267e-05 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173620+0000", 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173642+0000", 2024-09-17T01:56:16.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1511000000000001e-05 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248205+0000", 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074563144999999997 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248339+0000", 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133974 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248524+0000", 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018483200000000001 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256095+0000", 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075709640000000003 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261651+0000", 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055564209999999998 2024-09-17T01:56:16.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261768+0000", 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117135 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261878+0000", 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109967 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 250990~3883 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.196253553, 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.087972380000000003, 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:16.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174358+0000", 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174381+0000", 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2836999999999998e-05 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174406+0000", 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4879999999999999e-05 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174429+0000", 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3686999999999999e-05 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250532+0000", 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076102515999999995 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250667+0000", 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013468200000000001 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250956+0000", 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028952900000000001 2024-09-17T01:56:16.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256101+0000", 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005145401 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262086+0000", 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005984975 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262222+0000", 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013510200000000001 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262327+0000", 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010585400000000001 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 254873~3883 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.478 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1933713199999998, 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.085393837, 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177240+0000", 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.604e-06 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177280+0000", 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0521e-05 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177324+0000", 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4039999999999998e-05 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177382+0000", 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7500000000000002e-05 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.251935+0000", 2024-09-17T01:56:16.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074552713000000007 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.252158+0000", 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223265 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.252436+0000", 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027832600000000002 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261128+0000", 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086915900000000008 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262449+0000", 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013208060000000001 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262528+0000", 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9686999999999998e-05 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262631+0000", 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102785 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 258756~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1907189880000004, 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.083075610999999994, 2024-09-17T01:56:16.484 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179897+0000", 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4499999999999998e-06 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179917+0000", 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9979999999999998e-05 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179942+0000", 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5449999999999999e-05 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179964+0000", 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1897999999999999e-05 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.253718+0000", 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073753604 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.253863+0000", 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145422 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.254047+0000", 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018408699999999999 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261923+0000", 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078755700000000001 2024-09-17T01:56:16.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262765+0000", 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084215799999999997 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262861+0000", 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5864000000000002e-05 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262965+0000", 2024-09-17T01:56:16.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104128 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 262711~5209 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1883545790000003, 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.081020272000000004, 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.490 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182271+0000", 2024-09-17T01:56:16.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629999999999998e-05 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182307+0000", 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6773000000000002e-05 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182335+0000", 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7373999999999999e-05 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182393+0000", 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7890000000000003e-05 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.254933+0000", 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072540224 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.255061+0000", 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012768100000000001 2024-09-17T01:56:16.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.255249+0000", 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188665 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261941+0000", 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066919019999999996 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263076+0000", 2024-09-17T01:56:16.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011343740000000001 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263185+0000", 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010982800000000001 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263274+0000", 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8931000000000006e-05 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 267920~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1881787209999999, 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.081300400999999994, 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182431+0000", 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5629999999999999e-06 2024-09-17T01:56:16.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182442+0000", 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0747000000000001e-05 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182464+0000", 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1756999999999999e-05 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182480+0000", 2024-09-17T01:56:16.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.594e-05 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256227+0000", 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073747264000000007 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256393+0000", 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000165565 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256707+0000", 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031433299999999997 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263375+0000", 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066677990000000003 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263574+0000", 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198865 2024-09-17T01:56:16.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263656+0000", 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2169999999999994e-05 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263730+0000", 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4398000000000002e-05 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:16.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:16.502 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:16.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:16.504 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:16.502+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:16.603 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:16.602+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:16.641 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:8023 4.15 e51/17 4:abbfac2c:::10000002487.00000000:head v 51'116, mlcod=51'114)", 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:16.644463+0000", 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0030911549999999999, 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0031293279999999998, 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644463+0000", 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644463+0000", 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644464+0000", 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9899999999999999e-07 2024-09-17T01:56:16.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644470+0000", 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.365e-06 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644482+0000", 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1542000000000001e-05 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644489+0000", 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2540000000000003e-06 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644666+0000", 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000176885 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.644683+0000", 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6551000000000001e-05 2024-09-17T01:56:16.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:16.646 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:16.646 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:16.646 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:16.646 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:16.646 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 1 2024-09-17T01:56:16.646 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:16.656 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:16.744 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:16.746+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:16.805 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:16.806+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:16.822 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:16.822 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:16.822 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:16.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:16.924 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:16.926+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.008 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:17.009+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:17.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:17.011 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:17.011 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:17.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:17.011 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 72.801652981999993, 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010974469000000001, 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:17.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211739+0000", 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211742+0000", 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211756+0000", 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.359e-05 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211789+0000", 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3482999999999998e-05 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211806+0000", 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6650000000000002e-05 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211941+0000", 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013501600000000001 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.211952+0000", 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1323e-05 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219728+0000", 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.007776214 2024-09-17T01:56:17.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.219865+0000", 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013669499999999999 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.220073+0000", 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000208512 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.221159+0000", 2024-09-17T01:56:17.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010858910000000001 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222409+0000", 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012492810000000001 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222591+0000", 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000182268 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:55:04.222714+0000", 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012262899999999999 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.645239287000001, 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.052538046999999997, 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.018 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 6 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368153+0000", 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.368155+0000", 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7159999999999999e-06 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375086+0000", 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0069303330000000003 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375126+0000", 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9854999999999997e-05 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375144+0000", 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8006e-05 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375282+0000", 2024-09-17T01:56:17.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013803900000000001 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375504+0000", 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022231900000000001 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.375711+0000", 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000207238 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.408034+0000", 2024-09-17T01:56:17.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032322367999999997 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420591+0000", 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012557166 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420644+0000", 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2859000000000003e-05 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:03.420691+0000", 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7148000000000003e-05 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:57 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.794115693, 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013009569, 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.024 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219276+0000", 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219278+0000", 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.894e-06 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219406+0000", 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012822199999999999 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219424+0000", 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7091e-05 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219433+0000", 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2299999999999997e-06 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219604+0000", 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017164599999999999 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.219764+0000", 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015926499999999999 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.224310+0000", 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0045462749999999998 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.229006+0000", 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004696263 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232019+0000", 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0030129380000000002 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232168+0000", 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014881200000000001 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:06.232286+0000", 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117933 2024-09-17T01:56:17.029 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:62 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.7916030290000009, 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015833152, 2024-09-17T01:56:17.030 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221789+0000", 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.221792+0000", 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.61e-06 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222028+0000", 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000236295 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222057+0000", 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9246000000000001e-05 2024-09-17T01:56:17.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222080+0000", 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2408999999999998e-05 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222197+0000", 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117106 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.222331+0000", 2024-09-17T01:56:17.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134342 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.228794+0000", 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0064630290000000003 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.236744+0000", 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079497960000000003 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237468+0000", 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00072368699999999998 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237559+0000", 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1583999999999996e-05 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:07.237622+0000", 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3047999999999997e-05 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.035 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:71 3.b 3:d5c7a900:::200.00000003:head [write 1714465~2273320 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.5284630809999999, 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.019288186999999998, 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484929+0000", 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.484931+0000", 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7430000000000001e-06 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489029+0000", 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040978919999999997 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489059+0000", 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0786e-05 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489074+0000", 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4603000000000001e-05 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489213+0000", 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139429 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489353+0000", 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979199999999999 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.489551+0000", 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019731800000000001 2024-09-17T01:56:17.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.503369+0000", 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.013818833000000001 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504053+0000", 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00068402899999999995 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504146+0000", 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2138000000000005e-05 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.504217+0000", 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1624000000000004e-05 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:4966 4.16 4:6a5623fa:::10000001744.00000000:head [write 0~1681] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:17.041 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 6.0160608719999997, 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095897110000000008, 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4966 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997331+0000", 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997333+0000", 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9829999999999999e-06 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997342+0000", 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.9740000000000008e-06 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997362+0000", 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0146e-05 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997373+0000", 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0783e-05 2024-09-17T01:56:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997456+0000", 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.318e-05 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997689+0000", 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023306999999999999 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:10.997876+0000", 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000186508 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.000413+0000", 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002537381 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006653+0000", 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062398439999999996 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006808+0000", 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154692 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.006921+0000", 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011315 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:74 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-09-17T01:56:17.047 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.7807223289999996, 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018559200000000001, 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232670+0000", 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232672+0000", 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0729999999999999e-06 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232768+0000", 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5841000000000006e-05 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232795+0000", 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7362e-05 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232809+0000", 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3959e-05 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.232883+0000", 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4086999999999997e-05 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.233004+0000", 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120629 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.239248+0000", 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062448319999999996 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.244891+0000", 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056420919999999996 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251167+0000", 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062759410000000002 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251201+0000", 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4143999999999997e-05 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.251229+0000", 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8240000000000001e-05 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:75 3.1f 3:f83d65d8:::200.00000004:head [write 0~2723841 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:11.847751+0000", 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.1656409859999997, 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025605569000000002, 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.053 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.847751+0000", 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.847751+0000", 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.847753+0000", 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3300000000000001e-06 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852115+0000", 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.004361307 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852149+0000", 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3946000000000003e-05 2024-09-17T01:56:17.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852164+0000", 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4946000000000001e-05 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852269+0000", 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000105407 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852394+0000", 2024-09-17T01:56:17.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012504000000000001 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.852592+0000", 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019763699999999999 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.869601+0000", 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.017009064000000001 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.873277+0000", 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0036760730000000002 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.873320+0000", 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3458000000000003e-05 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:11.873357+0000", 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6361e-05 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.058 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:76 3.1f 3:f83d65d8:::200.00000004:head [write 2723841~1470463 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.024127+0000", 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.9892649929999999, 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016415272000000002, 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.024127+0000", 2024-09-17T01:56:17.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.024127+0000", 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.024129+0000", 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1270000000000001e-06 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026433+0000", 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0023038440000000002 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026480+0000", 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7132000000000002e-05 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026503+0000", 2024-09-17T01:56:17.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2736000000000001e-05 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026651+0000", 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000148436 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026792+0000", 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014033900000000001 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.026987+0000", 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019518700000000001 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.039274+0000", 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012286742999999999 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.040296+0000", 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010224850000000001 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.040426+0000", 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129956 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.040542+0000", 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011628700000000001 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:152 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.236611+0000", 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.7767812919999999, 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025623394000000001, 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236611+0000", 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236611+0000", 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236662+0000", 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1619000000000002e-05 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236736+0000", 2024-09-17T01:56:17.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3651000000000003e-05 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236759+0000", 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2506000000000001e-05 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236772+0000", 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3803e-05 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.236918+0000", 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014584900000000001 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.237073+0000", 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015463900000000001 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.244297+0000", 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072244190000000002 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.255291+0000", 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010993921 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262045+0000", 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0067536289999999997 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262170+0000", 2024-09-17T01:56:17.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000124874 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262234+0000", 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4484000000000001e-05 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:134 3.1a e49/16 3:5e41ab69:::200.00000005:head v 49'58, mlcod=49'52)", 2024-09-17T01:56:17.070 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.250578+0000", 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.7628143060000001, 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011695084, 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250578+0000", 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250578+0000", 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250579+0000", 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5370000000000001e-06 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250590+0000", 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0512e-05 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250614+0000", 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4297000000000001e-05 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250627+0000", 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2835e-05 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250800+0000", 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017289900000000001 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.250866+0000", 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6278000000000005e-05 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262184+0000", 2024-09-17T01:56:17.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011317745000000001 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.262273+0000", 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8980999999999994e-05 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:135 3.1a e49/16 3:5e41ab69:::200.00000005:head v 49'59, mlcod=49'52)", 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.251558+0000", 2024-09-17T01:56:17.075 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.7618345170000005, 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012132980999999999, 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251558+0000", 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251558+0000", 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251559+0000", 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.319e-06 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251569+0000", 2024-09-17T01:56:17.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.028e-05 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251587+0000", 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7535999999999999e-05 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251598+0000", 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.166e-05 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251656+0000", 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.7371999999999999e-05 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.251683+0000", 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7012000000000002e-05 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263547+0000", 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011864483 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263690+0000", 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014331899999999999 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(mds.0.3:136 3.1a e49/16 3:5e41ab69:::200.00000005:head v 49'60, mlcod=49'55)", 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.253994+0000", 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.7593980670000002, 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0097702989999999997, 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.080 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.253994+0000", 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.253994+0000", 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.253995+0000", 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.083e-06 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254008+0000", 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2666e-05 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254027+0000", 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9660000000000002e-05 2024-09-17T01:56:17.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254039+0000", 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1158999999999999e-05 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254120+0000", 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1483999999999994e-05 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.254148+0000", 2024-09-17T01:56:17.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.779e-05 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263697+0000", 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0095495819999999992 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.263764+0000", 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6874999999999999e-05 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:5640 4.21 4:87d83c18:::100000019f6.00000000:head [write 0~1612] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:12.264913+0000", 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 4.7484793109999996, 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0091076249999999994, 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 5640 2024-09-17T01:56:17.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264913+0000", 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264913+0000", 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264922+0000", 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8060000000000001e-06 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264932+0000", 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0967e-05 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264956+0000", 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3859e-05 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.264970+0000", 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3166999999999999e-05 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.265125+0000", 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015500799999999999 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.265385+0000", 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026015000000000001 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.265601+0000", 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021609999999999999 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.268271+0000", 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00266987 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.273759+0000", 2024-09-17T01:56:17.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0054878990000000001 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.273911+0000", 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000152876 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:12.274020+0000", 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000108923 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:164 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.244900+0000", 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.768491705, 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016673107999999999, 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.244900+0000", 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.244900+0000", 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.244903+0000", 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1030000000000002e-06 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245025+0000", 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012193000000000001 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245058+0000", 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2363000000000002e-05 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245072+0000", 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4646e-05 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245262+0000", 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018997799999999999 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.245440+0000", 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000177665 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.248229+0000", 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0027889389999999998 2024-09-17T01:56:17.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.260089+0000", 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011859553 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261314+0000", 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001225571 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261455+0000", 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000141216 2024-09-17T01:56:17.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261573+0000", 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000118144 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:7233 4.16 4:68bcb57e:::10000002107.00000000:head [write 0~2960] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.251568+0000", 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.7618243069999999, 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010011466, 2024-09-17T01:56:17.096 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 7233 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251568+0000", 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251568+0000", 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251570+0000", 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.917e-06 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251581+0000", 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1813e-05 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251609+0000", 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7512999999999999e-05 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251628+0000", 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8895000000000001e-05 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.251761+0000", 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013284399999999999 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.252235+0000", 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00047385400000000001 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.252716+0000", 2024-09-17T01:56:17.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00048142999999999998 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.254698+0000", 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019815140000000002 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261352+0000", 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066547860000000002 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261487+0000", 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000134719 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.261579+0000", 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2181000000000004e-05 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:165 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4136374 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-17T01:56:17.102 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:15.359547+0000", 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.6538448809999999, 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.036379124999999998, 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.359547+0000", 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.359547+0000", 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.359549+0000", 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4759999999999999e-06 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363536+0000", 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0039875120000000003 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363563+0000", 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7362e-05 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363575+0000", 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1068e-05 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363727+0000", 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015276600000000001 2024-09-17T01:56:17.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363808+0000", 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0587999999999995e-05 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.363925+0000", 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011665100000000001 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.385999+0000", 2024-09-17T01:56:17.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.022074755000000001 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.395791+0000", 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0097921580000000005 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.395867+0000", 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.5826000000000002e-05 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:15.395926+0000", 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8962999999999998e-05 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:168 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:16.249372+0000", 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.76402018699999996, 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.025995915000000001, 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.108 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249372+0000", 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249372+0000", 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249374+0000", 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3539999999999998e-06 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249490+0000", 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011616 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249524+0000", 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3259000000000001e-05 2024-09-17T01:56:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249539+0000", 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4943000000000001e-05 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249716+0000", 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017707899999999999 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.249858+0000", 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014280200000000001 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 2", 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.256611+0000", 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0067522299999999997 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.272379+0000", 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015768005000000002 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.275223+0000", 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002844704 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.275309+0000", 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5771000000000003e-05 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.275368+0000", 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.8607999999999999e-05 2024-09-17T01:56:17.113 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_repop(client.4468.0:7770 4.1a e50/17 4:58a75220:::1000000235e.00000000:head v 50'126, mlcod=50'124)", 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:16.264282+0000", 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.74911007100000004, 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0090681930000000004, 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264282+0000", 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264282+0000", 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264284+0000", 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.996e-06 2024-09-17T01:56:17.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264306+0000", 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2495999999999999e-05 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264343+0000", 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6356000000000002e-05 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264365+0000", 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2249999999999999e-05 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264517+0000", 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015192600000000001 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.264552+0000", 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4984999999999998e-05 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.273213+0000", 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.008661452 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.273350+0000", 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000136732 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:7786 4.23 4:c6a5c329:::10000002372.00000000:head [write 0~433] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T01:56:17.118 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:16.306235+0000", 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.70715668200000004, 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.011229426000000001, 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 7786 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306235+0000", 2024-09-17T01:56:17.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306235+0000", 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306237+0000", 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.336e-06 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306245+0000", 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.14e-06 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306263+0000", 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7923000000000001e-05 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306274+0000", 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1153e-05 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306420+0000", 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014610900000000001 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op must wait for map", 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.306437+0000", 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7363e-05 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.314003+0000", 2024-09-17T01:56:17.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0075659480000000003 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.314380+0000", 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00037622600000000001 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.314745+0000", 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00036513700000000002 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:17.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.316288+0000", 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001543282 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.317332+0000", 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0010440460000000001 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.317408+0000", 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6291000000000005e-05 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:17.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:16.317465+0000", 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.6471999999999997e-05 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:17.125 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:17.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:17.127 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:17.126+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.227 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:17.229+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:17.274 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:17.274 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:17.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4468.0:8279 4.12 e51/17 4:4a5880c3:::100000025ac.00000000:head v 51'127, mlcod=51'125)", 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:17.276695+0000", 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001066799, 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001111522, 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276695+0000", 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276695+0000", 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276696+0000", 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.268e-06 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276711+0000", 2024-09-17T01:56:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4832e-05 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276730+0000", 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9670999999999999e-05 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276744+0000", 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4035e-05 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276849+0000", 2024-09-17T01:56:17.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010433999999999999 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:17.276884+0000", 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5457999999999998e-05 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-17T01:56:17.278 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:17.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:17.305 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:17.306 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:17.328 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:17.328 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:17.329 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:17.330+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.355 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-17T01:56:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T01:56:17.430 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:17.430+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.466 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:17.467 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:17.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:17.531 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:17.530+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.611 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:17.611 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:17.626 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:17.631 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:17.633+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:17.732 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:17.734+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.763 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:17.763 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:17.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:17.868 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:17.870+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:17.934 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:17.937+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:17.958 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:17.958 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:17.974 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:18.034 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.037+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.135 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:18.134+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:18.152 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:18.152 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:18.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:18.236 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:18.238+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:18.303 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:18.303 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:18.318 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:18.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:56:18.370 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.373+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.438 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.441+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.441 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:18.441 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:18.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:18.550 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.553+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.638 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:18.638 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:18.640 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.641+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:18.741 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.741+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.794 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:18.794 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:18.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:18.842 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:18.845+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:18.943 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:18.942+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:18.944 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:18.944 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:18.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:19.056 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.058+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.139 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:19.139 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:19.143 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.146+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:19.244 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.246+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.295 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:19.295 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:19.302 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:56:19.308 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T01:56:19.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:19.366 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:19.369+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:19.374 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:19.420 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-09-17T01:56:19.447 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.446+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.455 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:19.455 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:19.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:19.540 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:19.540 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:19.548 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.550+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.560 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:19.560 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:19.560 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:19.563 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:19.564 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:19.649 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:19.649+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:19.653 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:19.654 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:19.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:19.654 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:19.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.654 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.654 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.2790838279999992, 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:19.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:19.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:19.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:19.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4600 4.2d 4:b73d992a:::100000015aa.00000000:head [write 0~6267] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:19.664 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1086411369999993, 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.728534024, 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4600 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544241+0000", 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544250+0000", 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6600000000000007e-06 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544274+0000", 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4006999999999999e-05 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544303+0000", 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8637e-05 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544322+0000", 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9357000000000001e-05 2024-09-17T01:56:19.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544546+0000", 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223802 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.544564+0000", 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8199999999999999e-05 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268542+0000", 2024-09-17T01:56:19.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.723977961 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.268794+0000", 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025118900000000002 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.269025+0000", 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023119199999999999 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272537+0000", 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035122629999999998 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272634+0000", 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7201000000000007e-05 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272721+0000", 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6567e-05 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272775+0000", 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3987999999999999e-05 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4672 4.2d 4:b407c00e:::100000015f9.00000000:head [write 0~1753] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.0317296799999998, 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.65541383900000005, 2024-09-17T01:56:19.671 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4672 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:19.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621152+0000", 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621154+0000", 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.607e-06 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621180+0000", 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5882999999999999e-05 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621204+0000", 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4573999999999999e-05 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621217+0000", 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2456999999999999e-05 2024-09-17T01:56:19.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621326+0000", 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109175 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.621344+0000", 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.789e-05 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270061+0000", 2024-09-17T01:56:19.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.64871766600000003 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270254+0000", 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000192392 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.270517+0000", 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026355699999999998 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276295+0000", 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005777412 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276427+0000", 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000131958 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276501+0000", 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4051e-05 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276566+0000", 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5216999999999996e-05 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4714 4.2d 4:b437e665:::10000001628.00000000:head [write 0~1699] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9774183720000007, 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.60310710899999997, 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4714 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675464+0000", 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675466+0000", 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1900000000000002e-06 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675478+0000", 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1956999999999999e-05 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675499+0000", 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1761000000000001e-05 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675518+0000", 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8810000000000001e-05 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675656+0000", 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013773799999999999 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.675672+0000", 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6079999999999999e-05 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272928+0000", 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.59725582399999999 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273261+0000", 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033340099999999999 2024-09-17T01:56:19.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.273625+0000", 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036354300000000003 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276407+0000", 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027817190000000002 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278409+0000", 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020029039999999998 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278502+0000", 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2263999999999996e-05 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278571+0000", 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8918000000000007e-05 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4788 4.2d 4:b4cc316c:::1000000167e.00000000:head [write 0~2170] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8801221340000005, 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50757323899999995, 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4788 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772760+0000", 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772762+0000", 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772774+0000", 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2086000000000001e-05 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772802+0000", 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8197000000000001e-05 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.772821+0000", 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8301e-05 2024-09-17T01:56:19.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773010+0000", 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189588 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.773042+0000", 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1643999999999997e-05 2024-09-17T01:56:19.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274751+0000", 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.50170971099999995 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.274979+0000", 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022755299999999999 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.275278+0000", 2024-09-17T01:56:19.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029924999999999998 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278717+0000", 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003438998 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280135+0000", 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001417349 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280219+0000", 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4036999999999995e-05 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280333+0000", 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011435800000000001 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.692 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4798 4.2d 4:b79c5810:::10000001688.00000000:head [write 0~6996] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8683212729999994, 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49795705400000001, 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.693 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4798 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784561+0000", 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784562+0000", 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.59e-06 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784584+0000", 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1997999999999998e-05 2024-09-17T01:56:19.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784604+0000", 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9383000000000001e-05 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784618+0000", 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4250000000000001e-05 2024-09-17T01:56:19.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784740+0000", 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012229400000000001 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.784756+0000", 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5741000000000001e-05 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276635+0000", 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49187889699999998 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.276961+0000", 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032572999999999999 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.277323+0000", 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036245400000000001 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282372+0000", 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050488490000000002 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282393+0000", 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282463+0000", 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9694000000000001e-05 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282518+0000", 2024-09-17T01:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5090999999999998e-05 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4799 4.2d 4:b4576620:::10000001689.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.867061133, 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49814391800000002, 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4799 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785821+0000", 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785823+0000", 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2069999999999998e-06 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785834+0000", 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0864e-05 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785865+0000", 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1513000000000001e-05 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785880+0000", 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4966999999999999e-05 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.785988+0000", 2024-09-17T01:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107394 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.786003+0000", 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5554e-05 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.278859+0000", 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.49285563100000002 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279204+0000", 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034552600000000003 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.279412+0000", 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020742199999999999 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282607+0000", 2024-09-17T01:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031956229999999999 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283821+0000", 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012134260000000001 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283902+0000", 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0851000000000002e-05 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283965+0000", 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2940000000000004e-05 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4916 4.2d 4:b65c07c8:::1000000170f.00000000:head [write 0~2630] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7211901570000006, 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.354345823, 2024-09-17T01:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4916 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931692+0000", 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931694+0000", 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.807e-06 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931703+0000", 2024-09-17T01:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8530000000000004e-06 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931721+0000", 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7997000000000001e-05 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931734+0000", 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2286999999999999e-05 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931828+0000", 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4470999999999997e-05 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.931844+0000", 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5424e-05 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280474+0000", 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34863022399999999 2024-09-17T01:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.280767+0000", 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029277300000000002 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.281100+0000", 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000333374 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285614+0000", 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004514176 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285870+0000", 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025610299999999998 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285966+0000", 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5474000000000001e-05 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286038+0000", 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1860000000000007e-05 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4923 4.2d 4:b7aaf913:::10000001717.00000000:head [write 0~1965] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7112571079999999, 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34469107700000001, 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4923 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941625+0000", 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941627+0000", 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7269999999999999e-06 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941636+0000", 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3959999999999995e-06 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941658+0000", 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2198e-05 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941670+0000", 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2353e-05 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941792+0000", 2024-09-17T01:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012115799999999999 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.941809+0000", 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282679+0000", 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.34086941199999998 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.282852+0000", 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000173492 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.283094+0000", 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024125899999999999 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.285850+0000", 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002755904 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286185+0000", 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033567800000000001 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286249+0000", 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3847e-05 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286316+0000", 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6829999999999995e-05 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4929 4.2d 4:b5acf001:::1000000171e.00000000:head [write 0~1676] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7031458710000003, 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33680069299999998, 2024-09-17T01:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4929 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949736+0000", 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949738+0000", 2024-09-17T01:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999998e-06 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949791+0000", 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2660000000000001e-05 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949822+0000", 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853999999999997e-05 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.949841+0000", 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8994000000000001e-05 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950037+0000", 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019598799999999999 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.950068+0000", 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0644e-05 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284073+0000", 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.33400524700000001 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284415+0000", 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034212100000000003 2024-09-17T01:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.284770+0000", 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035503999999999999 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286401+0000", 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00163072 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286418+0000", 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6293000000000001e-05 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286482+0000", 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4734999999999996e-05 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.286537+0000", 2024-09-17T01:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4477e-05 2024-09-17T01:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:126 3.1a 3:5e41ab69:::200.00000005:head [write 223054~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4890470899999997, 2024-09-17T01:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082452368999999998, 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163835+0000", 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163836+0000", 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0240000000000001e-06 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163846+0000", 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0530000000000001e-05 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163861+0000", 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4656e-05 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163870+0000", 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.524e-06 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234115+0000", 2024-09-17T01:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.070245611999999999 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234345+0000", 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023027799999999999 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.234701+0000", 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035562400000000002 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.238686+0000", 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039847320000000004 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246154+0000", 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074686639999999999 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246230+0000", 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6001000000000006e-05 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246287+0000", 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6724000000000001e-05 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:127 3.1a 3:5e41ab69:::200.00000005:head [write 224458~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4890018400000002, 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082535662999999995, 2024-09-17T01:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163880+0000", 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163881+0000", 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7400000000000003e-07 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163885+0000", 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0260000000000001e-06 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163894+0000", 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3640000000000005e-06 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163902+0000", 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4359999999999996e-06 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.235648+0000", 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.071746889999999994 2024-09-17T01:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.235901+0000", 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025289600000000001 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.236241+0000", 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033998900000000001 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246136+0000", 2024-09-17T01:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098946160000000002 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246301+0000", 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016531099999999999 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246366+0000", 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5151e-05 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246416+0000", 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9310000000000001e-05 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:128 3.1a 3:5e41ab69:::200.00000005:head [write 225858~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4889696729999997, 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.082823128999999995, 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163912+0000", 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163913+0000", 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7999999999999995e-07 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163922+0000", 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.38e-06 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163932+0000", 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7370000000000001e-06 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.163939+0000", 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3939999999999998e-06 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237512+0000", 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073573019000000003 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237635+0000", 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012272699999999999 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.237904+0000", 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026857699999999999 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246511+0000", 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086073959999999998 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246619+0000", 2024-09-17T01:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107831 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246684+0000", 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5284999999999996e-05 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246735+0000", 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1103000000000002e-05 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 247133~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4794130839999999, 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.088075537999999995, 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173469+0000", 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173470+0000", 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.37e-06 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173489+0000", 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9127000000000002e-05 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173513+0000", 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3577000000000001e-05 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173538+0000", 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4774e-05 2024-09-17T01:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.246939+0000", 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073401026999999994 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.247276+0000", 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033744299999999999 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.247472+0000", 2024-09-17T01:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000196052 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256084+0000", 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086122999999999998 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261238+0000", 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051537049999999997 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261423+0000", 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018525799999999999 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261544+0000", 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120905 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 249061~1929 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4793161259999996, 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.088312648999999993, 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173566+0000", 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173567+0000", 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3430000000000001e-06 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173577+0000", 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0267e-05 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173620+0000", 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.173642+0000", 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1511000000000001e-05 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248205+0000", 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074563144999999997 2024-09-17T01:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248339+0000", 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133974 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.248524+0000", 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018483200000000001 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256095+0000", 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075709640000000003 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261651+0000", 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055564209999999998 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261768+0000", 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117135 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261878+0000", 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109967 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 250990~3883 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4785268790000003, 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.087972380000000003, 2024-09-17T01:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174355+0000", 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174358+0000", 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9170000000000002e-06 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174381+0000", 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2836999999999998e-05 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174406+0000", 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4879999999999999e-05 2024-09-17T01:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.174429+0000", 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3686999999999999e-05 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250532+0000", 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.076102515999999995 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250667+0000", 2024-09-17T01:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013468200000000001 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.250956+0000", 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028952900000000001 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256101+0000", 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005145401 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262086+0000", 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005984975 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262222+0000", 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013510200000000001 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262327+0000", 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010585400000000001 2024-09-17T01:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 254873~3883 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4756446460000001, 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.085393837, 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177237+0000", 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177240+0000", 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.604e-06 2024-09-17T01:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177280+0000", 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0521e-05 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177324+0000", 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4039999999999998e-05 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.177382+0000", 2024-09-17T01:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7500000000000002e-05 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.251935+0000", 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.074552713000000007 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.252158+0000", 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000223265 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.252436+0000", 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027832600000000002 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261128+0000", 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086915900000000008 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262449+0000", 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013208060000000001 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262528+0000", 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9686999999999998e-05 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262631+0000", 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102785 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 258756~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4729923139999999, 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.083075610999999994, 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179890+0000", 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179897+0000", 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4499999999999998e-06 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179917+0000", 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9979999999999998e-05 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179942+0000", 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5449999999999999e-05 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.179964+0000", 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1897999999999999e-05 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.253718+0000", 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073753604 2024-09-17T01:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.253863+0000", 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145422 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.254047+0000", 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018408699999999999 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261923+0000", 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078755700000000001 2024-09-17T01:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262765+0000", 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084215799999999997 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262861+0000", 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5864000000000002e-05 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.262965+0000", 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104128 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 262711~5209 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4706279049999997, 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.081020272000000004, 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182254+0000", 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182271+0000", 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6629999999999998e-05 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182307+0000", 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6773000000000002e-05 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182335+0000", 2024-09-17T01:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7373999999999999e-05 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182393+0000", 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7890000000000003e-05 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.254933+0000", 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.072540224 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.255061+0000", 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012768100000000001 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.255249+0000", 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188665 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.261941+0000", 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066919019999999996 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263076+0000", 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011343740000000001 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263185+0000", 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010982800000000001 2024-09-17T01:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263274+0000", 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8931000000000006e-05 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 267920~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.4704520470000002, 2024-09-17T01:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.081300400999999994, 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182430+0000", 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182431+0000", 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5629999999999999e-06 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182442+0000", 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0747000000000001e-05 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182464+0000", 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1756999999999999e-05 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.182480+0000", 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.594e-05 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256227+0000", 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.073747264000000007 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256393+0000", 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000165565 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.256707+0000", 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031433299999999997 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263375+0000", 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066677990000000003 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263574+0000", 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198865 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263656+0000", 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2169999999999994e-05 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:12.263730+0000", 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4398000000000002e-05 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:19.791 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.790+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.792 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:19.892 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:19.894+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4.ac862fd6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.34154416700000001, 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.34156444200000002, 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.930 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4.69b484cb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.30223974199999998, 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.302304244, 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.935 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.939 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9652 4.a 4.c7fa4ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.735433+0000", 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.19477652500000001, 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.19487676100000001, 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9652 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735433+0000", 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735433+0000", 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735436+0000", 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1700000000000001e-06 2024-09-17T01:56:19.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735485+0000", 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.8943000000000002e-05 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735515+0000", 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9728999999999999e-05 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735541+0000", 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6761999999999999e-05 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735679+0000", 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013787399999999999 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.735693+0000", 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3916e-05 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.943 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9734 4.0 4.ce77eb80 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.849552+0000", 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.080657485000000001, 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.080792712000000003, 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.944 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9734 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849552+0000", 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849552+0000", 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.945 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849553+0000", 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2079999999999999e-06 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849570+0000", 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6908000000000001e-05 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849588+0000", 2024-09-17T01:56:19.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8196999999999999e-05 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849598+0000", 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6479999999999998e-06 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849702+0000", 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104584 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.849710+0000", 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3830000000000003e-06 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9653 4.16 4.7ed23a56 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.948 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.736769+0000", 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.19343974799999999, 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.193610277, 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9653 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736769+0000", 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736769+0000", 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736771+0000", 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6640000000000001e-06 2024-09-17T01:56:19.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736796+0000", 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4915000000000001e-05 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736819+0000", 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3300000000000001e-05 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736832+0000", 2024-09-17T01:56:19.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2782999999999999e-05 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736953+0000", 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120883 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.736970+0000", 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.715e-05 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.952 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9615 4.0 4.cd091680 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.676375+0000", 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.25383418800000002, 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.25403922600000001, 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.953 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9615 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676375+0000", 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676375+0000", 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676377+0000", 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1799999999999999e-06 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676394+0000", 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6492000000000001e-05 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676419+0000", 2024-09-17T01:56:19.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.544e-05 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676432+0000", 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3086e-05 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676529+0000", 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.6691e-05 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.676542+0000", 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3226e-05 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9696 4.11 4.f1c61491 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.797308+0000", 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.13290137399999999, 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.13314109499999999, 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.957 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9696 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797308+0000", 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797308+0000", 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797310+0000", 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.08e-06 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797323+0000", 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2999999999999999e-05 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797346+0000", 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2693000000000001e-05 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797364+0000", 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7926000000000001e-05 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797493+0000", 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129713 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.797516+0000", 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2277e-05 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4.329263a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.29913690500000001, 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.299430223, 2024-09-17T01:56:19.961 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:19.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9655 4.2b 4.eb1394ab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.965 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.739417+0000", 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.190792564, 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.19112130299999999, 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9655 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739417+0000", 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739417+0000", 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739419+0000", 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2400000000000002e-06 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739457+0000", 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8123000000000001e-05 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739489+0000", 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2295000000000002e-05 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739505+0000", 2024-09-17T01:56:19.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6124e-05 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739624+0000", 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011834 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.739638+0000", 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4e-05 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9697 4.16 4.243fc156 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.798517+0000", 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.13169245700000001, 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.13205588600000001, 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9697 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.970 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798517+0000", 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798517+0000", 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798519+0000", 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.813e-06 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798534+0000", 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5126999999999999e-05 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798558+0000", 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4159e-05 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798570+0000", 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2432999999999999e-05 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798716+0000", 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000145313 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.798733+0000", 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7033000000000001e-05 2024-09-17T01:56:19.973 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9698 4.30 4.2da476f0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.799787+0000", 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.130421852, 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.13081948800000001, 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.974 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9698 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.799787+0000", 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.799787+0000", 2024-09-17T01:56:19.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.799789+0000", 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.137e-06 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.799808+0000", 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8213e-05 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.799839+0000", 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1689000000000001e-05 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.799854+0000", 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4739999999999999e-05 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.800007+0000", 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000153072 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.800035+0000", 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7376e-05 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.978 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4.9190801a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.33751481, 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.33794691599999999, 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:19.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:19.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:19.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9621 4.a 4.f2ddb0ca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.683525+0000", 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.24668417500000001, 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.247150605, 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.983 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9621 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683525+0000", 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683525+0000", 2024-09-17T01:56:19.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683527+0000", 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1770000000000001e-06 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683546+0000", 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8468999999999999e-05 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683577+0000", 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1628999999999998e-05 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683592+0000", 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.45e-05 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683710+0000", 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011862300000000001 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.683724+0000", 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3370000000000001e-05 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9659 4.2b 4.aca189ab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.744651+0000", 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.185557846, 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.18605877200000001, 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.987 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9659 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744651+0000", 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744651+0000", 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744654+0000", 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.57e-06 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744697+0000", 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3046000000000001e-05 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744733+0000", 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6338999999999999e-05 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744757+0000", 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3604999999999998e-05 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744908+0000", 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015152699999999999 2024-09-17T01:56:19.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.744938+0000", 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9359000000000001e-05 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9700 4.35 4.44fda975 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.803395+0000", 2024-09-17T01:56:19.991 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.12681445699999999, 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.12735364299999999, 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9700 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803395+0000", 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803395+0000", 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803398+0000", 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4189999999999998e-06 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803414+0000", 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5690000000000001e-05 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803447+0000", 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3358999999999997e-05 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803470+0000", 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2379999999999999e-05 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803568+0000", 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.8319999999999994e-05 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.803582+0000", 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3664e-05 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.995 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9660 4.0 4.d7550b80 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.746063+0000", 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.18414598800000001, 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.18471969799999999, 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9660 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:19.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746063+0000", 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746063+0000", 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746065+0000", 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5939999999999999e-06 2024-09-17T01:56:19.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746089+0000", 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4658999999999999e-05 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746112+0000", 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2310000000000002e-05 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746124+0000", 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2029e-05 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746254+0000", 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000130643 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:19.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.746271+0000", 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6990000000000002e-05 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9701 4.a 4.e37afe8a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.804481+0000", 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.125728647, 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.12633631400000001, 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.000 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9701 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804481+0000", 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804481+0000", 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804482+0000", 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.776e-06 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804502+0000", 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9646000000000001e-05 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804520+0000", 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7887e-05 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804534+0000", 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4316e-05 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804679+0000", 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014465999999999999 2024-09-17T01:56:20.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.804706+0000", 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6695000000000001e-05 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.009 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9702 4.16 4.2a295d56 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.806912+0000", 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.123297137, 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.123938672, 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9702 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.010 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.806912+0000", 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.806912+0000", 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.806914+0000", 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.806926+0000", 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1642e-05 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.806957+0000", 2024-09-17T01:56:20.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1463e-05 2024-09-17T01:56:20.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.806974+0000", 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7013000000000001e-05 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.807089+0000", 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011420499999999999 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.807102+0000", 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3084999999999999e-05 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4.33a3fec0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.29328446000000002, 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.29396013500000001, 2024-09-17T01:56:20.016 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:20.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:20.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9625 4.3c 4.17c87c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.691449+0000", 2024-09-17T01:56:20.020 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.23876038399999999, 2024-09-17T01:56:20.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.239470084, 2024-09-17T01:56:20.021 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.021 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.021 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.021 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.021 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9625 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691449+0000", 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691449+0000", 2024-09-17T01:56:20.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691451+0000", 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4360000000000001e-06 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691471+0000", 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9596999999999999e-05 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691509+0000", 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8288999999999999e-05 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691527+0000", 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7805999999999999e-05 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691642+0000", 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011505700000000001 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.691656+0000", 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4256e-05 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9626 4.0 4.c5b16bc0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.692691+0000", 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.23751814099999999, 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.23826211999999999, 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.025 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9626 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692691+0000", 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692691+0000", 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692693+0000", 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.216e-06 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692712+0000", 2024-09-17T01:56:20.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8289999999999999e-05 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692744+0000", 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2234999999999999e-05 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692763+0000", 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9653999999999999e-05 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692889+0000", 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012549999999999999 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.692906+0000", 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6895999999999999e-05 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9663 4.1b 4.4499d11b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.029 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.749551+0000", 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.180658177, 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.18143638500000001, 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9663 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749551+0000", 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749551+0000", 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749553+0000", 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.057e-06 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749583+0000", 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9604999999999999e-05 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749611+0000", 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8276000000000002e-05 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749631+0000", 2024-09-17T01:56:20.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0253000000000001e-05 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749793+0000", 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016186299999999999 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.749818+0000", 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5262e-05 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.033 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9706 4.17 4.96c4b157 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.813324+0000", 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.116884902, 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.117697653, 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.034 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9706 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813324+0000", 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813324+0000", 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813327+0000", 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6529999999999998e-06 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813352+0000", 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5326000000000001e-05 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813384+0000", 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1615999999999997e-05 2024-09-17T01:56:20.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813398+0000", 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4506e-05 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813514+0000", 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115361 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.813521+0000", 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.7260000000000002e-06 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9589 4.35 4.f7f2c075 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.640374+0000", 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.28983504599999999, 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.29068195499999999, 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.038 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9589 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640374+0000", 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640374+0000", 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640376+0000", 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.137e-06 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640396+0000", 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9893000000000001e-05 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640423+0000", 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7143000000000001e-05 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640437+0000", 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3396e-05 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640553+0000", 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000116167 2024-09-17T01:56:20.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.640567+0000", 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3963e-05 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9709 4.1a 4.d7b2f15a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.818029+0000", 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.112179762, 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.113060682, 2024-09-17T01:56:20.042 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9709 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818029+0000", 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818029+0000", 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818031+0000", 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8390000000000001e-06 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818041+0000", 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7249999999999992e-06 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818069+0000", 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7837000000000001e-05 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818082+0000", 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2961e-05 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818230+0000", 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014861599999999999 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.818259+0000", 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8895999999999999e-05 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4.4303a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.046 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.37620305300000001, 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.37711866100000002, 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:20.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4.c28707ec (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.33118925300000002, 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.33213917900000001, 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:20.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.054 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9630 4.29 4.c61c3a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.698764+0000", 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.23144532200000001, 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.232429619, 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9630 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698764+0000", 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698764+0000", 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698766+0000", 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1629999999999999e-06 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698785+0000", 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9383000000000001e-05 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698817+0000", 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1939e-05 2024-09-17T01:56:20.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698832+0000", 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4346e-05 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698952+0000", 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000120647 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.698966+0000", 2024-09-17T01:56:20.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3519999999999999e-05 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9710 4.20 4.863f23e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.820232+0000", 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.10997731199999999, 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.11100407499999999, 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.059 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9710 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820232+0000", 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820232+0000", 2024-09-17T01:56:20.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820234+0000", 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6899999999999999e-06 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820243+0000", 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5540000000000003e-06 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820266+0000", 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3095000000000002e-05 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820278+0000", 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1707e-05 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820417+0000", 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013925499999999999 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.820444+0000", 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6919000000000001e-05 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9631 4.3c 4.d85f783c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.699835+0000", 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.23037431899999999, 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.231435419, 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.063 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9631 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.699835+0000", 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.699835+0000", 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.699837+0000", 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1270000000000001e-06 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.699855+0000", 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8182999999999999e-05 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.699886+0000", 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1186000000000003e-05 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.699901+0000", 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4586000000000001e-05 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.700005+0000", 2024-09-17T01:56:20.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104511 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.700023+0000", 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7090000000000001e-05 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9667 4.11 4.d7346c11 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.754987+0000", 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.175222561, 2024-09-17T01:56:20.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.176317692, 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9667 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.754987+0000", 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.754987+0000", 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.754989+0000", 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6129999999999998e-06 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.755035+0000", 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5506000000000001e-05 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.755060+0000", 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5139000000000001e-05 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.755079+0000", 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9352999999999999e-05 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.755185+0000", 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010529100000000001 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.755202+0000", 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7414999999999998e-05 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9711 4.2c 4.d47407ac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.821267+0000", 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.10894245900000001, 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.110072451, 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9711 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821267+0000", 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821267+0000", 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821268+0000", 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5290000000000001e-06 2024-09-17T01:56:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821277+0000", 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4120000000000001e-06 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821298+0000", 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1416999999999998e-05 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821309+0000", 2024-09-17T01:56:20.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1382e-05 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821417+0000", 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000107172 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.821425+0000", 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9899999999999997e-06 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.075 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4.d9b7d8f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.32799860800000002, 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.32916366400000002, 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.076 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9591 4.3c 4.7f0e7fc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.643855+0000", 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.28635399099999997, 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.28755322100000003, 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9591 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.643855+0000", 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.643855+0000", 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.643858+0000", 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5129999999999999e-06 2024-09-17T01:56:20.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.643892+0000", 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3899000000000002e-05 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.643933+0000", 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1545999999999998e-05 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.643952+0000", 2024-09-17T01:56:20.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9076000000000002e-05 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644058+0000", 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010526099999999999 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644072+0000", 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4269e-05 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9668 4.3a 4.e5e888ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.756027+0000", 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.17418252000000001, 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.1754165, 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.085 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9668 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756027+0000", 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756027+0000", 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756028+0000", 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6729999999999999e-06 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756038+0000", 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.8360000000000004e-06 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756062+0000", 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3620000000000001e-05 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756075+0000", 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2948999999999999e-05 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756255+0000", 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000180416 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.756280+0000", 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4919e-05 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9748 4.b 4.22c886cb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.872337+0000", 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.057872227999999998, 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.059140845999999997, 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.089 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9748 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872337+0000", 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872337+0000", 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872338+0000", 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1200000000000001e-06 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872344+0000", 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3149999999999997e-06 2024-09-17T01:56:20.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872360+0000", 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5826999999999999e-05 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872367+0000", 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2409999999999998e-06 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872431+0000", 2024-09-17T01:56:20.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3604999999999998e-05 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.872438+0000", 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8279999999999997e-06 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4.60c8edbc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.32684295699999999, 2024-09-17T01:56:20.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.32814632100000002, 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:20.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.097 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9592 4.11 4.f176a351 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.644917+0000", 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.28529264100000001, 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.28663019200000001, 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9592 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644917+0000", 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644917+0000", 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644919+0000", 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1430000000000001e-06 2024-09-17T01:56:20.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644930+0000", 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.115e-05 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644962+0000", 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1662999999999998e-05 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.644976+0000", 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4250000000000001e-05 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.645116+0000", 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000140569 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.645134+0000", 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7317e-05 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.101 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4.fba1e26c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.37140137600000001, 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.37277333699999998, 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:20.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:20.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:20.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9634 4.26 4.ae1643a6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.704425+0000", 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.22578456899999999, 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.22719074, 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9634 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704425+0000", 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704425+0000", 2024-09-17T01:56:20.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704427+0000", 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0099999999999998e-06 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704438+0000", 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1507e-05 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704471+0000", 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2808999999999997e-05 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704489+0000", 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7995999999999998e-05 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704639+0000", 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014970700000000001 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.704657+0000", 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8065999999999999e-05 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9750 4.38 4.db6a6b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.875566+0000", 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.054642917999999999, 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.056083284999999997, 2024-09-17T01:56:20.110 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9750 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875566+0000", 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875566+0000", 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875567+0000", 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8700000000000004e-07 2024-09-17T01:56:20.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875574+0000", 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9789999999999996e-06 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875585+0000", 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0815000000000001e-05 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875590+0000", 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3079999999999998e-06 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875667+0000", 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6674000000000005e-05 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.875675+0000", 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8339999999999999e-06 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.114 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4.6e46886c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.32476961799999998, 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.32624462399999998, 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:20.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:20.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9636 4.16 4.2c500596 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.708255+0000", 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.221954553, 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.223463789, 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9636 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708255+0000", 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708255+0000", 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708257+0000", 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708277+0000", 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9868999999999999e-05 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708309+0000", 2024-09-17T01:56:20.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2073000000000003e-05 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708323+0000", 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4569999999999999e-05 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708469+0000", 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014610299999999999 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.708486+0000", 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6809000000000001e-05 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9670 4.26 4.c8930de6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.759184+0000", 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.171025439, 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.17256880399999999, 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.123 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9670 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759184+0000", 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759184+0000", 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759187+0000", 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7360000000000001e-06 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759218+0000", 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1356999999999998e-05 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759246+0000", 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7759e-05 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759260+0000", 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4346e-05 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759363+0000", 2024-09-17T01:56:20.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102814 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.759377+0000", 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3896999999999999e-05 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9752 4.17 4.dfa084d7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.877968+0000", 2024-09-17T01:56:20.127 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.052241498999999997, 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.053823478000000001, 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9752 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.877968+0000", 2024-09-17T01:56:20.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.877968+0000", 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.877969+0000", 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1340000000000001e-06 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.877975+0000", 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5100000000000004e-06 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.877991+0000", 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5396999999999998e-05 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.877998+0000", 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.8449999999999997e-06 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.878064+0000", 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5920999999999994e-05 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.878079+0000", 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5255999999999999e-05 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.131 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4.5f9dd27c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.36832887800000003, 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.36994539199999998, 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.132 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9715 4.3a 4.570b913a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.827812+0000", 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.102397236, 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.104049851, 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.136 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9715 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827812+0000", 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827812+0000", 2024-09-17T01:56:20.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827813+0000", 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4759999999999999e-06 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827821+0000", 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1659999999999997e-06 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827843+0000", 2024-09-17T01:56:20.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1974999999999999e-05 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827854+0000", 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1481000000000001e-05 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.827998+0000", 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000143659 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.828020+0000", 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2753000000000001e-05 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4.86bff14a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.36639272299999998, 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.36807984999999999, 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:20.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9639 4.17 4.70ec47d7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.711939+0000", 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.21826978999999999, 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.21999121699999999, 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.144 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9639 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.711939+0000", 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.711939+0000", 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.711942+0000", 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1430000000000001e-06 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.711960+0000", 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8355999999999998e-05 2024-09-17T01:56:20.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.712048+0000", 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8313999999999995e-05 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.712075+0000", 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7022999999999999e-05 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.712216+0000", 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014047300000000001 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.712238+0000", 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9717 4.29 4.3bb48a9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.830245+0000", 2024-09-17T01:56:20.148 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.099963786999999998, 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.101720164, 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9717 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830245+0000", 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830245+0000", 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830247+0000", 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.432e-06 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830255+0000", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4649999999999994e-06 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830277+0000", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1704000000000001e-05 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830288+0000", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1274000000000001e-05 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830358+0000", 2024-09-17T01:56:20.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9567000000000007e-05 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.830366+0000", 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.2130000000000008e-06 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9602 4.16 4.d962b256 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.659744+0000", 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.27046538399999998, 2024-09-17T01:56:20.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.27225613799999998, 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9602 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.659744+0000", 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.659744+0000", 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.659746+0000", 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.243e-06 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.659765+0000", 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9236e-05 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.659798+0000", 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2373000000000003e-05 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.659812+0000", 2024-09-17T01:56:20.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4543e-05 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.660002+0000", 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018996799999999999 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.660020+0000", 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7363999999999998e-05 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.156 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9675 4.20 4.3e65be60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.765201+0000", 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.16500870400000001, 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.16683388900000001, 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.157 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9675 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765201+0000", 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765201+0000", 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765203+0000", 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7030000000000002e-06 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765236+0000", 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2589000000000003e-05 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765271+0000", 2024-09-17T01:56:20.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5018999999999998e-05 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765285+0000", 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4430000000000001e-05 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765410+0000", 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000124764 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.765424+0000", 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4175999999999999e-05 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9718 4.39 4.356bb739 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.831285+0000", 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.098923922999999997, 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.100783414, 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.161 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9718 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831285+0000", 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831285+0000", 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831287+0000", 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4360000000000001e-06 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831299+0000", 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2265e-05 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831319+0000", 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9868e-05 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831330+0000", 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0669999999999999e-05 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831445+0000", 2024-09-17T01:56:20.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115127 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.831464+0000", 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9259e-05 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9756 4.3a 4.5db7287a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.882636+0000", 2024-09-17T01:56:20.165 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.047573523999999999, 2024-09-17T01:56:20.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.049467255000000002, 2024-09-17T01:56:20.166 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.168 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9756 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882636+0000", 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882636+0000", 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882636+0000", 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9400000000000005e-07 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882641+0000", 2024-09-17T01:56:20.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0579999999999997e-06 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882654+0000", 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2227e-05 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882660+0000", 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.1410000000000002e-06 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882813+0000", 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000153227 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.882836+0000", 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3255999999999999e-05 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4.7b541e6c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.172 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:20.173 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.36441101799999998, 2024-09-17T01:56:20.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.366339307, 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:20.179 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9604 4.c 4.d8c011cc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.662337+0000", 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.26787173800000003, 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.26983438300000001, 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.180 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9604 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662337+0000", 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662337+0000", 2024-09-17T01:56:20.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662340+0000", 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1730000000000002e-06 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662358+0000", 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.874e-05 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662390+0000", 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1888999999999999e-05 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662406+0000", 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6140000000000001e-05 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662543+0000", 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137019 2024-09-17T01:56:20.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.662557+0000", 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3773e-05 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9677 4.35 4.6ce182f5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.767480+0000", 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.16272921000000001, 2024-09-17T01:56:20.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.16476985499999999, 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9677 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767480+0000", 2024-09-17T01:56:20.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767480+0000", 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767482+0000", 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0660000000000002e-06 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767506+0000", 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.357e-05 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767531+0000", 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5761999999999998e-05 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767545+0000", 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3529999999999999e-05 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767682+0000", 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013667 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.767709+0000", 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7212999999999998e-05 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4.9d130c4a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.31766878999999998, 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.31974477000000001, 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:20.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.192 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4.983bf60b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.36115746500000001, 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.363269809, 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.193 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.194 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:20.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9643 4.11 4.3f986151 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.718248+0000", 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.21196145699999999, 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.21410981800000001, 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.197 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9643 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718248+0000", 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718248+0000", 2024-09-17T01:56:20.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718250+0000", 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.323e-06 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718275+0000", 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4736000000000002e-05 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718314+0000", 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.8872999999999999e-05 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718334+0000", 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0506e-05 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718437+0000", 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000102351 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.718472+0000", 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5182000000000003e-05 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9679 4.39 4.cdcb5039 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.769986+0000", 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.16022319500000001, 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.16240602300000001, 2024-09-17T01:56:20.201 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9679 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.769986+0000", 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.769986+0000", 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.769988+0000", 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.886e-06 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.770019+0000", 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.0995999999999999e-05 2024-09-17T01:56:20.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.770051+0000", 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1662000000000003e-05 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.770069+0000", 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8487000000000001e-05 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.770181+0000", 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000112174 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.770204+0000", 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2408999999999998e-05 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9721 4.20 4.fa56560 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.834371+0000", 2024-09-17T01:56:20.205 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.095838335999999996, 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.098057871000000005, 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9721 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834371+0000", 2024-09-17T01:56:20.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834371+0000", 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834372+0000", 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.477e-06 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834380+0000", 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.4220000000000003e-06 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834397+0000", 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7435000000000002e-05 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834408+0000", 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.062e-05 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834489+0000", 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1001999999999995e-05 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.834497+0000", 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9149999999999996e-06 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.209 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9608 4.29 4.5e293a69 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.668281+0000", 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.26192842500000002, 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.26418254600000002, 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9608 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668281+0000", 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668281+0000", 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668283+0000", 2024-09-17T01:56:20.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2800000000000002e-06 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668301+0000", 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8303000000000001e-05 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668329+0000", 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7379e-05 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.212 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668376+0000", 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7658999999999999e-05 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668515+0000", 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013906699999999999 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.668539+0000", 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3702000000000001e-05 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.213 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9645 4.11 4.a1e06c51 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.722371+0000", 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.207838579, 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.21012904900000001, 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.214 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9645 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722371+0000", 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722371+0000", 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722373+0000", 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1730000000000002e-06 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722384+0000", 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1647e-05 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722418+0000", 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3945000000000001e-05 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722437+0000", 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8104000000000001e-05 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722566+0000", 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012962 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.722583+0000", 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9680 4.b 4.634eee4b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.771358+0000", 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.15885160600000001, 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.16117683899999999, 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9680 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771358+0000", 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771358+0000", 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771360+0000", 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5969999999999999e-06 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771396+0000", 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5751999999999999e-05 2024-09-17T01:56:20.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771432+0000", 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5942000000000002e-05 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771457+0000", 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5550000000000001e-05 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771603+0000", 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014573 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.771623+0000", 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9706000000000001e-05 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9724 4.c 4.4f2ee60c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.837560+0000", 2024-09-17T01:56:20.222 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.092648963000000001, 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.095010410000000003, 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9724 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837560+0000", 2024-09-17T01:56:20.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837560+0000", 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837562+0000", 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.347e-06 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.224 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837570+0000", 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.405e-06 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837589+0000", 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8941e-05 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837599+0000", 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0516999999999999e-05 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837681+0000", 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1858000000000001e-05 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.837689+0000", 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6290000000000001e-06 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.226 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9646 4.26 4.166d9526 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.724948+0000", 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.205260836, 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.20765884700000001, 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9646 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.724948+0000", 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.724948+0000", 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.724951+0000", 2024-09-17T01:56:20.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.724962+0000", 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.724993+0000", 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1569999999999998e-05 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.725011+0000", 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7975e-05 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.725168+0000", 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015619000000000001 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.725182+0000", 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4739999999999999e-05 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.230 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9682 4.0 4.67579300 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.774992+0000", 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.155217089, 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.157649711, 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.231 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9682 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.774992+0000", 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.774992+0000", 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.774994+0000", 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9599999999999999e-06 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.775010+0000", 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5553000000000002e-05 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.775031+0000", 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1696e-05 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.775042+0000", 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.116e-05 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.775157+0000", 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000114183 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.775171+0000", 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3827e-05 2024-09-17T01:56:20.234 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4.eb8e5dcc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.31241980000000003, 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.31488834500000001, 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.235 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:20.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9729 4.1e 4.8277a15e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.843005+0000", 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.087203837000000006, 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.089706892999999996, 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.239 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9729 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843005+0000", 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843005+0000", 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843007+0000", 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.26e-06 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843014+0000", 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.2790000000000001e-06 2024-09-17T01:56:20.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843029+0000", 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5281000000000002e-05 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843039+0000", 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5929999999999995e-06 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843208+0000", 2024-09-17T01:56:20.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016916199999999999 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.843222+0000", 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3927000000000001e-05 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4.60b3510c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.31122577299999998, 2024-09-17T01:56:20.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.31376611500000001, 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:20.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.247 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9687 4.20 4.560fd6a0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.783077+0000", 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.147132069, 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.14970676599999999, 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9687 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783077+0000", 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783077+0000", 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783079+0000", 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2900000000000001e-06 2024-09-17T01:56:20.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783093+0000", 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3135999999999999e-05 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783125+0000", 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2799000000000002e-05 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783140+0000", 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4866e-05 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783295+0000", 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015497699999999999 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.783324+0000", 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8518999999999999e-05 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.251 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9730 4.0 4.f1360f40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.845230+0000", 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.084979334000000004, 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.087588484999999994, 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9730 2024-09-17T01:56:20.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845230+0000", 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845230+0000", 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845231+0000", 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.085e-06 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845238+0000", 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9890000000000003e-06 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845257+0000", 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8856e-05 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845267+0000", 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0135e-05 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845397+0000", 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000129703 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.845414+0000", 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6966999999999999e-05 2024-09-17T01:56:20.255 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9688 4.38 4.f1268a38 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.785534+0000", 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.14467551000000001, 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.147318913, 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9688 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785534+0000", 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785534+0000", 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785536+0000", 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0260000000000002e-06 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785547+0000", 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.11e-05 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785573+0000", 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5890000000000001e-05 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785586+0000", 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3003000000000001e-05 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785706+0000", 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012048300000000001 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.785727+0000", 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.065e-05 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4.d03e5535 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.350712947, 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.35339087299999999, 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.260 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:20.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9612 4.11 4.718d8311 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.672908+0000", 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.257301526, 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.26001397300000001, 2024-09-17T01:56:20.264 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9612 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.672908+0000", 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.672908+0000", 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.672910+0000", 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1239999999999999e-06 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.672927+0000", 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6922000000000002e-05 2024-09-17T01:56:20.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.672962+0000", 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5729000000000003e-05 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.672980+0000", 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7790000000000001e-05 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.673157+0000", 2024-09-17T01:56:20.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017701899999999999 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.673174+0000", 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7003e-05 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9731 4.c 4.74d30b0c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.846284+0000", 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.083925493000000004, 2024-09-17T01:56:20.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.086672621000000005, 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9731 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846284+0000", 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846284+0000", 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846285+0000", 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1349999999999999e-06 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846292+0000", 2024-09-17T01:56:20.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.922e-06 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846311+0000", 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9068000000000001e-05 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846321+0000", 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0097e-05 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846439+0000", 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000118343 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.846446+0000", 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.1500000000000002e-06 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4.c5adc369 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:20.272 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.30462134000000002, 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.30740318700000002, 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:20.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9732 4.11 4.eff31391 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.847295+0000", 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.082914007999999997, 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.085730197999999994, 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9732 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847295+0000", 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847295+0000", 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847297+0000", 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3260000000000001e-06 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847308+0000", 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1080000000000001e-05 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847325+0000", 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7544999999999999e-05 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847335+0000", 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7049999999999994e-06 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847389+0000", 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4113000000000002e-05 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.847398+0000", 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6230000000000003e-06 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9733 4.38 4.d042c1f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.848365+0000", 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.081844129000000002, 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.084695461, 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.281 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for peered", 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9733 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848365+0000", 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848365+0000", 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848366+0000", 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.173e-06 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848380+0000", 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3969e-05 2024-09-17T01:56:20.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848398+0000", 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7864999999999999e-05 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848408+0000", 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.5570000000000001e-06 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848514+0000", 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010635400000000001 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.848522+0000", 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8490000000000006e-06 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 80 2024-09-17T01:56:20.285 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:20.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-17T01:56:20.287 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:20.288 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:20.286+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:20.387 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:20.386+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:20.471 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:20.472 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:20.472 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:20.472 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:20.472 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:20.486 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:20.532 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:20.534+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:20.589 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:20.589+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:20.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.1107818549999999, 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:20.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:20.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:20.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.105980178, 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.668 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:20.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.673 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.1029076799999999, 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.674 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:20.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:20.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:20.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:20.680 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.1009715250000001, 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:20.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:20.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.686 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0989898199999999, 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.687 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:20.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0957362669999999, 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.693 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:20.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.085291749, 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.076122969, 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.072093612, 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0657680549999999, 2024-09-17T01:56:20.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:20.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:20.723 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0625774100000001, 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.724 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:20.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:20.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.729 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0614217589999999, 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.730 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:20.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:20.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0593484200000001, 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.736 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:20.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:20.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0522475920000001, 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.742 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:20.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0469986019999999, 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.748 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:20.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:20.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.045804575, 2024-09-17T01:56:20.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:20.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:20.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:20.760 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0392001420000001, 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:20.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:20.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:20.766 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.036818544, 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:20.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:20.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.772 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.033715707, 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:20.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:20.778 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 1.0278632619999999, 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:20.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:20.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:20.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:20.784 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:20.786 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:20.786 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:20.786+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:20.887 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:20.889+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:20.919 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:20.919 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:20.920 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:20.920 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:20.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:20.988 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:20.989+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.089 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:21.089+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.119 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:21.119 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:21.119 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:21.119 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:21.119 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:21.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:21.226 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:21.229+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.291 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:21.290+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:21.312 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.93716568, 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:21.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:21.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:21.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.739169599, 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:21.320 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:21.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:21.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.738286346, 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.326 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:21.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:21.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.736286827, 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:21.332 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.735230117, 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7321517850000001, 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7302462680000001, 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7280125710000001, 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7270764349999999, 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.705123937, 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7020779290000001, 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.6968855220000001, 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.691525978, 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.687053403, 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.675541194, 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.667590004, 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.663271553, 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.6585313070000001, 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.656049619, 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.6550543960000001, 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:21.435 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:21.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:56:21.437 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:21.437+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:21.537 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:21.541+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:21.571 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:21.571 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:21.571 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:21.571 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:21.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:21.639 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:21.638+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:21.726 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:21.726 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:21.726 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:21.726 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:21.726 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:21.734 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:21.734 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:21.739 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:21.738+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:21.742 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:21.760 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:21.760 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:21.760 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:21.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:21.764 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:21.841 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:21.841+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.942 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:21.945+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:21.949 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:21.950 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:21.966 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:22.043 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:22.045+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:22.108 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:22.109 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:22.122 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:56:22.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:22.126 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:56:22.126 INFO:tasks.workunit.client.0.smithi063.stderr:+ make 2024-09-17T01:56:22.144 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:22.150+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:22.245 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:22.250+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:22.245 INFO:tasks.workunit.client.0.smithi063.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:56:22.300 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:22.300 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:22.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:22.327 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:56:22.362 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:22.365+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:22.436 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:22.436 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:22.448 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:22.454+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:22.450 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:22.549 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:22.549+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:22.580 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:22.580 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:22.595 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:22.639 INFO:tasks.workunit.client.0.smithi063.stderr:++ readlink -f fsstress 2024-09-17T01:56:22.641 INFO:tasks.workunit.client.0.smithi063.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:56:22.641 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2024-09-17T01:56:22.642 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:56:22.642 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2024-09-17T01:56:22.643 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:56:22.643 INFO:tasks.workunit.client.0.smithi063.stderr:++ mktemp -d -p . 2024-09-17T01:56:22.644 INFO:tasks.workunit.client.0.smithi063.stderr:+ T=./tmp.bsDRrR7LpP 2024-09-17T01:56:22.644 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.bsDRrR7LpP -l 1 -n 1000 -p 10 -v 2024-09-17T01:56:22.647 INFO:tasks.workunit.client.0.smithi063.stdout:seed = 1726026795 2024-09-17T01:56:22.649 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:22.654+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:22.650 INFO:tasks.workunit.client.0.smithi063.stdout:9/0: chown . 183387130 1 2024-09-17T01:56:22.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/0: creat f0 x:0 0 0 2024-09-17T01:56:22.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/1: mkdir d1 0 2024-09-17T01:56:22.650 INFO:tasks.workunit.client.0.smithi063.stdout:2/0: write - no filename 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:9/1: mknod c0 0 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/1: chown . 892917635 1 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/2: fsync - no filename 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/3: dread - no filename 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/4: stat - no entries 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/0: mkdir d0 0 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/1: dread - no filename 2024-09-17T01:56:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/2: write - no filename 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/0: truncate - no filename 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/1: rmdir - no directory 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/2: dread - no filename 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:0/2: creat d1/f2 x:0 0 0 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:1/3: mknod d0/c1 0 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:1/4: dwrite - no filename 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:4/0: write - no filename 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:4/1: readlink - no filename 2024-09-17T01:56:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:4/2: dwrite - no filename 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:1/5: chown d0 35 1 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:9/2: link c0 c1 0 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:0/3: mkdir d1/d3 0 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/3: getdents . 0 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/0: rmdir - no directory 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/4: truncate - no filename 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/5: write - no filename 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/1: rmdir - no directory 2024-09-17T01:56:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:4/3: creat f0 x:0 0 0 2024-09-17T01:56:22.656 INFO:tasks.workunit.client.0.smithi063.stdout:6/0: truncate - no filename 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:9/3: unlink c0 0 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:6/1: chown . 84 1 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/6: creat d0/f2 x:0 0 0 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:7/0: chown . 255452 1 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/7: dread - d0/f2 zero size 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:4/4: write f0 [821312,44269] 0 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:0/4: creat d1/d3/f4 x:0 0 0 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/6: creat f0 x:0 0 0 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:5/2: mknod c0 0 2024-09-17T01:56:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:5/3: write - no filename 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:6/2: symlink l0 0 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:3/7: dread - f0 zero size 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/8: chown d0/c1 37 1 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:9/4: chown c1 738378 1 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:0/5: symlink d1/l5 0 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/4: unlink c0 0 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/5: fsync - no filename 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/6: write - no filename 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/7: rename - no filename 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:6/3: creat f1 x:0 0 0 2024-09-17T01:56:22.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/1: mknod c0 0 2024-09-17T01:56:22.659 INFO:tasks.workunit.client.0.smithi063.stdout:5/8: chown . 3 1 2024-09-17T01:56:22.659 INFO:tasks.workunit.client.0.smithi063.stdout:5/9: fdatasync - no filename 2024-09-17T01:56:22.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/9: write d0/f2 [1038467,70831] 0 2024-09-17T01:56:22.659 INFO:tasks.workunit.client.0.smithi063.stdout:3/8: symlink l1 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/4: rename l0 to l2 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:5/10: creat f1 x:0 0 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:7/2: creat f1 x:0 0 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:0/6: write d1/d3/f4 [403789,120607] 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:8/0: getdents . 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:9/5: rename c1 to c2 0 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:8/1: dwrite - no filename 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:8/2: fdatasync - no filename 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:8/3: readlink - no filename 2024-09-17T01:56:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/5: link f1 f3 0 2024-09-17T01:56:22.662 INFO:tasks.workunit.client.0.smithi063.stdout:0/7: dread - f0 zero size 2024-09-17T01:56:22.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/6: symlink l3 0 2024-09-17T01:56:22.662 INFO:tasks.workunit.client.0.smithi063.stdout:6/6: creat f4 x:0 0 0 2024-09-17T01:56:22.662 INFO:tasks.workunit.client.0.smithi063.stdout:8/4: creat f0 x:0 0 0 2024-09-17T01:56:22.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/10: dread d0/f2 [0,4194304] 0 2024-09-17T01:56:22.667 INFO:tasks.workunit.client.0.smithi063.stdout:3/9: dwrite f0 [0,4194304] 0 2024-09-17T01:56:22.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/11: creat d0/f3 x:0 0 0 2024-09-17T01:56:22.668 INFO:tasks.workunit.client.0.smithi063.stdout:5/11: dwrite f1 [0,4194304] 0 2024-09-17T01:56:22.668 INFO:tasks.workunit.client.0.smithi063.stdout:3/10: symlink l2 0 2024-09-17T01:56:22.668 INFO:tasks.workunit.client.0.smithi063.stdout:5/12: mknod c2 0 2024-09-17T01:56:22.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/12: link d0/f2 d0/f4 0 2024-09-17T01:56:22.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/13: symlink d0/l5 0 2024-09-17T01:56:22.670 INFO:tasks.workunit.client.0.smithi063.stdout:1/14: creat d0/f6 x:0 0 0 2024-09-17T01:56:22.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/15: creat d0/f7 x:0 0 0 2024-09-17T01:56:22.672 INFO:tasks.workunit.client.0.smithi063.stdout:1/16: creat d0/f8 x:0 0 0 2024-09-17T01:56:22.675 INFO:tasks.workunit.client.0.smithi063.stdout:4/5: truncate f0 210497 0 2024-09-17T01:56:22.677 INFO:tasks.workunit.client.0.smithi063.stdout:3/11: dwrite f0 [0,4194304] 0 2024-09-17T01:56:22.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/12: read f0 [862969,105776] 0 2024-09-17T01:56:22.678 INFO:tasks.workunit.client.0.smithi063.stdout:7/3: getdents . 0 2024-09-17T01:56:22.678 INFO:tasks.workunit.client.0.smithi063.stdout:7/4: dread - f1 zero size 2024-09-17T01:56:22.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/7: getdents . 0 2024-09-17T01:56:22.679 INFO:tasks.workunit.client.0.smithi063.stdout:7/5: fsync f1 0 2024-09-17T01:56:22.680 INFO:tasks.workunit.client.0.smithi063.stdout:6/8: fsync f3 0 2024-09-17T01:56:22.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/6: mkdir d2 0 2024-09-17T01:56:22.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/7: mkdir d2/d3 0 2024-09-17T01:56:22.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/8: read - f1 zero size 2024-09-17T01:56:22.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/9: creat d2/f4 x:0 0 0 2024-09-17T01:56:22.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/10: dread - f1 zero size 2024-09-17T01:56:22.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/11: readlink - no filename 2024-09-17T01:56:22.683 INFO:tasks.workunit.client.0.smithi063.stdout:7/12: readlink - no filename 2024-09-17T01:56:22.683 INFO:tasks.workunit.client.0.smithi063.stdout:3/13: dread f0 [0,4194304] 0 2024-09-17T01:56:22.683 INFO:tasks.workunit.client.0.smithi063.stdout:7/13: rename d2 to d2/d3/d5 22 2024-09-17T01:56:22.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/14: chown f0 7 1 2024-09-17T01:56:22.684 INFO:tasks.workunit.client.0.smithi063.stdout:7/14: rmdir d2 39 2024-09-17T01:56:22.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/15: creat f3 x:0 0 0 2024-09-17T01:56:22.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/16: mknod c4 0 2024-09-17T01:56:22.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/17: write f3 [178099,114783] 0 2024-09-17T01:56:22.686 INFO:tasks.workunit.client.0.smithi063.stdout:3/18: symlink l5 0 2024-09-17T01:56:22.686 INFO:tasks.workunit.client.0.smithi063.stdout:5/13: getdents . 0 2024-09-17T01:56:22.686 INFO:tasks.workunit.client.0.smithi063.stdout:3/19: chown f0 14048 1 2024-09-17T01:56:22.686 INFO:tasks.workunit.client.0.smithi063.stdout:5/14: chown c2 794224 1 2024-09-17T01:56:22.687 INFO:tasks.workunit.client.0.smithi063.stdout:3/20: unlink c4 0 2024-09-17T01:56:22.687 INFO:tasks.workunit.client.0.smithi063.stdout:3/21: write f0 [4517653,39441] 0 2024-09-17T01:56:22.687 INFO:tasks.workunit.client.0.smithi063.stdout:3/22: read f0 [2527012,50456] 0 2024-09-17T01:56:22.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/23: truncate f3 1174296 0 2024-09-17T01:56:22.690 INFO:tasks.workunit.client.0.smithi063.stdout:5/15: dread f1 [0,4194304] 0 2024-09-17T01:56:22.690 INFO:tasks.workunit.client.0.smithi063.stdout:5/16: unlink f1 0 2024-09-17T01:56:22.691 INFO:tasks.workunit.client.0.smithi063.stdout:5/17: rename c2 to c3 0 2024-09-17T01:56:22.693 INFO:tasks.workunit.client.0.smithi063.stdout:1/17: fsync d0/f8 0 2024-09-17T01:56:22.693 INFO:tasks.workunit.client.0.smithi063.stdout:4/6: rename f0 to f1 0 2024-09-17T01:56:22.694 INFO:tasks.workunit.client.0.smithi063.stdout:7/15: symlink d2/l6 0 2024-09-17T01:56:22.694 INFO:tasks.workunit.client.0.smithi063.stdout:7/16: read - d2/f4 zero size 2024-09-17T01:56:22.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/17: fdatasync d2/f4 0 2024-09-17T01:56:22.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/18: readlink d2/l6 0 2024-09-17T01:56:22.696 INFO:tasks.workunit.client.0.smithi063.stdout:0/8: dread d1/d3/f4 [0,4194304] 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/19: creat d2/f7 x:0 0 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/9: link d1/f2 d1/f6 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:1/18: link d0/c1 d0/c9 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:6/9: dwrite f3 [0,4194304] 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:4/7: chown f1 44 1 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:4/8: chown f1 458169 1 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:4/9: rmdir - no directory 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:5/18: rename c3 to c4 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:5/19: fdatasync - no filename 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/10: creat d1/f7 x:0 0 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:4/10: mknod c2 0 2024-09-17T01:56:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/11: write d1/f2 [108624,5417] 0 2024-09-17T01:56:22.703 INFO:tasks.workunit.client.0.smithi063.stdout:0/12: link d1/f7 d1/d3/f8 0 2024-09-17T01:56:22.703 INFO:tasks.workunit.client.0.smithi063.stdout:0/13: dread - d1/d3/f8 zero size 2024-09-17T01:56:22.707 INFO:tasks.workunit.client.0.smithi063.stdout:6/10: dwrite f4 [0,4194304] 0 2024-09-17T01:56:22.707 INFO:tasks.workunit.client.0.smithi063.stdout:6/11: write f4 [3610303,42131] 0 2024-09-17T01:56:22.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/12: read f1 [3467183,108756] 0 2024-09-17T01:56:22.708 INFO:tasks.workunit.client.0.smithi063.stdout:1/19: write d0/f4 [2047406,59425] 0 2024-09-17T01:56:22.709 INFO:tasks.workunit.client.0.smithi063.stdout:1/20: fdatasync d0/f8 0 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/20: chown c4 0 1 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/21: write - no filename 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/22: truncate - no filename 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/23: dwrite - no filename 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/24: truncate - no filename 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/25: dread - no filename 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/26: read - no filename 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:4/11: write f1 [555359,54057] 0 2024-09-17T01:56:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:1/21: mknod d0/ca 0 2024-09-17T01:56:22.711 INFO:tasks.workunit.client.0.smithi063.stdout:5/27: getdents . 0 2024-09-17T01:56:22.712 INFO:tasks.workunit.client.0.smithi063.stdout:1/22: rename d0/l5 to d0/lb 0 2024-09-17T01:56:22.712 INFO:tasks.workunit.client.0.smithi063.stdout:5/28: creat f5 x:0 0 0 2024-09-17T01:56:22.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/24: dread f3 [0,4194304] 0 2024-09-17T01:56:22.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/23: symlink d0/lc 0 2024-09-17T01:56:22.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/24: read - d0/f6 zero size 2024-09-17T01:56:22.715 INFO:tasks.workunit.client.0.smithi063.stdout:3/25: dread f3 [0,4194304] 0 2024-09-17T01:56:22.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/26: fdatasync f3 0 2024-09-17T01:56:22.718 INFO:tasks.workunit.client.0.smithi063.stdout:6/13: dwrite f4 [0,4194304] 0 2024-09-17T01:56:22.718 INFO:tasks.workunit.client.0.smithi063.stdout:4/12: dread f1 [0,4194304] 0 2024-09-17T01:56:22.719 INFO:tasks.workunit.client.0.smithi063.stdout:4/13: creat f3 x:0 0 0 2024-09-17T01:56:22.721 INFO:tasks.workunit.client.0.smithi063.stdout:4/14: rename f3 to f4 0 2024-09-17T01:56:22.722 INFO:tasks.workunit.client.0.smithi063.stdout:4/15: mknod c5 0 2024-09-17T01:56:22.724 INFO:tasks.workunit.client.0.smithi063.stdout:5/29: dwrite f5 [0,4194304] 0 2024-09-17T01:56:22.726 INFO:tasks.workunit.client.0.smithi063.stdout:4/16: dread f1 [0,4194304] 0 2024-09-17T01:56:22.727 INFO:tasks.workunit.client.0.smithi063.stdout:4/17: write f4 [630681,113423] 0 2024-09-17T01:56:22.729 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:22.729 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:22.729 INFO:tasks.workunit.client.0.smithi063.stdout:4/18: symlink l6 0 2024-09-17T01:56:22.730 INFO:tasks.workunit.client.0.smithi063.stdout:3/27: dwrite f3 [0,4194304] 0 2024-09-17T01:56:22.730 INFO:tasks.workunit.client.0.smithi063.stdout:1/25: rename d0/lb to d0/ld 0 2024-09-17T01:56:22.730 INFO:tasks.workunit.client.0.smithi063.stdout:4/19: creat f7 x:0 0 0 2024-09-17T01:56:22.731 INFO:tasks.workunit.client.0.smithi063.stdout:3/28: mknod c6 0 2024-09-17T01:56:22.731 INFO:tasks.workunit.client.0.smithi063.stdout:4/20: creat f8 x:0 0 0 2024-09-17T01:56:22.731 INFO:tasks.workunit.client.0.smithi063.stdout:6/14: dwrite f3 [0,4194304] 0 2024-09-17T01:56:22.732 INFO:tasks.workunit.client.0.smithi063.stdout:1/26: mkdir d0/de 0 2024-09-17T01:56:22.732 INFO:tasks.workunit.client.0.smithi063.stdout:4/21: symlink l9 0 2024-09-17T01:56:22.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/15: unlink f4 0 2024-09-17T01:56:22.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/16: stat l2 0 2024-09-17T01:56:22.733 INFO:tasks.workunit.client.0.smithi063.stdout:5/30: dread f5 [0,4194304] 0 2024-09-17T01:56:22.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/17: write f3 [2480607,89598] 0 2024-09-17T01:56:22.734 INFO:tasks.workunit.client.0.smithi063.stdout:1/27: getdents d0/de 0 2024-09-17T01:56:22.735 INFO:tasks.workunit.client.0.smithi063.stdout:1/28: rmdir d0/de 0 2024-09-17T01:56:22.737 INFO:tasks.workunit.client.0.smithi063.stdout:1/29: write d0/f2 [262228,100227] 0 2024-09-17T01:56:22.739 INFO:tasks.workunit.client.0.smithi063.stdout:5/31: dread f5 [0,4194304] 0 2024-09-17T01:56:22.740 INFO:tasks.workunit.client.0.smithi063.stdout:1/30: symlink d0/lf 0 2024-09-17T01:56:22.740 INFO:tasks.workunit.client.0.smithi063.stdout:5/32: read f5 [3282913,98281] 0 2024-09-17T01:56:22.741 INFO:tasks.workunit.client.0.smithi063.stdout:1/31: mkdir d0/d10 0 2024-09-17T01:56:22.742 INFO:tasks.workunit.client.0.smithi063.stdout:3/29: dwrite f0 [4194304,4194304] 0 2024-09-17T01:56:22.743 INFO:tasks.workunit.client.0.smithi063.stdout:1/32: write d0/f7 [776867,10727] 0 2024-09-17T01:56:22.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/30: chown l5 1486399 1 2024-09-17T01:56:22.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/33: mkdir d6 0 2024-09-17T01:56:22.744 INFO:tasks.workunit.client.0.smithi063.stdout:5/34: chown d6 326 1 2024-09-17T01:56:22.744 INFO:tasks.workunit.client.0.smithi063.stdout:1/33: unlink d0/lc 0 2024-09-17T01:56:22.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/35: mknod d6/c7 0 2024-09-17T01:56:22.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/18: dwrite f1 [0,4194304] 0 2024-09-17T01:56:22.747 INFO:tasks.workunit.client.0.smithi063.stdout:6/19: write f3 [4505679,587] 0 2024-09-17T01:56:22.750 INFO:tasks.workunit.client.0.smithi063.stdout:3/31: truncate f3 1192507 0 2024-09-17T01:56:22.750 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:22.753+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:22.751 INFO:tasks.workunit.client.0.smithi063.stdout:5/36: dread f5 [0,4194304] 0 2024-09-17T01:56:22.751 INFO:tasks.workunit.client.0.smithi063.stdout:3/32: creat f7 x:0 0 0 2024-09-17T01:56:22.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/33: symlink l8 0 2024-09-17T01:56:22.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/37: symlink d6/l8 0 2024-09-17T01:56:22.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/38: stat d6 0 2024-09-17T01:56:22.755 INFO:tasks.workunit.client.0.smithi063.stdout:1/34: dwrite d0/f4 [0,4194304] 0 2024-09-17T01:56:22.756 INFO:tasks.workunit.client.0.smithi063.stdout:5/39: mkdir d6/d9 0 2024-09-17T01:56:22.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:22.757 INFO:tasks.workunit.client.0.smithi063.stdout:6/20: dwrite f1 [0,4194304] 0 2024-09-17T01:56:22.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/40: mkdir d6/da 0 2024-09-17T01:56:22.757 INFO:tasks.workunit.client.0.smithi063.stdout:6/21: chown l2 3927 1 2024-09-17T01:56:22.758 INFO:tasks.workunit.client.0.smithi063.stdout:1/35: getdents d0 0 2024-09-17T01:56:22.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/22: chown f3 263445403 1 2024-09-17T01:56:22.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/23: rmdir - no directory 2024-09-17T01:56:22.761 INFO:tasks.workunit.client.0.smithi063.stdout:5/41: dread f5 [0,4194304] 0 2024-09-17T01:56:22.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/36: getdents d0 0 2024-09-17T01:56:22.763 INFO:tasks.workunit.client.0.smithi063.stdout:3/34: dread f3 [0,4194304] 0 2024-09-17T01:56:22.764 INFO:tasks.workunit.client.0.smithi063.stdout:3/35: unlink f0 0 2024-09-17T01:56:22.765 INFO:tasks.workunit.client.0.smithi063.stdout:3/36: dread - f7 zero size 2024-09-17T01:56:22.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/24: dwrite f1 [0,4194304] 0 2024-09-17T01:56:22.769 INFO:tasks.workunit.client.0.smithi063.stdout:6/25: write f3 [382294,108775] 0 2024-09-17T01:56:22.769 INFO:tasks.workunit.client.0.smithi063.stdout:1/37: dread d0/f7 [0,4194304] 0 2024-09-17T01:56:22.771 INFO:tasks.workunit.client.0.smithi063.stdout:6/26: symlink l5 0 2024-09-17T01:56:22.771 INFO:tasks.workunit.client.0.smithi063.stdout:5/42: dwrite f5 [0,4194304] 0 2024-09-17T01:56:22.775 INFO:tasks.workunit.client.0.smithi063.stdout:5/43: mknod d6/cb 0 2024-09-17T01:56:22.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/27: dread f3 [0,4194304] 0 2024-09-17T01:56:22.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/37: dwrite f7 [0,4194304] 0 2024-09-17T01:56:22.779 INFO:tasks.workunit.client.0.smithi063.stdout:1/38: dwrite d0/f8 [0,4194304] 0 2024-09-17T01:56:22.779 INFO:tasks.workunit.client.0.smithi063.stdout:3/38: write f7 [3739597,103283] 0 2024-09-17T01:56:22.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/39: stat f7 0 2024-09-17T01:56:22.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/28: link f1 f6 0 2024-09-17T01:56:22.781 INFO:tasks.workunit.client.0.smithi063.stdout:1/39: mknod d0/c11 0 2024-09-17T01:56:22.781 INFO:tasks.workunit.client.0.smithi063.stdout:3/40: mknod c9 0 2024-09-17T01:56:22.781 INFO:tasks.workunit.client.0.smithi063.stdout:1/40: fsync d0/f2 0 2024-09-17T01:56:22.782 INFO:tasks.workunit.client.0.smithi063.stdout:1/41: dread - d0/f3 zero size 2024-09-17T01:56:22.784 INFO:tasks.workunit.client.0.smithi063.stdout:3/41: dread f3 [0,4194304] 0 2024-09-17T01:56:22.785 INFO:tasks.workunit.client.0.smithi063.stdout:5/44: dwrite f5 [0,4194304] 0 2024-09-17T01:56:22.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/29: dread f3 [0,4194304] 0 2024-09-17T01:56:22.787 INFO:tasks.workunit.client.0.smithi063.stdout:1/42: dread d0/f2 [0,4194304] 0 2024-09-17T01:56:22.788 INFO:tasks.workunit.client.0.smithi063.stdout:1/43: rename d0 to d0/d12 22 2024-09-17T01:56:22.788 INFO:tasks.workunit.client.0.smithi063.stdout:3/42: truncate f7 4174727 0 2024-09-17T01:56:22.789 INFO:tasks.workunit.client.0.smithi063.stdout:3/43: mknod ca 0 2024-09-17T01:56:22.789 INFO:tasks.workunit.client.0.smithi063.stdout:1/44: rmdir d0/d10 0 2024-09-17T01:56:22.789 INFO:tasks.workunit.client.0.smithi063.stdout:3/44: creat fb x:0 0 0 2024-09-17T01:56:22.790 INFO:tasks.workunit.client.0.smithi063.stdout:3/45: creat fc x:0 0 0 2024-09-17T01:56:22.790 INFO:tasks.workunit.client.0.smithi063.stdout:3/46: chown l5 1008 1 2024-09-17T01:56:22.790 INFO:tasks.workunit.client.0.smithi063.stdout:5/45: dread f5 [0,4194304] 0 2024-09-17T01:56:22.791 INFO:tasks.workunit.client.0.smithi063.stdout:3/47: creat fd x:0 0 0 2024-09-17T01:56:22.791 INFO:tasks.workunit.client.0.smithi063.stdout:5/46: mknod d6/d9/cc 0 2024-09-17T01:56:22.791 INFO:tasks.workunit.client.0.smithi063.stdout:3/48: creat fe x:0 0 0 2024-09-17T01:56:22.791 INFO:tasks.workunit.client.0.smithi063.stdout:3/49: rmdir - no directory 2024-09-17T01:56:22.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/47: readlink d6/l8 0 2024-09-17T01:56:22.796 INFO:tasks.workunit.client.0.smithi063.stdout:1/45: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:56:22.799 INFO:tasks.workunit.client.0.smithi063.stdout:3/50: dwrite fd [0,4194304] 0 2024-09-17T01:56:22.800 INFO:tasks.workunit.client.0.smithi063.stdout:3/51: fdatasync fb 0 2024-09-17T01:56:22.800 INFO:tasks.workunit.client.0.smithi063.stdout:5/48: dwrite f5 [0,4194304] 0 2024-09-17T01:56:22.802 INFO:tasks.workunit.client.0.smithi063.stdout:5/49: chown d6/d9/cc 185005302 1 2024-09-17T01:56:22.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/52: mkdir df 0 2024-09-17T01:56:22.803 INFO:tasks.workunit.client.0.smithi063.stdout:5/50: creat d6/fd x:0 0 0 2024-09-17T01:56:22.804 INFO:tasks.workunit.client.0.smithi063.stdout:3/53: rename l2 to df/l10 0 2024-09-17T01:56:22.804 INFO:tasks.workunit.client.0.smithi063.stdout:3/54: fdatasync fe 0 2024-09-17T01:56:22.805 INFO:tasks.workunit.client.0.smithi063.stdout:5/51: getdents d6/d9 0 2024-09-17T01:56:22.805 INFO:tasks.workunit.client.0.smithi063.stdout:1/46: dwrite d0/f7 [0,4194304] 0 2024-09-17T01:56:22.806 INFO:tasks.workunit.client.0.smithi063.stdout:3/55: creat df/f11 x:0 0 0 2024-09-17T01:56:22.806 INFO:tasks.workunit.client.0.smithi063.stdout:1/47: chown d0/ca 182995442 1 2024-09-17T01:56:22.806 INFO:tasks.workunit.client.0.smithi063.stdout:5/52: rename f5 to d6/da/fe 0 2024-09-17T01:56:22.807 INFO:tasks.workunit.client.0.smithi063.stdout:3/56: mkdir df/d12 0 2024-09-17T01:56:22.807 INFO:tasks.workunit.client.0.smithi063.stdout:3/57: fdatasync fb 0 2024-09-17T01:56:22.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/53: fdatasync d6/fd 0 2024-09-17T01:56:22.807 INFO:tasks.workunit.client.0.smithi063.stdout:3/58: mknod df/c13 0 2024-09-17T01:56:22.808 INFO:tasks.workunit.client.0.smithi063.stdout:5/54: chown c4 257 1 2024-09-17T01:56:22.808 INFO:tasks.workunit.client.0.smithi063.stdout:5/55: rmdir d6/d9 39 2024-09-17T01:56:22.808 INFO:tasks.workunit.client.0.smithi063.stdout:3/59: write df/f11 [592111,99818] 0 2024-09-17T01:56:22.809 INFO:tasks.workunit.client.0.smithi063.stdout:5/56: write d6/da/fe [120700,11713] 0 2024-09-17T01:56:22.809 INFO:tasks.workunit.client.0.smithi063.stdout:3/60: getdents df/d12 0 2024-09-17T01:56:22.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/57: write d6/fd [843540,126731] 0 2024-09-17T01:56:22.811 INFO:tasks.workunit.client.0.smithi063.stdout:3/61: mknod df/d12/c14 0 2024-09-17T01:56:22.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/58: rmdir d6 39 2024-09-17T01:56:22.811 INFO:tasks.workunit.client.0.smithi063.stdout:1/48: dread d0/f8 [0,4194304] 0 2024-09-17T01:56:22.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/59: chown d6 245 1 2024-09-17T01:56:22.812 INFO:tasks.workunit.client.0.smithi063.stdout:3/62: rename ca to df/d12/c15 0 2024-09-17T01:56:22.812 INFO:tasks.workunit.client.0.smithi063.stdout:1/49: symlink d0/l13 0 2024-09-17T01:56:22.813 INFO:tasks.workunit.client.0.smithi063.stdout:1/50: write d0/f2 [4505060,10409] 0 2024-09-17T01:56:22.814 INFO:tasks.workunit.client.0.smithi063.stdout:1/51: rename d0/f3 to d0/f14 0 2024-09-17T01:56:22.815 INFO:tasks.workunit.client.0.smithi063.stdout:1/52: write d0/f7 [481764,61901] 0 2024-09-17T01:56:22.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/60: dread d6/da/fe [0,4194304] 0 2024-09-17T01:56:22.820 INFO:tasks.workunit.client.0.smithi063.stdout:3/63: dwrite fc [0,4194304] 0 2024-09-17T01:56:22.821 INFO:tasks.workunit.client.0.smithi063.stdout:3/64: dread - fb zero size 2024-09-17T01:56:22.823 INFO:tasks.workunit.client.0.smithi063.stdout:3/65: creat df/d12/f16 x:0 0 0 2024-09-17T01:56:22.824 INFO:tasks.workunit.client.0.smithi063.stdout:3/66: fdatasync df/d12/f16 0 2024-09-17T01:56:22.824 INFO:tasks.workunit.client.0.smithi063.stdout:1/53: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:56:22.825 INFO:tasks.workunit.client.0.smithi063.stdout:1/54: chown d0/l13 368993579 1 2024-09-17T01:56:22.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/61: dwrite d6/fd [0,4194304] 0 2024-09-17T01:56:22.826 INFO:tasks.workunit.client.0.smithi063.stdout:3/67: creat df/d12/f17 x:0 0 0 2024-09-17T01:56:22.827 INFO:tasks.workunit.client.0.smithi063.stdout:3/68: symlink df/d12/l18 0 2024-09-17T01:56:22.827 INFO:tasks.workunit.client.0.smithi063.stdout:3/69: creat df/f19 x:0 0 0 2024-09-17T01:56:22.828 INFO:tasks.workunit.client.0.smithi063.stdout:3/70: write fe [650702,104150] 0 2024-09-17T01:56:22.829 INFO:tasks.workunit.client.0.smithi063.stdout:3/71: link l5 df/l1a 0 2024-09-17T01:56:22.830 INFO:tasks.workunit.client.0.smithi063.stdout:3/72: symlink df/d12/l1b 0 2024-09-17T01:56:22.831 INFO:tasks.workunit.client.0.smithi063.stdout:3/73: creat df/f1c x:0 0 0 2024-09-17T01:56:22.834 INFO:tasks.workunit.client.0.smithi063.stdout:5/62: dwrite d6/fd [0,4194304] 0 2024-09-17T01:56:22.835 INFO:tasks.workunit.client.0.smithi063.stdout:5/63: mknod d6/da/cf 0 2024-09-17T01:56:22.836 INFO:tasks.workunit.client.0.smithi063.stdout:3/74: getdents df 0 2024-09-17T01:56:22.837 INFO:tasks.workunit.client.0.smithi063.stdout:3/75: fsync f7 0 2024-09-17T01:56:22.837 INFO:tasks.workunit.client.0.smithi063.stdout:3/76: mknod df/d12/c1d 0 2024-09-17T01:56:22.839 INFO:tasks.workunit.client.0.smithi063.stdout:5/64: dread d6/fd [0,4194304] 0 2024-09-17T01:56:22.840 INFO:tasks.workunit.client.0.smithi063.stdout:5/65: write d6/da/fe [1393300,1872] 0 2024-09-17T01:56:22.840 INFO:tasks.workunit.client.0.smithi063.stdout:5/66: readlink d6/l8 0 2024-09-17T01:56:22.841 INFO:tasks.workunit.client.0.smithi063.stdout:5/67: write d6/da/fe [1014708,8742] 0 2024-09-17T01:56:22.843 INFO:tasks.workunit.client.0.smithi063.stdout:1/55: dread d0/f4 [4194304,4194304] 0 2024-09-17T01:56:22.843 INFO:tasks.workunit.client.0.smithi063.stdout:1/56: mknod d0/c15 0 2024-09-17T01:56:22.844 INFO:tasks.workunit.client.0.smithi063.stdout:1/57: symlink d0/l16 0 2024-09-17T01:56:22.845 INFO:tasks.workunit.client.0.smithi063.stdout:3/77: dwrite fe [0,4194304] 0 2024-09-17T01:56:22.847 INFO:tasks.workunit.client.0.smithi063.stdout:1/58: rename d0/lf to d0/l17 0 2024-09-17T01:56:22.847 INFO:tasks.workunit.client.0.smithi063.stdout:3/78: mkdir df/d12/d1e 0 2024-09-17T01:56:22.848 INFO:tasks.workunit.client.0.smithi063.stdout:3/79: creat df/d12/f1f x:0 0 0 2024-09-17T01:56:22.848 INFO:tasks.workunit.client.0.smithi063.stdout:1/59: write d0/f7 [3983410,73016] 0 2024-09-17T01:56:22.848 INFO:tasks.workunit.client.0.smithi063.stdout:1/60: mknod d0/c18 0 2024-09-17T01:56:22.849 INFO:tasks.workunit.client.0.smithi063.stdout:1/61: chown d0/f4 199037 1 2024-09-17T01:56:22.851 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:22.854+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:22.854 INFO:tasks.workunit.client.0.smithi063.stdout:3/80: dwrite df/f1c [0,4194304] 0 2024-09-17T01:56:22.856 INFO:tasks.workunit.client.0.smithi063.stdout:1/62: getdents d0 0 2024-09-17T01:56:22.856 INFO:tasks.workunit.client.0.smithi063.stdout:3/81: rename f7 to df/f20 0 2024-09-17T01:56:22.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/63: symlink d0/l19 0 2024-09-17T01:56:22.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/64: read d0/f6 [2555934,73341] 0 2024-09-17T01:56:22.858 INFO:tasks.workunit.client.0.smithi063.stdout:3/82: unlink df/f19 0 2024-09-17T01:56:22.858 INFO:tasks.workunit.client.0.smithi063.stdout:3/83: chown df/f20 0 1 2024-09-17T01:56:22.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/65: truncate d0/f4 149285 0 2024-09-17T01:56:22.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/66: write d0/f7 [4913554,90816] 0 2024-09-17T01:56:22.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/67: chown d0/l13 62 1 2024-09-17T01:56:22.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/68: creat d0/f1a x:0 0 0 2024-09-17T01:56:22.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/69: creat d0/f1b x:0 0 0 2024-09-17T01:56:22.868 INFO:tasks.workunit.client.0.smithi063.stdout:1/70: getdents d0 0 2024-09-17T01:56:22.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/71: mkdir d0/d1c 0 2024-09-17T01:56:22.869 INFO:tasks.workunit.client.0.smithi063.stdout:1/72: chown d0/c9 11465 1 2024-09-17T01:56:22.870 INFO:tasks.workunit.client.0.smithi063.stdout:1/73: creat d0/d1c/f1d x:0 0 0 2024-09-17T01:56:22.871 INFO:tasks.workunit.client.0.smithi063.stdout:1/74: write d0/f8 [4818737,85312] 0 2024-09-17T01:56:22.871 INFO:tasks.workunit.client.0.smithi063.stdout:1/75: write d0/f1b [685919,11182] 0 2024-09-17T01:56:22.874 INFO:tasks.workunit.client.0.smithi063.stdout:1/76: dread d0/f7 [4194304,4194304] 0 2024-09-17T01:56:22.875 INFO:tasks.workunit.client.0.smithi063.stdout:1/77: truncate d0/d1c/f1d 87583 0 2024-09-17T01:56:22.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/78: symlink d0/d1c/l1e 0 2024-09-17T01:56:22.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/79: read - d0/f1a zero size 2024-09-17T01:56:22.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/80: symlink d0/d1c/l1f 0 2024-09-17T01:56:22.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/81: readlink d0/l16 0 2024-09-17T01:56:22.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/82: creat d0/f20 x:0 0 0 2024-09-17T01:56:22.881 INFO:tasks.workunit.client.0.smithi063.stdout:1/83: getdents d0 0 2024-09-17T01:56:22.882 INFO:tasks.workunit.client.0.smithi063.stdout:1/84: mknod d0/d1c/c21 0 2024-09-17T01:56:22.882 INFO:tasks.workunit.client.0.smithi063.stdout:1/85: rename d0/c1 to d0/d1c/c22 0 2024-09-17T01:56:22.883 INFO:tasks.workunit.client.0.smithi063.stdout:1/86: symlink d0/l23 0 2024-09-17T01:56:22.883 INFO:tasks.workunit.client.0.smithi063.stdout:1/87: write d0/f14 [821692,99409] 0 2024-09-17T01:56:22.884 INFO:tasks.workunit.client.0.smithi063.stdout:1/88: dread d0/f4 [0,4194304] 0 2024-09-17T01:56:22.885 INFO:tasks.workunit.client.0.smithi063.stdout:1/89: symlink d0/l24 0 2024-09-17T01:56:22.885 INFO:tasks.workunit.client.0.smithi063.stdout:1/90: symlink d0/l25 0 2024-09-17T01:56:22.886 INFO:tasks.workunit.client.0.smithi063.stdout:1/91: symlink d0/d1c/l26 0 2024-09-17T01:56:22.886 INFO:tasks.workunit.client.0.smithi063.stdout:1/92: mknod d0/d1c/c27 0 2024-09-17T01:56:22.887 INFO:tasks.workunit.client.0.smithi063.stdout:1/93: read d0/f1b [359339,100365] 0 2024-09-17T01:56:22.891 INFO:tasks.workunit.client.0.smithi063.stdout:1/94: dread d0/f8 [0,4194304] 0 2024-09-17T01:56:22.901 INFO:tasks.workunit.client.0.smithi063.stdout:1/95: dwrite d0/f4 [0,4194304] 0 2024-09-17T01:56:22.901 INFO:tasks.workunit.client.0.smithi063.stdout:1/96: readlink d0/l23 0 2024-09-17T01:56:22.901 INFO:tasks.workunit.client.0.smithi063.stdout:1/97: creat d0/d1c/f28 x:0 0 0 2024-09-17T01:56:22.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/98: creat d0/d1c/f29 x:0 0 0 2024-09-17T01:56:22.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/99: write d0/f20 [224848,108862] 0 2024-09-17T01:56:22.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/100: truncate d0/d1c/f1d 524837 0 2024-09-17T01:56:22.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/101: fsync d0/f14 0 2024-09-17T01:56:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/102: rename d0/d1c/c21 to d0/d1c/c2a 0 2024-09-17T01:56:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/103: readlink d0/l24 0 2024-09-17T01:56:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/104: write d0/d1c/f29 [199845,128426] 0 2024-09-17T01:56:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/105: creat d0/f2b x:0 0 0 2024-09-17T01:56:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/106: mknod d0/d1c/c2c 0 2024-09-17T01:56:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/107: read d0/f4 [2883442,129950] 0 2024-09-17T01:56:22.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/108: mkdir d0/d2d 0 2024-09-17T01:56:22.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/109: write d0/d1c/f28 [1017459,25822] 0 2024-09-17T01:56:22.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/110: symlink d0/l2e 0 2024-09-17T01:56:22.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/111: dread - d0/f2b zero size 2024-09-17T01:56:22.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/112: write d0/f4 [2957687,62614] 0 2024-09-17T01:56:22.912 INFO:tasks.workunit.client.0.smithi063.stdout:1/113: rename d0/d1c/c22 to d0/d1c/c2f 0 2024-09-17T01:56:22.912 INFO:tasks.workunit.client.0.smithi063.stdout:1/114: mknod d0/c30 0 2024-09-17T01:56:22.913 INFO:tasks.workunit.client.0.smithi063.stdout:1/115: link d0/d1c/l26 d0/d2d/l31 0 2024-09-17T01:56:22.917 INFO:tasks.workunit.client.0.smithi063.stdout:1/116: dread d0/f4 [0,4194304] 0 2024-09-17T01:56:22.917 INFO:tasks.workunit.client.0.smithi063.stdout:1/117: truncate d0/d1c/f29 1262463 0 2024-09-17T01:56:22.918 INFO:tasks.workunit.client.0.smithi063.stdout:1/118: unlink d0/f2b 0 2024-09-17T01:56:22.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/119: dread d0/d1c/f29 [0,4194304] 0 2024-09-17T01:56:22.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/120: fdatasync d0/f1a 0 2024-09-17T01:56:22.927 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:22.927 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:22.930 INFO:tasks.workunit.client.0.smithi063.stdout:1/121: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:56:22.931 INFO:tasks.workunit.client.0.smithi063.stdout:1/122: mkdir d0/d32 0 2024-09-17T01:56:22.932 INFO:tasks.workunit.client.0.smithi063.stdout:1/123: creat d0/d2d/f33 x:0 0 0 2024-09-17T01:56:22.942 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:22.990 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:22.993+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:23.052 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:23.053+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:23.074 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:23.074 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:23.088 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:23.153 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:23.158+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:23.251 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:23.251 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:23.254 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:23.258+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:23.265 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:23.355 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:23.357+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:23.388 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:23.389 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:23.404 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:23.421 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T01:56:23.457 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:23.457+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:23.533 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-09-17T01:56:23.534 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-09-17T01:56:23.537 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:23.537 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:23.551 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:23.596 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:23.602+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:23.658 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:23.662+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:23.676 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:23.676 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:23.690 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:23.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:23.780 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:23.786+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:23.851 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:23.852 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:23.860 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:23.866+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:23.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:23.925 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:23.926 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:23.945 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:23.945 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:23.945 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:23.948 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:23.948 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:23.961 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:23.961+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:23.999 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:24.000 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:24.013 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:24.102 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:24.105+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:24.163 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:24.165+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:24.180 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:24.180 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:24.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:24.264 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:24.270+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:24.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:56:24.363 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:24.363 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:24.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:24.363 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:24.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.363 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.990685681, 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:24.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:24.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:24.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:24.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:24.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:24.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7926896000000001, 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:24.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:24.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7918063469999996, 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:24.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:24.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7898068279999997, 2024-09-17T01:56:24.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:24.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:24.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.390 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7887501180000003, 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:24.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:24.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.785671786, 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:24.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:24.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:24.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.783766269, 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:24.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7815325719999997, 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:24.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:24.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7805964359999997, 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.416 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:24.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7586439379999996, 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:24.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7555979300000004, 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:24.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.434 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7504055229999995, 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:24.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:24.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7450459790000004, 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.441 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:24.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:24.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.740573404, 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.447 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:24.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:24.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7290611949999999, 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:24.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:24.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7211100049999999, 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.459 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:24.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7167915540000003, 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:24.465 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:24.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:24.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:24.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7120513080000004, 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.472 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:24.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:24.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7095696199999999, 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.478 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:24.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7085743969999996, 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:24.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:24.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:24.490 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:24.492 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:24.492 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:24.494+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:24.593 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:24.598+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:24.623 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:24.623 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:24.623 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:24.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:24.693 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:24.693+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:24.794 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:24.798+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:24.804 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:24.805 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:24.805 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:24.805 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:24.805 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:24.819 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:24.895 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:24.897+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:24.991 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:24.991 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:24.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:24.991 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:24.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4381491869999996, 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.992 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:24.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:24.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:24.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4333475099999999, 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:24.998 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:24.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:25.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.003 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.004 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4302750120000001, 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:25.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.428338857, 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:25.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:25.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:25.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.016 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:25.018 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4263571519999996, 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.019 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:25.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.025 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4231035990000001, 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:25.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:25.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:25.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:25.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4126590810000001, 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.032 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:25.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.4034903009999997, 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:25.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:25.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3994609440000003, 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.045 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:25.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3931353870000001, 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:25.051 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:25.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:25.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.389944742, 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:25.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:25.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3887890909999996, 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.064 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:25.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:25.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.071 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.071 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:25.071 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3867157519999997, 2024-09-17T01:56:25.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:25.071 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:25.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:25.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:25.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3796149240000002, 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.078 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:25.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:25.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3743659340000001, 2024-09-17T01:56:25.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:25.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:25.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.090 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3731719069999997, 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.091 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:25.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:25.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.366567474, 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.097 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:25.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:25.103 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3641858759999996, 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.104 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:25.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:25.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.110 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.3610830390000004, 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.111 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:25.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:25.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:25.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:25.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:25.118 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 5.355230594, 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:25.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:25.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.124 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:25.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:25.125 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:25.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:25.128 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:25.130+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:25.130 INFO:tasks.workunit.client.0.smithi063.stdout:7/20: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:5/68: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/7: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/8: truncate - no filename 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/9: rmdir - no directory 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/10: dwrite - no filename 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/14: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/5: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/124: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:3/84: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:4/22: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:2/5: sync 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:2/6: rename - no filename 2024-09-17T01:56:25.131 INFO:tasks.workunit.client.0.smithi063.stdout:2/7: fdatasync - no filename 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:2/8: truncate - no filename 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:2/9: write - no filename 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:2/10: truncate - no filename 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:2/11: rename - no filename 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/30: sync 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:3/85: readlink df/d12/l1b 0 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:5/69: fdatasync d6/da/fe 0 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:4/23: chown l6 1922 1 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:9/11: chown l3 1562830127 1 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:5/70: chown d6/l8 1 1 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:0/15: symlink d1/d3/l9 0 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:1/125: mknod d0/c34 0 2024-09-17T01:56:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/31: creat f7 x:0 0 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/12: symlink l0 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/13: write - no filename 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:3/86: write f3 [1839920,128001] 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:7/21: symlink d2/d3/l8 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/14: chown l0 21451918 1 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:0/16: dread - d1/d3/f8 zero size 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/32: symlink l8 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:9/12: mknod c4 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:5/71: stat d6/d9/cc 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:1/126: mkdir d0/d2d/d35 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:4/24: dread f4 [0,4194304] 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/15: symlink l1 0 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/33: chown f1 4142037 1 2024-09-17T01:56:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/34: dread - f7 zero size 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:7/22: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/6: dwrite f0 [0,4194304] 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/17: creat d1/fa x:0 0 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/87: rename fb to df/d12/d1e/f21 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:1/127: dwrite d0/f20 [0,4194304] 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:5/72: symlink d6/l10 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:2/16: creat f2 x:0 0 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:2/17: dread - f2 zero size 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/7: dwrite f0 [0,4194304] 0 2024-09-17T01:56:25.134 INFO:tasks.workunit.client.0.smithi063.stdout:6/35: fdatasync f3 0 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:7/23: mknod d2/c9 0 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:9/13: symlink l5 0 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:9/14: write - no filename 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:9/15: write - no filename 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/18: mkdir d1/d3/db 0 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:1/128: symlink d0/d1c/l36 0 2024-09-17T01:56:25.136 INFO:tasks.workunit.client.0.smithi063.stdout:7/24: rename d2 to d2/da 22 2024-09-17T01:56:25.138 INFO:tasks.workunit.client.0.smithi063.stdout:2/18: mkdir d3 0 2024-09-17T01:56:25.138 INFO:tasks.workunit.client.0.smithi063.stdout:5/73: unlink d6/d9/cc 0 2024-09-17T01:56:25.139 INFO:tasks.workunit.client.0.smithi063.stdout:5/74: fdatasync d6/da/fe 0 2024-09-17T01:56:25.139 INFO:tasks.workunit.client.0.smithi063.stdout:2/19: truncate f2 423814 0 2024-09-17T01:56:25.144 INFO:tasks.workunit.client.0.smithi063.stdout:1/129: dread d0/f20 [0,4194304] 0 2024-09-17T01:56:25.146 INFO:tasks.workunit.client.0.smithi063.stdout:1/130: dread - d0/f1a zero size 2024-09-17T01:56:25.147 INFO:tasks.workunit.client.0.smithi063.stdout:6/36: mknod c9 0 2024-09-17T01:56:25.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/88: dwrite df/d12/d1e/f21 [0,4194304] 0 2024-09-17T01:56:25.148 INFO:tasks.workunit.client.0.smithi063.stdout:1/131: dread - d0/d2d/f33 zero size 2024-09-17T01:56:25.149 INFO:tasks.workunit.client.0.smithi063.stdout:7/25: dwrite d2/f7 [0,4194304] 0 2024-09-17T01:56:25.149 INFO:tasks.workunit.client.0.smithi063.stdout:9/16: mknod c6 0 2024-09-17T01:56:25.149 INFO:tasks.workunit.client.0.smithi063.stdout:9/17: truncate - no filename 2024-09-17T01:56:25.149 INFO:tasks.workunit.client.0.smithi063.stdout:2/20: creat d3/f4 x:0 0 0 2024-09-17T01:56:25.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/132: chown d0/d1c/c27 9036864 1 2024-09-17T01:56:25.150 INFO:tasks.workunit.client.0.smithi063.stdout:3/89: dread - df/d12/f17 zero size 2024-09-17T01:56:25.150 INFO:tasks.workunit.client.0.smithi063.stdout:3/90: chown l8 121 1 2024-09-17T01:56:25.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/25: getdents . 0 2024-09-17T01:56:25.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/26: creat d2/fb x:0 0 0 2024-09-17T01:56:25.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/26: readlink l9 0 2024-09-17T01:56:25.152 INFO:tasks.workunit.client.0.smithi063.stdout:3/91: mknod df/c22 0 2024-09-17T01:56:25.152 INFO:tasks.workunit.client.0.smithi063.stdout:2/21: creat d3/f5 x:0 0 0 2024-09-17T01:56:25.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/8: getdents . 0 2024-09-17T01:56:25.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/75: creat d6/f11 x:0 0 0 2024-09-17T01:56:25.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/27: chown f7 437618726 1 2024-09-17T01:56:25.153 INFO:tasks.workunit.client.0.smithi063.stdout:7/27: readlink d2/l6 0 2024-09-17T01:56:25.153 INFO:tasks.workunit.client.0.smithi063.stdout:6/37: truncate f1 477571 0 2024-09-17T01:56:25.154 INFO:tasks.workunit.client.0.smithi063.stdout:8/9: mkdir d1 0 2024-09-17T01:56:25.155 INFO:tasks.workunit.client.0.smithi063.stdout:9/18: creat f7 x:0 0 0 2024-09-17T01:56:25.156 INFO:tasks.workunit.client.0.smithi063.stdout:1/133: dread d0/f20 [0,4194304] 0 2024-09-17T01:56:25.156 INFO:tasks.workunit.client.0.smithi063.stdout:4/28: write f4 [89831,2767] 0 2024-09-17T01:56:25.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/38: symlink la 0 2024-09-17T01:56:25.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/28: mknod d2/cc 0 2024-09-17T01:56:25.157 INFO:tasks.workunit.client.0.smithi063.stdout:6/39: dread - f7 zero size 2024-09-17T01:56:25.161 INFO:tasks.workunit.client.0.smithi063.stdout:9/19: mkdir d8 0 2024-09-17T01:56:25.162 INFO:tasks.workunit.client.0.smithi063.stdout:6/40: mknod cb 0 2024-09-17T01:56:25.162 INFO:tasks.workunit.client.0.smithi063.stdout:1/134: write d0/f1b [417933,115176] 0 2024-09-17T01:56:25.162 INFO:tasks.workunit.client.0.smithi063.stdout:4/29: getdents . 0 2024-09-17T01:56:25.162 INFO:tasks.workunit.client.0.smithi063.stdout:4/30: chown l9 11326187 1 2024-09-17T01:56:25.162 INFO:tasks.workunit.client.0.smithi063.stdout:5/76: dread d6/fd [0,4194304] 0 2024-09-17T01:56:25.162 INFO:tasks.workunit.client.0.smithi063.stdout:1/135: creat d0/d2d/f37 x:0 0 0 2024-09-17T01:56:25.163 INFO:tasks.workunit.client.0.smithi063.stdout:1/136: mknod d0/d2d/c38 0 2024-09-17T01:56:25.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/31: write f8 [826194,116920] 0 2024-09-17T01:56:25.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/77: write d6/fd [727025,100961] 0 2024-09-17T01:56:25.165 INFO:tasks.workunit.client.0.smithi063.stdout:7/29: getdents d2 0 2024-09-17T01:56:25.165 INFO:tasks.workunit.client.0.smithi063.stdout:3/92: dwrite df/f20 [0,4194304] 0 2024-09-17T01:56:25.165 INFO:tasks.workunit.client.0.smithi063.stdout:4/32: symlink la 0 2024-09-17T01:56:25.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/137: mknod d0/c39 0 2024-09-17T01:56:25.166 INFO:tasks.workunit.client.0.smithi063.stdout:2/22: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:56:25.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/10: dwrite f0 [4194304,4194304] 0 2024-09-17T01:56:25.170 INFO:tasks.workunit.client.0.smithi063.stdout:2/23: creat d3/f6 x:0 0 0 2024-09-17T01:56:25.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/138: rename d0/c34 to d0/c3a 0 2024-09-17T01:56:25.171 INFO:tasks.workunit.client.0.smithi063.stdout:4/33: link c5 cb 0 2024-09-17T01:56:25.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/11: creat d1/f2 x:0 0 0 2024-09-17T01:56:25.172 INFO:tasks.workunit.client.0.smithi063.stdout:1/139: write d0/f1a [449574,121196] 0 2024-09-17T01:56:25.173 INFO:tasks.workunit.client.0.smithi063.stdout:4/34: creat fc x:0 0 0 2024-09-17T01:56:25.173 INFO:tasks.workunit.client.0.smithi063.stdout:8/12: write d1/f2 [740048,86140] 0 2024-09-17T01:56:25.175 INFO:tasks.workunit.client.0.smithi063.stdout:8/13: symlink d1/l3 0 2024-09-17T01:56:25.175 INFO:tasks.workunit.client.0.smithi063.stdout:4/35: rename la to ld 0 2024-09-17T01:56:25.175 INFO:tasks.workunit.client.0.smithi063.stdout:4/36: rmdir - no directory 2024-09-17T01:56:25.176 INFO:tasks.workunit.client.0.smithi063.stdout:4/37: mkdir de 0 2024-09-17T01:56:25.177 INFO:tasks.workunit.client.0.smithi063.stdout:6/41: dwrite f6 [0,4194304] 0 2024-09-17T01:56:25.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/42: chown f6 306696 1 2024-09-17T01:56:25.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/43: readlink l2 0 2024-09-17T01:56:25.178 INFO:tasks.workunit.client.0.smithi063.stdout:7/30: dwrite f1 [0,4194304] 0 2024-09-17T01:56:25.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/44: read - f7 zero size 2024-09-17T01:56:25.179 INFO:tasks.workunit.client.0.smithi063.stdout:6/45: mkdir dc 0 2024-09-17T01:56:25.179 INFO:tasks.workunit.client.0.smithi063.stdout:2/24: getdents d3 0 2024-09-17T01:56:25.180 INFO:tasks.workunit.client.0.smithi063.stdout:7/31: write d2/f4 [303589,81595] 0 2024-09-17T01:56:25.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/93: truncate fe 2206691 0 2024-09-17T01:56:25.181 INFO:tasks.workunit.client.0.smithi063.stdout:2/25: mkdir d3/d7 0 2024-09-17T01:56:25.181 INFO:tasks.workunit.client.0.smithi063.stdout:6/46: symlink dc/ld 0 2024-09-17T01:56:25.181 INFO:tasks.workunit.client.0.smithi063.stdout:4/38: read f8 [462411,66771] 0 2024-09-17T01:56:25.181 INFO:tasks.workunit.client.0.smithi063.stdout:7/32: write d2/f4 [4864117,108901] 0 2024-09-17T01:56:25.182 INFO:tasks.workunit.client.0.smithi063.stdout:1/140: truncate d0/f2 3549248 0 2024-09-17T01:56:25.183 INFO:tasks.workunit.client.0.smithi063.stdout:6/47: chown f7 10628 1 2024-09-17T01:56:25.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/39: chown f1 5982946 1 2024-09-17T01:56:25.183 INFO:tasks.workunit.client.0.smithi063.stdout:7/33: chown d2/l6 30 1 2024-09-17T01:56:25.184 INFO:tasks.workunit.client.0.smithi063.stdout:7/34: read f1 [3281714,86077] 0 2024-09-17T01:56:25.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/40: write f4 [256260,120492] 0 2024-09-17T01:56:25.185 INFO:tasks.workunit.client.0.smithi063.stdout:7/35: creat d2/fd x:0 0 0 2024-09-17T01:56:25.185 INFO:tasks.workunit.client.0.smithi063.stdout:4/41: chown l9 110251388 1 2024-09-17T01:56:25.185 INFO:tasks.workunit.client.0.smithi063.stdout:6/48: chown l2 1897850 1 2024-09-17T01:56:25.185 INFO:tasks.workunit.client.0.smithi063.stdout:6/49: readlink la 0 2024-09-17T01:56:25.186 INFO:tasks.workunit.client.0.smithi063.stdout:8/14: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:25.187 INFO:tasks.workunit.client.0.smithi063.stdout:7/36: write d2/fb [218031,77373] 0 2024-09-17T01:56:25.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/42: mknod de/cf 0 2024-09-17T01:56:25.188 INFO:tasks.workunit.client.0.smithi063.stdout:8/15: chown d1/l3 14 1 2024-09-17T01:56:25.189 INFO:tasks.workunit.client.0.smithi063.stdout:4/43: creat de/f10 x:0 0 0 2024-09-17T01:56:25.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/94: dread df/f20 [0,4194304] 0 2024-09-17T01:56:25.190 INFO:tasks.workunit.client.0.smithi063.stdout:7/37: write d2/fd [349592,121043] 0 2024-09-17T01:56:25.191 INFO:tasks.workunit.client.0.smithi063.stdout:4/44: mknod de/c11 0 2024-09-17T01:56:25.191 INFO:tasks.workunit.client.0.smithi063.stdout:8/16: link d1/l3 d1/l4 0 2024-09-17T01:56:25.192 INFO:tasks.workunit.client.0.smithi063.stdout:7/38: symlink d2/le 0 2024-09-17T01:56:25.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/95: creat df/d12/f23 x:0 0 0 2024-09-17T01:56:25.193 INFO:tasks.workunit.client.0.smithi063.stdout:4/45: link c2 de/c12 0 2024-09-17T01:56:25.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/17: write d1/f2 [4416707,121083] 0 2024-09-17T01:56:25.193 INFO:tasks.workunit.client.0.smithi063.stdout:7/39: mkdir d2/df 0 2024-09-17T01:56:25.194 INFO:tasks.workunit.client.0.smithi063.stdout:1/141: dwrite d0/d1c/f1d [0,4194304] 0 2024-09-17T01:56:25.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/18: truncate f0 8908485 0 2024-09-17T01:56:25.195 INFO:tasks.workunit.client.0.smithi063.stdout:7/40: truncate d2/fb 659950 0 2024-09-17T01:56:25.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/19: write f0 [3820551,84710] 0 2024-09-17T01:56:25.195 INFO:tasks.workunit.client.0.smithi063.stdout:4/46: unlink de/cf 0 2024-09-17T01:56:25.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/20: write f0 [9434966,126251] 0 2024-09-17T01:56:25.196 INFO:tasks.workunit.client.0.smithi063.stdout:3/96: link df/d12/f17 df/d12/d1e/f24 0 2024-09-17T01:56:25.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/142: symlink d0/d2d/d35/l3b 0 2024-09-17T01:56:25.196 INFO:tasks.workunit.client.0.smithi063.stdout:4/47: mknod de/c13 0 2024-09-17T01:56:25.196 INFO:tasks.workunit.client.0.smithi063.stdout:8/21: write f0 [6015578,65058] 0 2024-09-17T01:56:25.197 INFO:tasks.workunit.client.0.smithi063.stdout:7/41: creat d2/df/f10 x:0 0 0 2024-09-17T01:56:25.197 INFO:tasks.workunit.client.0.smithi063.stdout:3/97: creat df/f25 x:0 0 0 2024-09-17T01:56:25.197 INFO:tasks.workunit.client.0.smithi063.stdout:4/48: chown de/c11 37 1 2024-09-17T01:56:25.197 INFO:tasks.workunit.client.0.smithi063.stdout:1/143: rename d0/ld to d0/d2d/l3c 0 2024-09-17T01:56:25.198 INFO:tasks.workunit.client.0.smithi063.stdout:4/49: truncate fc 139586 0 2024-09-17T01:56:25.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/42: link d2/fb d2/df/f11 0 2024-09-17T01:56:25.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/144: creat d0/d2d/f3d x:0 0 0 2024-09-17T01:56:25.198 INFO:tasks.workunit.client.0.smithi063.stdout:8/22: rename d1/l4 to d1/l5 0 2024-09-17T01:56:25.198 INFO:tasks.workunit.client.0.smithi063.stdout:4/50: creat de/f14 x:0 0 0 2024-09-17T01:56:25.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/43: chown f1 207301627 1 2024-09-17T01:56:25.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/26: dread f2 [0,4194304] 0 2024-09-17T01:56:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/51: rename l9 to de/l15 0 2024-09-17T01:56:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:6/50: fdatasync f6 0 2024-09-17T01:56:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/44: rename f1 to d2/df/f12 0 2024-09-17T01:56:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/52: creat de/f16 x:0 0 0 2024-09-17T01:56:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:6/51: rmdir dc 39 2024-09-17T01:56:25.201 INFO:tasks.workunit.client.0.smithi063.stdout:4/53: mkdir de/d17 0 2024-09-17T01:56:25.202 INFO:tasks.workunit.client.0.smithi063.stdout:3/98: truncate f3 696318 0 2024-09-17T01:56:25.202 INFO:tasks.workunit.client.0.smithi063.stdout:6/52: mknod dc/ce 0 2024-09-17T01:56:25.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/23: rename d1/l5 to d1/l6 0 2024-09-17T01:56:25.203 INFO:tasks.workunit.client.0.smithi063.stdout:3/99: creat df/f26 x:0 0 0 2024-09-17T01:56:25.205 INFO:tasks.workunit.client.0.smithi063.stdout:8/24: mkdir d1/d7 0 2024-09-17T01:56:25.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/100: rmdir df/d12/d1e 39 2024-09-17T01:56:25.207 INFO:tasks.workunit.client.0.smithi063.stdout:8/25: creat d1/f8 x:0 0 0 2024-09-17T01:56:25.209 INFO:tasks.workunit.client.0.smithi063.stdout:3/101: unlink df/d12/l1b 0 2024-09-17T01:56:25.211 INFO:tasks.workunit.client.0.smithi063.stdout:8/26: write d1/f2 [1010,18372] 0 2024-09-17T01:56:25.212 INFO:tasks.workunit.client.0.smithi063.stdout:1/145: dwrite d0/d2d/f3d [0,4194304] 0 2024-09-17T01:56:25.215 INFO:tasks.workunit.client.0.smithi063.stdout:6/53: dread f1 [0,4194304] 0 2024-09-17T01:56:25.215 INFO:tasks.workunit.client.0.smithi063.stdout:8/27: readlink d1/l6 0 2024-09-17T01:56:25.215 INFO:tasks.workunit.client.0.smithi063.stdout:3/102: creat df/d12/d1e/f27 x:0 0 0 2024-09-17T01:56:25.216 INFO:tasks.workunit.client.0.smithi063.stdout:7/45: dwrite d2/fd [0,4194304] 0 2024-09-17T01:56:25.216 INFO:tasks.workunit.client.0.smithi063.stdout:4/54: dwrite fc [0,4194304] 0 2024-09-17T01:56:25.216 INFO:tasks.workunit.client.0.smithi063.stdout:8/28: write d1/f8 [62470,54677] 0 2024-09-17T01:56:25.216 INFO:tasks.workunit.client.0.smithi063.stdout:6/54: rename dc/ce to dc/cf 0 2024-09-17T01:56:25.217 INFO:tasks.workunit.client.0.smithi063.stdout:8/29: write f0 [3546989,68439] 0 2024-09-17T01:56:25.217 INFO:tasks.workunit.client.0.smithi063.stdout:4/55: mkdir de/d18 0 2024-09-17T01:56:25.218 INFO:tasks.workunit.client.0.smithi063.stdout:6/55: write f6 [736837,103946] 0 2024-09-17T01:56:25.218 INFO:tasks.workunit.client.0.smithi063.stdout:1/146: write d0/f4 [2401738,68862] 0 2024-09-17T01:56:25.218 INFO:tasks.workunit.client.0.smithi063.stdout:4/56: chown de/f10 0 1 2024-09-17T01:56:25.218 INFO:tasks.workunit.client.0.smithi063.stdout:7/46: write d2/df/f12 [5074139,115572] 0 2024-09-17T01:56:25.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/147: chown d0/l25 125219 1 2024-09-17T01:56:25.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/30: getdents d1/d7 0 2024-09-17T01:56:25.219 INFO:tasks.workunit.client.0.smithi063.stdout:4/57: write f8 [1967852,4058] 0 2024-09-17T01:56:25.220 INFO:tasks.workunit.client.0.smithi063.stdout:4/58: dread - de/f10 zero size 2024-09-17T01:56:25.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/148: creat d0/d32/f3e x:0 0 0 2024-09-17T01:56:25.221 INFO:tasks.workunit.client.0.smithi063.stdout:3/103: dread df/f20 [0,4194304] 0 2024-09-17T01:56:25.222 INFO:tasks.workunit.client.0.smithi063.stdout:1/149: write d0/d1c/f1d [4439642,123154] 0 2024-09-17T01:56:25.222 INFO:tasks.workunit.client.0.smithi063.stdout:3/104: fdatasync df/d12/f23 0 2024-09-17T01:56:25.223 INFO:tasks.workunit.client.0.smithi063.stdout:1/150: mkdir d0/d2d/d35/d3f 0 2024-09-17T01:56:25.223 INFO:tasks.workunit.client.0.smithi063.stdout:3/105: dread - df/f26 zero size 2024-09-17T01:56:25.224 INFO:tasks.workunit.client.0.smithi063.stdout:1/151: mknod d0/c40 0 2024-09-17T01:56:25.225 INFO:tasks.workunit.client.0.smithi063.stdout:8/31: truncate d1/f8 6926 0 2024-09-17T01:56:25.226 INFO:tasks.workunit.client.0.smithi063.stdout:8/32: chown d1/l6 212748 1 2024-09-17T01:56:25.226 INFO:tasks.workunit.client.0.smithi063.stdout:1/152: unlink d0/d2d/l31 0 2024-09-17T01:56:25.227 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:25.229+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:25.228 INFO:tasks.workunit.client.0.smithi063.stdout:6/56: dwrite f7 [0,4194304] 0 2024-09-17T01:56:25.231 INFO:tasks.workunit.client.0.smithi063.stdout:6/57: read f1 [4101872,93358] 0 2024-09-17T01:56:25.232 INFO:tasks.workunit.client.0.smithi063.stdout:8/33: truncate d1/f2 295225 0 2024-09-17T01:56:25.233 INFO:tasks.workunit.client.0.smithi063.stdout:6/58: mkdir dc/d10 0 2024-09-17T01:56:25.233 INFO:tasks.workunit.client.0.smithi063.stdout:7/47: dwrite d2/df/f10 [0,4194304] 0 2024-09-17T01:56:25.234 INFO:tasks.workunit.client.0.smithi063.stdout:6/59: mknod dc/c11 0 2024-09-17T01:56:25.235 INFO:tasks.workunit.client.0.smithi063.stdout:1/153: dread d0/d2d/f3d [0,4194304] 0 2024-09-17T01:56:25.235 INFO:tasks.workunit.client.0.smithi063.stdout:3/106: dwrite df/d12/f23 [0,4194304] 0 2024-09-17T01:56:25.235 INFO:tasks.workunit.client.0.smithi063.stdout:6/60: write f7 [942496,86353] 0 2024-09-17T01:56:25.236 INFO:tasks.workunit.client.0.smithi063.stdout:7/48: truncate d2/df/f10 4644483 0 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:1/154: creat d0/d1c/f41 x:0 0 0 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/61: rename f6 to dc/f12 0 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:3/107: mkdir df/d28 0 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:1/155: rmdir d0/d32 39 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/62: creat dc/f13 x:0 0 0 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:3/108: mknod df/d12/d1e/c29 0 2024-09-17T01:56:25.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/63: readlink l8 0 2024-09-17T01:56:25.241 INFO:tasks.workunit.client.0.smithi063.stdout:1/156: dread d0/d2d/f3d [0,4194304] 0 2024-09-17T01:56:25.242 INFO:tasks.workunit.client.0.smithi063.stdout:1/157: write d0/f1b [64148,93955] 0 2024-09-17T01:56:25.243 INFO:tasks.workunit.client.0.smithi063.stdout:7/49: write d2/df/f11 [1618529,6880] 0 2024-09-17T01:56:25.243 INFO:tasks.workunit.client.0.smithi063.stdout:3/109: truncate df/f11 90562 0 2024-09-17T01:56:25.244 INFO:tasks.workunit.client.0.smithi063.stdout:1/158: creat d0/d32/f42 x:0 0 0 2024-09-17T01:56:25.245 INFO:tasks.workunit.client.0.smithi063.stdout:3/110: creat df/d28/f2a x:0 0 0 2024-09-17T01:56:25.246 INFO:tasks.workunit.client.0.smithi063.stdout:6/64: dwrite dc/f13 [0,4194304] 0 2024-09-17T01:56:25.246 INFO:tasks.workunit.client.0.smithi063.stdout:1/159: symlink d0/d1c/l43 0 2024-09-17T01:56:25.246 INFO:tasks.workunit.client.0.smithi063.stdout:3/111: write df/d12/f23 [3813377,36471] 0 2024-09-17T01:56:25.247 INFO:tasks.workunit.client.0.smithi063.stdout:7/50: fsync d2/df/f11 0 2024-09-17T01:56:25.249 INFO:tasks.workunit.client.0.smithi063.stdout:1/160: mknod d0/d2d/d35/c44 0 2024-09-17T01:56:25.249 INFO:tasks.workunit.client.0.smithi063.stdout:6/65: unlink dc/cf 0 2024-09-17T01:56:25.249 INFO:tasks.workunit.client.0.smithi063.stdout:3/112: creat df/d12/d1e/f2b x:0 0 0 2024-09-17T01:56:25.249 INFO:tasks.workunit.client.0.smithi063.stdout:6/66: chown l5 1801 1 2024-09-17T01:56:25.251 INFO:tasks.workunit.client.0.smithi063.stdout:3/113: truncate df/d12/d1e/f2b 897981 0 2024-09-17T01:56:25.252 INFO:tasks.workunit.client.0.smithi063.stdout:6/67: mkdir dc/d14 0 2024-09-17T01:56:25.253 INFO:tasks.workunit.client.0.smithi063.stdout:6/68: readlink l8 0 2024-09-17T01:56:25.253 INFO:tasks.workunit.client.0.smithi063.stdout:3/114: write df/d12/d1e/f27 [1043966,20715] 0 2024-09-17T01:56:25.254 INFO:tasks.workunit.client.0.smithi063.stdout:6/69: write f3 [2490116,10251] 0 2024-09-17T01:56:25.254 INFO:tasks.workunit.client.0.smithi063.stdout:3/115: dread - df/d12/d1e/f24 zero size 2024-09-17T01:56:25.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/116: unlink l1 0 2024-09-17T01:56:25.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/70: mknod dc/d14/c15 0 2024-09-17T01:56:25.256 INFO:tasks.workunit.client.0.smithi063.stdout:7/51: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:56:25.257 INFO:tasks.workunit.client.0.smithi063.stdout:7/52: stat d2/df/f12 0 2024-09-17T01:56:25.258 INFO:tasks.workunit.client.0.smithi063.stdout:1/161: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:56:25.260 INFO:tasks.workunit.client.0.smithi063.stdout:3/117: symlink df/d12/d1e/l2c 0 2024-09-17T01:56:25.260 INFO:tasks.workunit.client.0.smithi063.stdout:7/53: rename d2/cc to d2/df/c13 0 2024-09-17T01:56:25.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/162: creat d0/d32/f45 x:0 0 0 2024-09-17T01:56:25.261 INFO:tasks.workunit.client.0.smithi063.stdout:3/118: chown df/d28/f2a 26 1 2024-09-17T01:56:25.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/163: link d0/d1c/c27 d0/d1c/c46 0 2024-09-17T01:56:25.265 INFO:tasks.workunit.client.0.smithi063.stdout:6/71: dwrite f3 [0,4194304] 0 2024-09-17T01:56:25.266 INFO:tasks.workunit.client.0.smithi063.stdout:6/72: write dc/f12 [1960096,119219] 0 2024-09-17T01:56:25.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/54: read d2/fb [742680,55317] 0 2024-09-17T01:56:25.269 INFO:tasks.workunit.client.0.smithi063.stdout:3/119: dwrite df/f20 [0,4194304] 0 2024-09-17T01:56:25.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/164: dwrite d0/d2d/f3d [0,4194304] 0 2024-09-17T01:56:25.273 INFO:tasks.workunit.client.0.smithi063.stdout:3/120: mkdir df/d12/d2d 0 2024-09-17T01:56:25.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/165: dread - d0/d32/f42 zero size 2024-09-17T01:56:25.274 INFO:tasks.workunit.client.0.smithi063.stdout:1/166: dread - d0/d32/f42 zero size 2024-09-17T01:56:25.275 INFO:tasks.workunit.client.0.smithi063.stdout:7/55: dwrite d2/df/f10 [0,4194304] 0 2024-09-17T01:56:25.276 INFO:tasks.workunit.client.0.smithi063.stdout:3/121: rename df/d12/f1f to df/d12/f2e 0 2024-09-17T01:56:25.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/56: chown d2/df/c13 33874 1 2024-09-17T01:56:25.277 INFO:tasks.workunit.client.0.smithi063.stdout:1/167: chown d0/d2d/l3c 1214 1 2024-09-17T01:56:25.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/57: creat d2/d3/f14 x:0 0 0 2024-09-17T01:56:25.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/168: creat d0/f47 x:0 0 0 2024-09-17T01:56:25.278 INFO:tasks.workunit.client.0.smithi063.stdout:7/58: write d2/f4 [5098562,70717] 0 2024-09-17T01:56:25.279 INFO:tasks.workunit.client.0.smithi063.stdout:7/59: getdents d2/df 0 2024-09-17T01:56:25.280 INFO:tasks.workunit.client.0.smithi063.stdout:7/60: write d2/df/f10 [5613572,86071] 0 2024-09-17T01:56:25.281 INFO:tasks.workunit.client.0.smithi063.stdout:7/61: chown d2/l6 775700567 1 2024-09-17T01:56:25.281 INFO:tasks.workunit.client.0.smithi063.stdout:3/122: write df/d12/f17 [166210,60751] 0 2024-09-17T01:56:25.282 INFO:tasks.workunit.client.0.smithi063.stdout:7/62: chown c0 1 1 2024-09-17T01:56:25.282 INFO:tasks.workunit.client.0.smithi063.stdout:3/123: write df/f25 [412582,84056] 0 2024-09-17T01:56:25.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/63: mkdir d2/d15 0 2024-09-17T01:56:25.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/64: mkdir d2/d16 0 2024-09-17T01:56:25.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/65: mkdir d2/d3/d17 0 2024-09-17T01:56:25.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/169: dwrite d0/f47 [0,4194304] 0 2024-09-17T01:56:25.287 INFO:tasks.workunit.client.0.smithi063.stdout:6/73: fdatasync dc/f12 0 2024-09-17T01:56:25.288 INFO:tasks.workunit.client.0.smithi063.stdout:3/124: fsync df/d12/d1e/f24 0 2024-09-17T01:56:25.289 INFO:tasks.workunit.client.0.smithi063.stdout:6/74: creat dc/d10/f16 x:0 0 0 2024-09-17T01:56:25.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/125: dread fe [0,4194304] 0 2024-09-17T01:56:25.292 INFO:tasks.workunit.client.0.smithi063.stdout:7/66: dwrite d2/df/f10 [0,4194304] 0 2024-09-17T01:56:25.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/67: creat d2/d3/f18 x:0 0 0 2024-09-17T01:56:25.294 INFO:tasks.workunit.client.0.smithi063.stdout:3/126: mkdir df/d12/d2d/d2f 0 2024-09-17T01:56:25.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/68: stat d2/df/f10 0 2024-09-17T01:56:25.294 INFO:tasks.workunit.client.0.smithi063.stdout:6/75: dread f7 [0,4194304] 0 2024-09-17T01:56:25.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/69: mknod d2/d16/c19 0 2024-09-17T01:56:25.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/70: symlink d2/d15/l1a 0 2024-09-17T01:56:25.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/170: truncate d0/f20 2912179 0 2024-09-17T01:56:25.300 INFO:tasks.workunit.client.0.smithi063.stdout:6/76: getdents dc/d10 0 2024-09-17T01:56:25.300 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:25.300 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:10809 4.28 4:148cf116:::10000003175.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T01:56:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:25.290120+0000", 2024-09-17T01:56:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.013236405999999999, 2024-09-17T01:56:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013311119, 2024-09-17T01:56:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:25.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10809 2024-09-17T01:56:25.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.303 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.290120+0000", 2024-09-17T01:56:25.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.290120+0000", 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.290121+0000", 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4300000000000001e-06 2024-09-17T01:56:25.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.295007+0000", 2024-09-17T01:56:25.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048855160000000003 2024-09-17T01:56:25.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.295023+0000", 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6651e-05 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.295035+0000", 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1586000000000001e-05 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.295148+0000", 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113405 2024-09-17T01:56:25.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.295301+0000", 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015229499999999999 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.295435+0000", 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133805 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.301546+0000", 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061110089999999997 2024-09-17T01:56:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:517 3.0 3:07a02702:::200.0000000c:head [write 963307~10036 [fadvise_dontneed] in=10036b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:25.299401+0000", 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039553840000000002, 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042782890000000002, 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299401+0000", 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299401+0000", 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299403+0000", 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4669999999999998e-06 2024-09-17T01:56:25.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299457+0000", 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3502999999999999e-05 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299520+0000", 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2910000000000006e-05 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299539+0000", 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8919e-05 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.299712+0000", 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017366899999999999 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.300006+0000", 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029395099999999998 2024-09-17T01:56:25.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303634+0000", 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036277940000000002 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:10810 4.2a 4:57a01e93:::10000003155.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:25.297335+0000", 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0060211420000000002, 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065342159999999998, 2024-09-17T01:56:25.312 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10810 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.297335+0000", 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.297335+0000", 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.297337+0000", 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9309999999999998e-06 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.301707+0000", 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043700279999999998 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.301722+0000", 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5243e-05 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.301734+0000", 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1762e-05 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.301821+0000", 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6617000000000001e-05 2024-09-17T01:56:25.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.301959+0000", 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138641 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:10813 4.1 4:80c3a855:::10000003136.00000000:head [read 295404~228884 out=228884b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:25.303646+0000", 2024-09-17T01:56:25.316 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9997101, 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032587300000000002, 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10813 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303646+0000", 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303646+0000", 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303647+0000", 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.04e-06 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303652+0000", 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2460000000000003e-06 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303665+0000", 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2123999999999999e-05 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303674+0000", 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4159999999999993e-06 2024-09-17T01:56:25.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303746+0000", 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2119999999999994e-05 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303798+0000", 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1547e-05 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:25.303972+0000", 2024-09-17T01:56:25.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017437999999999999 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 4 2024-09-17T01:56:25.321 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:25.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:1/171: truncate d0/f1a 1067582 0 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/77: symlink dc/d14/l17 0 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/78: rename dc/d10 to dc/d14/d18 0 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/71: dread d2/df/f11 [0,4194304] 0 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/72: fdatasync d2/fd 0 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/73: rmdir d2/d16 39 2024-09-17T01:56:25.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/74: getdents d2/df 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/172: dwrite d0/d2d/f33 [0,4194304] 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/173: stat d0/d1c/c2f 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/79: dwrite f7 [0,4194304] 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/174: write d0/f4 [2429607,83436] 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/80: fsync dc/f13 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/175: rename d0/f7 to d0/d1c/f48 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/176: rmdir d0 39 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/177: dwrite d0/f2 [0,4194304] 0 2024-09-17T01:56:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/178: symlink d0/d1c/l49 0 2024-09-17T01:56:25.337 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:56:25.366 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:25.369+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:25.428 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:25.429+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:25.486 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:25.487 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:25.487 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:25.487 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:25.487 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:25.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:25.546 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:25.549+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:25.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/19: sync 2024-09-17T01:56:25.550 INFO:tasks.workunit.client.0.smithi063.stdout:9/20: sync 2024-09-17T01:56:25.551 INFO:tasks.workunit.client.0.smithi063.stdout:0/20: symlink d1/lc 0 2024-09-17T01:56:25.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/21: rmdir d8 0 2024-09-17T01:56:25.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/21: dread - d1/fa zero size 2024-09-17T01:56:25.553 INFO:tasks.workunit.client.0.smithi063.stdout:0/22: stat d1 0 2024-09-17T01:56:25.553 INFO:tasks.workunit.client.0.smithi063.stdout:9/22: write f7 [241485,18390] 0 2024-09-17T01:56:25.555 INFO:tasks.workunit.client.0.smithi063.stdout:0/23: mknod d1/d3/db/cd 0 2024-09-17T01:56:25.556 INFO:tasks.workunit.client.0.smithi063.stdout:0/24: write d1/fa [821774,25522] 0 2024-09-17T01:56:25.558 INFO:tasks.workunit.client.0.smithi063.stdout:0/25: mknod d1/d3/ce 0 2024-09-17T01:56:25.558 INFO:tasks.workunit.client.0.smithi063.stdout:9/23: read f7 [128928,20795] 0 2024-09-17T01:56:25.566 INFO:tasks.workunit.client.0.smithi063.stdout:9/24: dread f7 [0,4194304] 0 2024-09-17T01:56:25.566 INFO:tasks.workunit.client.0.smithi063.stdout:9/25: chown c2 120543481 1 2024-09-17T01:56:25.566 INFO:tasks.workunit.client.0.smithi063.stdout:9/26: dread f7 [0,4194304] 0 2024-09-17T01:56:25.575 INFO:tasks.workunit.client.0.smithi063.stdout:0/26: dwrite d1/d3/f8 [0,4194304] 0 2024-09-17T01:56:25.583 INFO:tasks.workunit.client.0.smithi063.stdout:9/27: dwrite f7 [0,4194304] 0 2024-09-17T01:56:25.590 INFO:tasks.workunit.client.0.smithi063.stdout:9/28: truncate f7 111116 0 2024-09-17T01:56:25.594 INFO:tasks.workunit.client.0.smithi063.stdout:9/29: dread f7 [0,4194304] 0 2024-09-17T01:56:25.596 INFO:tasks.workunit.client.0.smithi063.stdout:9/30: mkdir d9 0 2024-09-17T01:56:25.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/31: rename c2 to d9/ca 0 2024-09-17T01:56:25.599 INFO:tasks.workunit.client.0.smithi063.stdout:9/32: stat c4 0 2024-09-17T01:56:25.599 INFO:tasks.workunit.client.0.smithi063.stdout:0/27: dwrite d1/d3/f4 [0,4194304] 0 2024-09-17T01:56:25.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/33: chown c4 1 1 2024-09-17T01:56:25.601 INFO:tasks.workunit.client.0.smithi063.stdout:0/28: chown d1/d3/db 0 1 2024-09-17T01:56:25.610 INFO:tasks.workunit.client.0.smithi063.stdout:0/29: dread d1/d3/f8 [0,4194304] 0 2024-09-17T01:56:25.611 INFO:tasks.workunit.client.0.smithi063.stdout:6/81: sync 2024-09-17T01:56:25.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/127: sync 2024-09-17T01:56:25.612 INFO:tasks.workunit.client.0.smithi063.stdout:8/34: sync 2024-09-17T01:56:25.612 INFO:tasks.workunit.client.0.smithi063.stdout:7/75: sync 2024-09-17T01:56:25.612 INFO:tasks.workunit.client.0.smithi063.stdout:1/179: sync 2024-09-17T01:56:25.613 INFO:tasks.workunit.client.0.smithi063.stdout:4/59: sync 2024-09-17T01:56:25.613 INFO:tasks.workunit.client.0.smithi063.stdout:5/78: sync 2024-09-17T01:56:25.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/27: sync 2024-09-17T01:56:25.614 INFO:tasks.workunit.client.0.smithi063.stdout:0/30: symlink d1/d3/lf 0 2024-09-17T01:56:25.614 INFO:tasks.workunit.client.0.smithi063.stdout:3/128: fsync df/f1c 0 2024-09-17T01:56:25.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/82: write dc/f13 [4872853,35939] 0 2024-09-17T01:56:25.614 INFO:tasks.workunit.client.0.smithi063.stdout:1/180: read d0/f20 [117581,56703] 0 2024-09-17T01:56:25.615 INFO:tasks.workunit.client.0.smithi063.stdout:5/79: rename d6/f11 to d6/f12 0 2024-09-17T01:56:25.618 INFO:tasks.workunit.client.0.smithi063.stdout:4/60: getdents de/d18 0 2024-09-17T01:56:25.618 INFO:tasks.workunit.client.0.smithi063.stdout:5/80: write d6/da/fe [4233116,17710] 0 2024-09-17T01:56:25.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/83: mkdir dc/d14/d19 0 2024-09-17T01:56:25.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/181: creat d0/f4a x:0 0 0 2024-09-17T01:56:25.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/61: truncate de/f16 771848 0 2024-09-17T01:56:25.628 INFO:tasks.workunit.client.0.smithi063.stdout:7/76: dread d2/df/f10 [0,4194304] 0 2024-09-17T01:56:25.629 INFO:tasks.workunit.client.0.smithi063.stdout:8/35: dwrite f0 [0,4194304] 0 2024-09-17T01:56:25.629 INFO:tasks.workunit.client.0.smithi063.stdout:1/182: mknod d0/d32/c4b 0 2024-09-17T01:56:25.630 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:25.634+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:25.631 INFO:tasks.workunit.client.0.smithi063.stdout:1/183: chown d0/f4a 173393 1 2024-09-17T01:56:25.632 INFO:tasks.workunit.client.0.smithi063.stdout:0/31: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:25.632 INFO:tasks.workunit.client.0.smithi063.stdout:2/28: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:56:25.633 INFO:tasks.workunit.client.0.smithi063.stdout:1/184: write d0/f4a [895264,85430] 0 2024-09-17T01:56:25.634 INFO:tasks.workunit.client.0.smithi063.stdout:3/129: dwrite df/d12/d1e/f2b [0,4194304] 0 2024-09-17T01:56:25.635 INFO:tasks.workunit.client.0.smithi063.stdout:3/130: chown df/d28/f2a 0 1 2024-09-17T01:56:25.636 INFO:tasks.workunit.client.0.smithi063.stdout:4/62: creat de/d17/f19 x:0 0 0 2024-09-17T01:56:25.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/29: creat d3/f8 x:0 0 0 2024-09-17T01:56:25.637 INFO:tasks.workunit.client.0.smithi063.stdout:1/185: creat d0/d1c/f4c x:0 0 0 2024-09-17T01:56:25.638 INFO:tasks.workunit.client.0.smithi063.stdout:8/36: creat d1/d7/f9 x:0 0 0 2024-09-17T01:56:25.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/131: mkdir df/d12/d30 0 2024-09-17T01:56:25.640 INFO:tasks.workunit.client.0.smithi063.stdout:6/84: dread dc/f12 [0,4194304] 0 2024-09-17T01:56:25.640 INFO:tasks.workunit.client.0.smithi063.stdout:7/77: creat d2/d16/f1b x:0 0 0 2024-09-17T01:56:25.641 INFO:tasks.workunit.client.0.smithi063.stdout:4/63: chown de/c12 1000489 1 2024-09-17T01:56:25.641 INFO:tasks.workunit.client.0.smithi063.stdout:6/85: read f3 [2572888,79324] 0 2024-09-17T01:56:25.641 INFO:tasks.workunit.client.0.smithi063.stdout:4/64: fsync f7 0 2024-09-17T01:56:25.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/78: chown d2/le 147 1 2024-09-17T01:56:25.642 INFO:tasks.workunit.client.0.smithi063.stdout:7/79: write d2/f4 [4240126,122253] 0 2024-09-17T01:56:25.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/65: dread f1 [0,4194304] 0 2024-09-17T01:56:25.643 INFO:tasks.workunit.client.0.smithi063.stdout:1/186: symlink d0/d32/l4d 0 2024-09-17T01:56:25.643 INFO:tasks.workunit.client.0.smithi063.stdout:8/37: symlink d1/la 0 2024-09-17T01:56:25.643 INFO:tasks.workunit.client.0.smithi063.stdout:2/30: rename d3/f5 to d3/f9 0 2024-09-17T01:56:25.643 INFO:tasks.workunit.client.0.smithi063.stdout:3/132: unlink df/f25 0 2024-09-17T01:56:25.643 INFO:tasks.workunit.client.0.smithi063.stdout:6/86: creat dc/d14/d19/f1a x:0 0 0 2024-09-17T01:56:25.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/80: creat d2/f1c x:0 0 0 2024-09-17T01:56:25.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/66: chown cb 411 1 2024-09-17T01:56:25.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/187: rmdir d0/d2d/d35 39 2024-09-17T01:56:25.644 INFO:tasks.workunit.client.0.smithi063.stdout:6/87: stat cb 0 2024-09-17T01:56:25.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/32: dwrite d1/d3/f4 [4194304,4194304] 0 2024-09-17T01:56:25.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/133: dread - df/d28/f2a zero size 2024-09-17T01:56:25.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/81: truncate d6/da/fe 2733923 0 2024-09-17T01:56:25.645 INFO:tasks.workunit.client.0.smithi063.stdout:2/31: truncate d3/f6 5011387 0 2024-09-17T01:56:25.645 INFO:tasks.workunit.client.0.smithi063.stdout:8/38: rename d1/l6 to d1/d7/lb 0 2024-09-17T01:56:25.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/188: write d0/d1c/f4c [526449,35835] 0 2024-09-17T01:56:25.646 INFO:tasks.workunit.client.0.smithi063.stdout:5/82: unlink d6/c7 0 2024-09-17T01:56:25.647 INFO:tasks.workunit.client.0.smithi063.stdout:0/33: write d1/f2 [2477186,64152] 0 2024-09-17T01:56:25.648 INFO:tasks.workunit.client.0.smithi063.stdout:6/88: mkdir dc/d1b 0 2024-09-17T01:56:25.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/32: write d3/f9 [651715,15113] 0 2024-09-17T01:56:25.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/33: read d3/f6 [1818120,3985] 0 2024-09-17T01:56:25.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/34: write d1/f2 [1807425,39586] 0 2024-09-17T01:56:25.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/83: mkdir d6/d9/d13 0 2024-09-17T01:56:25.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/89: creat dc/d14/d19/f1c x:0 0 0 2024-09-17T01:56:25.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/84: readlink d6/l10 0 2024-09-17T01:56:25.653 INFO:tasks.workunit.client.0.smithi063.stdout:0/35: read d1/f6 [615766,85534] 0 2024-09-17T01:56:25.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/90: chown dc/ld 117706404 1 2024-09-17T01:56:25.654 INFO:tasks.workunit.client.0.smithi063.stdout:8/39: dread d1/f8 [0,4194304] 0 2024-09-17T01:56:25.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/81: dread d2/f7 [0,4194304] 0 2024-09-17T01:56:25.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/134: dread df/f20 [0,4194304] 0 2024-09-17T01:56:25.661 INFO:tasks.workunit.client.0.smithi063.stdout:7/82: chown c0 13 1 2024-09-17T01:56:25.661 INFO:tasks.workunit.client.0.smithi063.stdout:4/67: dwrite de/f14 [0,4194304] 0 2024-09-17T01:56:25.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/36: mkdir d1/d3/d10 0 2024-09-17T01:56:25.665 INFO:tasks.workunit.client.0.smithi063.stdout:6/91: creat dc/d14/d19/f1d x:0 0 0 2024-09-17T01:56:25.665 INFO:tasks.workunit.client.0.smithi063.stdout:4/68: stat de/c12 0 2024-09-17T01:56:25.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/189: dwrite d0/d1c/f48 [0,4194304] 0 2024-09-17T01:56:25.666 INFO:tasks.workunit.client.0.smithi063.stdout:3/135: symlink df/d12/d1e/l31 0 2024-09-17T01:56:25.666 INFO:tasks.workunit.client.0.smithi063.stdout:6/92: chown dc/f13 78 1 2024-09-17T01:56:25.668 INFO:tasks.workunit.client.0.smithi063.stdout:2/34: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:56:25.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/190: truncate d0/d1c/f41 459257 0 2024-09-17T01:56:25.671 INFO:tasks.workunit.client.0.smithi063.stdout:6/93: truncate dc/d14/d18/f16 110142 0 2024-09-17T01:56:25.675 INFO:tasks.workunit.client.0.smithi063.stdout:2/35: creat d3/d7/fa x:0 0 0 2024-09-17T01:56:25.675 INFO:tasks.workunit.client.0.smithi063.stdout:7/83: getdents d2 0 2024-09-17T01:56:25.675 INFO:tasks.workunit.client.0.smithi063.stdout:6/94: creat dc/f1e x:0 0 0 2024-09-17T01:56:25.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/84: fsync d2/d3/f14 0 2024-09-17T01:56:25.677 INFO:tasks.workunit.client.0.smithi063.stdout:0/37: dread d1/f2 [0,4194304] 0 2024-09-17T01:56:25.677 INFO:tasks.workunit.client.0.smithi063.stdout:2/36: symlink d3/d7/lb 0 2024-09-17T01:56:25.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/136: truncate fc 469925 0 2024-09-17T01:56:25.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/40: dwrite d1/f8 [0,4194304] 0 2024-09-17T01:56:25.679 INFO:tasks.workunit.client.0.smithi063.stdout:0/38: rmdir d1 39 2024-09-17T01:56:25.679 INFO:tasks.workunit.client.0.smithi063.stdout:7/85: rename d2/d16 to d2/d1d 0 2024-09-17T01:56:25.681 INFO:tasks.workunit.client.0.smithi063.stdout:4/69: dwrite de/f16 [0,4194304] 0 2024-09-17T01:56:25.681 INFO:tasks.workunit.client.0.smithi063.stdout:8/41: read f0 [5905373,27470] 0 2024-09-17T01:56:25.681 INFO:tasks.workunit.client.0.smithi063.stdout:1/191: dread d0/d2d/f3d [0,4194304] 0 2024-09-17T01:56:25.681 INFO:tasks.workunit.client.0.smithi063.stdout:5/85: dread d6/da/fe [0,4194304] 0 2024-09-17T01:56:25.681 INFO:tasks.workunit.client.0.smithi063.stdout:8/42: fsync f0 0 2024-09-17T01:56:25.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/86: creat d2/d3/f1e x:0 0 0 2024-09-17T01:56:25.682 INFO:tasks.workunit.client.0.smithi063.stdout:1/192: dread - d0/d32/f45 zero size 2024-09-17T01:56:25.682 INFO:tasks.workunit.client.0.smithi063.stdout:3/137: creat df/d12/d30/f32 x:0 0 0 2024-09-17T01:56:25.682 INFO:tasks.workunit.client.0.smithi063.stdout:4/70: fdatasync f1 0 2024-09-17T01:56:25.683 INFO:tasks.workunit.client.0.smithi063.stdout:5/86: mknod d6/da/c14 0 2024-09-17T01:56:25.683 INFO:tasks.workunit.client.0.smithi063.stdout:8/43: creat d1/d7/fc x:0 0 0 2024-09-17T01:56:25.683 INFO:tasks.workunit.client.0.smithi063.stdout:1/193: unlink d0/d1c/f29 0 2024-09-17T01:56:25.684 INFO:tasks.workunit.client.0.smithi063.stdout:5/87: unlink d6/cb 0 2024-09-17T01:56:25.688 INFO:tasks.workunit.client.0.smithi063.stdout:0/39: dread d1/f7 [0,4194304] 0 2024-09-17T01:56:25.690 INFO:tasks.workunit.client.0.smithi063.stdout:1/194: mkdir d0/d2d/d35/d3f/d4e 0 2024-09-17T01:56:25.690 INFO:tasks.workunit.client.0.smithi063.stdout:0/40: fdatasync d1/f2 0 2024-09-17T01:56:25.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/37: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:56:25.692 INFO:tasks.workunit.client.0.smithi063.stdout:1/195: write d0/f4a [1489854,77942] 0 2024-09-17T01:56:25.692 INFO:tasks.workunit.client.0.smithi063.stdout:8/44: truncate d1/f8 3071767 0 2024-09-17T01:56:25.693 INFO:tasks.workunit.client.0.smithi063.stdout:0/41: read d1/f7 [2341363,125675] 0 2024-09-17T01:56:25.695 INFO:tasks.workunit.client.0.smithi063.stdout:2/38: mknod d3/cc 0 2024-09-17T01:56:25.695 INFO:tasks.workunit.client.0.smithi063.stdout:1/196: chown d0/d32/l4d 1 1 2024-09-17T01:56:25.696 INFO:tasks.workunit.client.0.smithi063.stdout:0/42: write d1/f2 [935760,19068] 0 2024-09-17T01:56:25.697 INFO:tasks.workunit.client.0.smithi063.stdout:5/88: dwrite d6/fd [4194304,4194304] 0 2024-09-17T01:56:25.697 INFO:tasks.workunit.client.0.smithi063.stdout:7/87: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:56:25.698 INFO:tasks.workunit.client.0.smithi063.stdout:0/43: chown d1/d3 9758876 1 2024-09-17T01:56:25.698 INFO:tasks.workunit.client.0.smithi063.stdout:1/197: dread - d0/d32/f3e zero size 2024-09-17T01:56:25.698 INFO:tasks.workunit.client.0.smithi063.stdout:2/39: dread f2 [0,4194304] 0 2024-09-17T01:56:25.698 INFO:tasks.workunit.client.0.smithi063.stdout:0/44: readlink d1/lc 0 2024-09-17T01:56:25.699 INFO:tasks.workunit.client.0.smithi063.stdout:2/40: dread f2 [0,4194304] 0 2024-09-17T01:56:25.700 INFO:tasks.workunit.client.0.smithi063.stdout:3/138: dwrite fe [0,4194304] 0 2024-09-17T01:56:25.701 INFO:tasks.workunit.client.0.smithi063.stdout:5/89: creat d6/da/f15 x:0 0 0 2024-09-17T01:56:25.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/139: creat df/f33 x:0 0 0 2024-09-17T01:56:25.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/45: getdents d1/d3 0 2024-09-17T01:56:25.702 INFO:tasks.workunit.client.0.smithi063.stdout:3/140: mknod df/d28/c34 0 2024-09-17T01:56:25.706 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:25.706 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:25.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:25.706 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:25.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.707 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:25.707 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:25.707 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.332538005, 2024-09-17T01:56:25.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:25.708 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.709 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:25.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.709 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:25.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:25.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:25.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:25.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:25.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:25.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:25.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:25.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:25.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:25.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:25.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:25.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:25.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:25.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:25.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1345419239999996, 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:25.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:25.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1336586710000001, 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:25.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:25.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:25.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1316591520000001, 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1306024419999998, 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1275241100000004, 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1256185930000004, 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1233848960000001, 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1224487600000002, 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1004962620000001, 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.097450254, 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0922578469999999, 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0868983029999999, 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0824257279999996, 2024-09-17T01:56:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0709135190000003, 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0629623290000003, 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0586438779999998, 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0539036319999999, 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0514219440000003, 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.050426721, 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:25.861 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:25.863 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:25.865+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:25.863 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/90: truncate d6/f12 547471 0 2024-09-17T01:56:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:8/45: dwrite d1/f8 [0,4194304] 0 2024-09-17T01:56:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:1/198: dwrite d0/d1c/f28 [0,4194304] 0 2024-09-17T01:56:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:3/141: write df/f11 [809288,21548] 0 2024-09-17T01:56:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:3/142: rmdir df/d12/d2d 39 2024-09-17T01:56:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:3/143: dread - df/d12/f16 zero size 2024-09-17T01:56:25.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/46: dread d1/d3/f4 [4194304,4194304] 0 2024-09-17T01:56:25.904 INFO:tasks.workunit.client.0.smithi063.stdout:7/88: dwrite d2/f1c [0,4194304] 0 2024-09-17T01:56:25.904 INFO:tasks.workunit.client.0.smithi063.stdout:2/41: dwrite d3/f6 [0,4194304] 0 2024-09-17T01:56:25.904 INFO:tasks.workunit.client.0.smithi063.stdout:7/89: symlink d2/d15/l1f 0 2024-09-17T01:56:25.904 INFO:tasks.workunit.client.0.smithi063.stdout:2/42: fdatasync f2 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:7/90: stat d2/d1d/f1b 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/199: dwrite d0/f1a [0,4194304] 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/91: fdatasync d6/fd 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:2/43: write d3/f6 [2816347,77547] 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:7/91: rename d2/d3/f18 to d2/df/f20 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/200: symlink d0/d32/l4f 0 2024-09-17T01:56:25.905 INFO:tasks.workunit.client.0.smithi063.stdout:7/92: stat d2/f1c 0 2024-09-17T01:56:25.906 INFO:tasks.workunit.client.0.smithi063.stdout:8/46: dwrite d1/d7/fc [0,4194304] 0 2024-09-17T01:56:25.906 INFO:tasks.workunit.client.0.smithi063.stdout:9/34: sync 2024-09-17T01:56:25.906 INFO:tasks.workunit.client.0.smithi063.stdout:6/95: sync 2024-09-17T01:56:25.906 INFO:tasks.workunit.client.0.smithi063.stdout:5/92: mknod d6/d9/c16 0 2024-09-17T01:56:25.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/47: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:8/47: fsync d1/f8 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:2/44: read d3/f4 [2449393,6957] 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:1/201: truncate d0/f6 1224207 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:9/35: dread f7 [0,4194304] 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/93: mknod d6/da/c17 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:3/144: dwrite df/d12/d1e/f27 [0,4194304] 0 2024-09-17T01:56:25.907 INFO:tasks.workunit.client.0.smithi063.stdout:2/45: link d3/d7/fa d3/d7/fd 0 2024-09-17T01:56:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:0/48: link d1/d3/lf d1/d3/l11 0 2024-09-17T01:56:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/202: write d0/d32/f42 [458888,119429] 0 2024-09-17T01:56:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:0/49: chown f0 0 1 2024-09-17T01:56:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/203: write d0/f2 [136312,76581] 0 2024-09-17T01:56:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/93: truncate d2/d1d/f1b 249002 0 2024-09-17T01:56:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:3/145: chown df/d12 1023616971 1 2024-09-17T01:56:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:5/94: creat d6/f18 x:0 0 0 2024-09-17T01:56:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/204: stat d0 0 2024-09-17T01:56:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:8/48: truncate f0 946460 0 2024-09-17T01:56:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:5/95: fdatasync d6/fd 0 2024-09-17T01:56:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:3/146: write df/d12/f16 [890020,21995] 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/205: write d0/f1a [3966774,120282] 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:8/49: mknod d1/cd 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/206: fsync d0/d1c/f4c 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:6/96: dread dc/f12 [0,4194304] 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:7/94: getdents d2/d1d 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:2/46: dread d3/f9 [0,4194304] 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/207: mkdir d0/d32/d50 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:9/36: dwrite f7 [0,4194304] 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:3/147: rename df/d12/c1d to df/d12/d2d/d2f/c35 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:7/95: write d2/df/f10 [4395718,114427] 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/208: mknod d0/d32/c51 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/209: stat d0/f47 0 2024-09-17T01:56:25.910 INFO:tasks.workunit.client.0.smithi063.stdout:8/50: dread f0 [0,4194304] 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/96: dread d6/fd [4194304,4194304] 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:0/50: dwrite d1/f6 [0,4194304] 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:3/148: creat df/d12/d2d/f36 x:0 0 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:2/47: truncate d3/d7/fd 271649 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/210: write d0/f4a [1485543,119122] 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/96: write d2/fb [1223683,122849] 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:6/97: getdents dc/d14/d19 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:3/149: read - df/d12/f2e zero size 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:0/51: unlink d1/d3/l11 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:3/150: symlink df/d12/d1e/l37 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:6/98: rename dc/d14/d19/f1d to dc/d14/f1f 0 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:4/71: sync 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:6/99: dread - dc/d14/d19/f1a zero size 2024-09-17T01:56:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:4/72: readlink l6 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:0/52: rename d1/d3/ce to d1/d3/db/c12 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:3/151: fdatasync fc 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:6/100: mkdir dc/d14/d19/d20 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:6/101: fdatasync dc/f12 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:9/37: truncate f7 2855120 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:2/48: write d3/d7/fd [880695,59640] 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/97: truncate d2/df/f10 3982128 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:4/73: truncate fc 771267 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/97: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:4/74: rename de/d17/f19 to de/d18/f1a 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:0/53: dwrite d1/f6 [0,4194304] 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:4/75: stat de/c12 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/98: link d2/d1d/c19 d2/d3/d17/c21 0 2024-09-17T01:56:25.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/98: mkdir d6/da/d19 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:6/102: dwrite f1 [0,4194304] 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:8/51: dwrite d1/d7/f9 [0,4194304] 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:7/99: mkdir d2/d3/d22 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:5/99: write d6/f12 [327751,12081] 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:6/103: write dc/d14/d19/f1c [1017624,46821] 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:2/49: dwrite d3/f9 [4194304,4194304] 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:4/76: mkdir de/d17/d1b 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:8/52: unlink d1/d7/fc 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:5/100: symlink d6/l1a 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:7/100: rename d2/d3/f14 to d2/f23 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:8/53: mknod d1/d7/ce 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:3/152: sync 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:5/101: creat d6/da/f1b x:0 0 0 2024-09-17T01:56:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:7/101: symlink d2/d3/l24 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/54: unlink d1/d7/ce 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:7/102: read d2/fd [3770239,64437] 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/55: rmdir d1 39 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:6/104: dread f1 [0,4194304] 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:6/105: mkdir dc/d14/d18/d21 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/56: dread d1/f2 [0,4194304] 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:7/103: rename d2/d1d to d2/d3/d17/d25 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:9/38: truncate f7 1496628 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/57: mkdir d1/df 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:7/104: dread - d2/f23 zero size 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:3/153: dread df/f20 [0,4194304] 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:0/54: truncate d1/d3/f8 2134189 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:2/50: truncate d3/d7/fa 532292 0 2024-09-17T01:56:25.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/58: creat d1/f10 x:0 0 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:2/51: chown l1 7774284 1 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:4/77: write fc [851924,6195] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:2/52: write f2 [454309,55881] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:4/78: stat f1 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/102: dwrite d6/f18 [0,4194304] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:8/59: write f0 [727243,88214] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:4/79: dread - f7 zero size 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/55: write d1/f7 [180342,109808] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:9/39: dread f7 [0,4194304] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/103: symlink d6/d9/l1c 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:6/106: dwrite dc/f13 [0,4194304] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:8/60: mknod d1/c11 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:3/154: dwrite df/d12/d30/f32 [0,4194304] 0 2024-09-17T01:56:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:9/40: write f7 [1504856,21362] 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:8/61: dread d1/f2 [0,4194304] 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/56: creat d1/d3/db/f13 x:0 0 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:6/107: mknod dc/d14/c22 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:9/41: mknod d9/cb 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:7/105: dwrite d2/f7 [0,4194304] 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:2/53: dread d3/f9 [4194304,4194304] 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:4/80: creat de/d17/d1b/f1c x:0 0 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:8/62: mkdir d1/d7/d12 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:9/42: creat d9/fc x:0 0 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:5/104: dread d6/f18 [0,4194304] 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/57: mkdir d1/d3/db/d14 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:9/43: readlink l5 0 2024-09-17T01:56:25.916 INFO:tasks.workunit.client.0.smithi063.stdout:5/105: write d6/da/f15 [470659,87155] 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:0/58: truncate f0 1011353 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/108: creat dc/d14/d19/d20/f23 x:0 0 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:0/59: chown d1/d3/db/d14 5499 1 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:2/54: dread d3/f4 [0,4194304] 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:1/211: dread d0/f4a [0,4194304] 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:5/106: dread d6/da/fe [0,4194304] 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/106: dwrite d2/d3/d17/d25/f1b [0,4194304] 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/109: link dc/d14/c15 dc/c24 0 2024-09-17T01:56:25.917 INFO:tasks.workunit.client.0.smithi063.stdout:3/155: dwrite df/d12/f2e [0,4194304] 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/63: dwrite d1/f10 [0,4194304] 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/55: symlink d3/d7/le 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:6/110: unlink l5 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/60: dread d1/f7 [0,4194304] 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:9/44: dwrite f7 [0,4194304] 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:1/212: mknod d0/d32/d50/c52 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:6/111: chown dc/d14/d18/d21 152739 1 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:6/112: chown dc/f12 14059 1 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:5/107: mkdir d6/d9/d13/d1d 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/64: readlink d1/d7/lb 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/65: stat d1/d7/lb 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:6/113: mknod dc/d14/d18/c25 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/56: truncate d3/d7/fd 865171 0 2024-09-17T01:56:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/66: rmdir d1/d7/d12 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:1/213: dread d0/f1b [0,4194304] 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/108: stat d6/da/d19 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/109: read d6/f12 [3036045,128425] 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:1/214: read d0/f1b [587915,108861] 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/45: truncate f7 3370273 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:6/114: link f3 dc/d14/d18/d21/f26 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/46: truncate d9/fc 882260 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:4/81: sync 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/110: creat d6/d9/d13/f1e x:0 0 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:0/61: dwrite d1/d3/f8 [0,4194304] 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/111: read d6/f12 [2114394,117703] 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/47: mknod d9/cd 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/112: stat d6/fd 0 2024-09-17T01:56:25.919 INFO:tasks.workunit.client.0.smithi063.stdout:4/82: creat de/d18/f1d x:0 0 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:7/107: dwrite d2/df/f11 [0,4194304] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:8/67: dwrite d1/f8 [0,4194304] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:9/48: mkdir d9/de 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:3/156: dwrite f3 [0,4194304] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/215: dwrite d0/d2d/f33 [0,4194304] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:8/68: chown d1 65 1 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:7/108: write d2/f7 [977991,94374] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:8/69: write d1/f8 [4332138,71513] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:6/115: dread dc/d14/d18/d21/f26 [0,4194304] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/216: write d0/f14 [1187444,13975] 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:5/113: getdents d6/da 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:9/49: creat d9/de/ff x:0 0 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:7/109: symlink d2/d3/l26 0 2024-09-17T01:56:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:8/70: rmdir d1/d7 39 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:1/217: rmdir d0/d2d/d35 39 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:0/62: link d1/d3/db/cd d1/d3/db/d14/c15 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:9/50: fdatasync f7 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:5/114: mknod d6/da/c1f 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/110: write d2/d3/f1e [28001,94586] 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:6/116: link dc/d14/l17 dc/d14/d18/d21/l27 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/111: write d2/fd [2574342,24132] 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:9/51: write d9/de/ff [636504,25699] 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:1/218: dread d0/f6 [0,4194304] 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:5/115: truncate d6/f18 4943593 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/71: rename d1/d7/f9 to d1/d7/f13 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:6/117: mknod dc/c28 0 2024-09-17T01:56:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:4/83: dwrite de/f10 [0,4194304] 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:5/116: chown d6/l8 336217 1 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:1/219: truncate d0/d32/f45 1010637 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:1/220: chown d0/d2d/c38 1669 1 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:4/84: creat de/d17/d1b/f1e x:0 0 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:1/221: write d0/d32/f42 [1597552,91686] 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:3/157: truncate fe 1584243 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:7/112: getdents d2/d3/d17 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:0/63: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:7/113: mkdir d2/d3/d27 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:0/64: symlink d1/d3/db/l16 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:0/65: chown d1/d3/lf 587299 1 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:5/117: dread d6/f18 [0,4194304] 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:5/118: symlink d6/d9/d13/d1d/l20 0 2024-09-17T01:56:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:5/119: creat d6/d9/d13/d1d/f21 x:0 0 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/114: dread d2/fb [0,4194304] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/120: fsync d6/da/f15 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:4/85: dwrite de/d18/f1d [0,4194304] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:4/86: write f1 [1113571,53214] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/121: write d6/f18 [3907491,18427] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/122: fdatasync d6/d9/d13/d1d/f21 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/222: dread d0/d1c/f41 [0,4194304] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/123: readlink d6/d9/l1c 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:0/66: dwrite d1/d3/f8 [4194304,4194304] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:3/158: write fc [698837,17507] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:0/67: write d1/fa [196168,56893] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/115: dread d2/fd [0,4194304] 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:0/68: readlink d1/lc 0 2024-09-17T01:56:25.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/223: rmdir d0/d2d 39 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:3/159: symlink df/d12/d2d/l38 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:0/69: write d1/d3/db/f13 [177656,122009] 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:5/124: symlink d6/l22 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/87: dread de/f10 [0,4194304] 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:7/116: link d2/df/f12 d2/d3/d27/f28 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:3/160: mkdir df/d12/d1e/d39 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:1/224: rmdir d0/d32/d50 39 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:7/117: mknod d2/df/c29 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:0/70: mknod d1/d3/db/c17 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:1/225: fdatasync d0/d1c/f4c 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:5/125: mkdir d6/d23 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/88: rename de/c12 to de/d17/d1b/c1f 0 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:0/71: chown d1/d3/l9 1 1 2024-09-17T01:56:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:6/118: dread dc/d14/d19/f1c [0,4194304] 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/89: symlink de/d17/l20 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:1/226: mknod d0/d2d/c53 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/126: dread d6/f12 [0,4194304] 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:6/119: dread f3 [0,4194304] 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/72: dread d1/f7 [0,4194304] 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/161: truncate df/d12/f23 2322763 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:6/120: chown dc/d14/c22 2201134 1 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/162: chown c9 197 1 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/127: creat d6/d9/d13/d1d/f24 x:0 0 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:7/118: dwrite d2/f23 [0,4194304] 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:1/227: dread d0/d1c/f48 [0,4194304] 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/73: mkdir d1/d3/db/d18 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/163: truncate df/f33 855604 0 2024-09-17T01:56:25.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/90: getdents de/d17 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/119: unlink d2/d3/l24 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/128: rename d6/da/c1f to d6/da/d19/c25 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:6/121: chown dc/d14/c15 13508054 1 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/120: mkdir d2/d15/d2a 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/164: chown df/d12/d1e/f21 51545743 1 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:1/228: truncate d0/d1c/f4c 850669 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:0/74: write d1/d3/f4 [2186944,89716] 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:6/122: dread - dc/d14/d19/d20/f23 zero size 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/91: rename f1 to de/d18/f21 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/129: creat d6/da/d19/f26 x:0 0 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/92: write de/d18/f1d [3866883,4886] 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/130: truncate d6/d9/d13/d1d/f24 946781 0 2024-09-17T01:56:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/121: symlink d2/df/l2b 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/75: creat d1/f19 x:0 0 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/131: creat d6/da/f27 x:0 0 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/165: mkdir df/d12/d3a 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:1/229: write d0/d1c/f48 [426097,67379] 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:6/123: write f1 [2759919,117897] 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/166: readlink l8 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/122: write d2/f7 [4791570,64409] 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/132: dread - d6/d9/d13/f1e zero size 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/123: chown d2/df/c29 612736727 1 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/167: rmdir df/d12/d1e 39 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/76: creat d1/d3/db/d18/f1a x:0 0 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:6/124: creat dc/d1b/f29 x:0 0 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/168: read f3 [3722565,97446] 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/77: fdatasync d1/f2 0 2024-09-17T01:56:25.927 INFO:tasks.workunit.client.0.smithi063.stdout:4/93: dread de/f10 [0,4194304] 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/124: fdatasync d2/df/f12 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:1/230: link d0/f6 d0/d32/d50/f54 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/78: mkdir d1/d3/d1b 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/94: write de/d18/f1d [1964859,108980] 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:3/169: mknod df/d12/d1e/d39/c3b 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/79: creat d1/d3/db/d14/f1c x:0 0 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/125: getdents d2/d3/d27 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:6/125: symlink dc/d14/d18/l2a 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:3/170: write df/d28/f2a [549793,69332] 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/126: symlink d2/d3/d17/l2c 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/95: write f4 [1786356,12213] 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:6/126: symlink dc/d14/d19/d20/l2b 0 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/96: dread - f7 zero size 2024-09-17T01:56:25.928 INFO:tasks.workunit.client.0.smithi063.stdout:6/127: dread - dc/d14/d19/d20/f23 zero size 2024-09-17T01:56:25.929 INFO:tasks.workunit.client.0.smithi063.stdout:4/97: rename de/d17 to de/d17/d1b/d22 22 2024-09-17T01:56:25.929 INFO:tasks.workunit.client.0.smithi063.stdout:4/98: creat de/d17/f23 x:0 0 0 2024-09-17T01:56:25.929 INFO:tasks.workunit.client.0.smithi063.stdout:1/231: dwrite d0/f4 [0,4194304] 0 2024-09-17T01:56:25.929 INFO:tasks.workunit.client.0.smithi063.stdout:2/57: sync 2024-09-17T01:56:25.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/52: sync 2024-09-17T01:56:25.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/133: dwrite d6/da/fe [0,4194304] 0 2024-09-17T01:56:25.933 INFO:tasks.workunit.client.0.smithi063.stdout:0/80: dwrite f0 [0,4194304] 0 2024-09-17T01:56:25.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/134: write d6/da/f27 [306735,16261] 0 2024-09-17T01:56:25.933 INFO:tasks.workunit.client.0.smithi063.stdout:2/58: unlink l1 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:1/232: rmdir d0/d32 39 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/171: dwrite fc [0,4194304] 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/81: mkdir d1/d1d 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:2/59: write d3/f8 [423224,8753] 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/135: creat d6/d9/f28 x:0 0 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:9/53: dread d9/fc [0,4194304] 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/82: write d1/f6 [1892196,5899] 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/128: dwrite dc/f12 [0,4194304] 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/172: creat df/d12/d2d/f3c x:0 0 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:2/60: mkdir d3/d7/df 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:9/54: fdatasync d9/fc 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/83: creat d1/f1e x:0 0 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:4/99: dwrite fc [0,4194304] 0 2024-09-17T01:56:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/173: chown df/d12/f2e 643539151 1 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:5/136: mkdir d6/d23/d29 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/233: rename d0/d1c/l1f to d0/d2d/l55 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/55: chown d9/de/ff 3261 1 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/234: chown d0/l24 359 1 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/235: readlink d0/l23 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/129: rename dc/d14/d18/d21/l27 to dc/d14/l2c 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/56: link d9/cd d9/c10 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:4/100: truncate de/f14 2585778 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:2/61: dread d3/f9 [4194304,4194304] 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/57: symlink d9/de/l11 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:7/127: sync 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/72: sync 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/58: fdatasync d9/de/ff 0 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/59: sync 2024-09-17T01:56:25.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/130: link dc/d14/d19/f1a dc/d14/d19/f2d 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:9/60: fsync d9/de/ff 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:4/101: getdents de 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:9/61: chown d9 6358147 1 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:4/102: dread - f7 zero size 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/236: dread d0/f14 [0,4194304] 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/128: creat d2/d3/d27/f2d x:0 0 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/73: link d1/f2 d1/d7/f14 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:4/103: creat de/f24 x:0 0 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/129: truncate d2/fd 4374900 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/74: stat d1/d7/lb 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/137: dwrite d6/da/f1b [0,4194304] 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/84: dwrite d1/d3/db/d14/f1c [0,4194304] 0 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:9/62: chown d9/c10 5521 1 2024-09-17T01:56:25.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/130: write d2/d3/f1e [762249,57471] 0 2024-09-17T01:56:25.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/131: sync 2024-09-17T01:56:25.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/131: dread dc/f13 [0,4194304] 0 2024-09-17T01:56:25.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/62: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:56:25.937 INFO:tasks.workunit.client.0.smithi063.stdout:4/104: unlink fc 0 2024-09-17T01:56:25.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/132: dread - dc/f1e zero size 2024-09-17T01:56:25.937 INFO:tasks.workunit.client.0.smithi063.stdout:0/85: mkdir d1/d1f 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:9/63: mkdir d9/d12 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:2/63: write d3/f6 [2077331,9295] 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:7/132: rename d2/df/l2b to d2/d3/d22/l2e 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/75: link f0 d1/d7/f15 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:5/138: link d6/da/f27 d6/d23/f2a 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:4/105: write de/d17/d1b/f1c [73837,19210] 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:9/64: mkdir d9/de/d13 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/86: write d1/f2 [630445,83535] 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:5/139: rmdir d6 39 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/76: unlink d1/f8 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:2/64: creat d3/f10 x:0 0 0 2024-09-17T01:56:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:4/106: mkdir de/d17/d25 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:6/133: getdents dc 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:2/65: symlink d3/l11 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:0/87: symlink d1/d1d/l20 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:1/237: dwrite d0/f47 [0,4194304] 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:8/77: rmdir d1/d7 39 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:4/107: creat de/f26 x:0 0 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:6/134: write f3 [2998227,44790] 0 2024-09-17T01:56:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:8/78: chown d1/cd 365983 1 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/88: write d1/f2 [3305315,20704] 0 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:4/108: write de/d18/f1d [4448093,110165] 0 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:4/109: sync 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:2/66: mknod d3/c12 0 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/65: read d9/de/ff [242160,59581] 0 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/140: mkdir d6/d23/d29/d2b 0 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/89: fdatasync d1/f7 0 2024-09-17T01:56:25.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/141: creat d6/da/d19/f2c x:0 0 0 2024-09-17T01:56:25.942 INFO:tasks.workunit.client.0.smithi063.stdout:4/110: rmdir de/d17/d25 0 2024-09-17T01:56:25.942 INFO:tasks.workunit.client.0.smithi063.stdout:8/79: creat d1/f16 x:0 0 0 2024-09-17T01:56:25.943 INFO:tasks.workunit.client.0.smithi063.stdout:0/90: mkdir d1/d3/db/d21 0 2024-09-17T01:56:25.943 INFO:tasks.workunit.client.0.smithi063.stdout:4/111: symlink de/d18/l27 0 2024-09-17T01:56:25.944 INFO:tasks.workunit.client.0.smithi063.stdout:5/142: dread d6/f18 [4194304,4194304] 0 2024-09-17T01:56:25.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/174: dread df/d28/f2a [0,4194304] 0 2024-09-17T01:56:25.945 INFO:tasks.workunit.client.0.smithi063.stdout:8/80: creat d1/f17 x:0 0 0 2024-09-17T01:56:25.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/91: readlink d1/d3/lf 0 2024-09-17T01:56:25.945 INFO:tasks.workunit.client.0.smithi063.stdout:4/112: chown ld 12990849 1 2024-09-17T01:56:25.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/143: fdatasync d6/da/d19/f2c 0 2024-09-17T01:56:25.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/81: stat d1/d7/f15 0 2024-09-17T01:56:25.946 INFO:tasks.workunit.client.0.smithi063.stdout:4/113: readlink ld 0 2024-09-17T01:56:25.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/66: read d9/de/ff [178057,123174] 0 2024-09-17T01:56:25.947 INFO:tasks.workunit.client.0.smithi063.stdout:4/114: stat de/f16 0 2024-09-17T01:56:25.947 INFO:tasks.workunit.client.0.smithi063.stdout:0/92: creat d1/d3/db/d14/f22 x:0 0 0 2024-09-17T01:56:25.947 INFO:tasks.workunit.client.0.smithi063.stdout:3/175: rename df/d12/f17 to df/d12/d2d/f3d 0 2024-09-17T01:56:25.947 INFO:tasks.workunit.client.0.smithi063.stdout:8/82: dread - d1/f17 zero size 2024-09-17T01:56:25.948 INFO:tasks.workunit.client.0.smithi063.stdout:9/67: mkdir d9/d14 0 2024-09-17T01:56:25.948 INFO:tasks.workunit.client.0.smithi063.stdout:6/135: dwrite dc/d1b/f29 [0,4194304] 0 2024-09-17T01:56:25.948 INFO:tasks.workunit.client.0.smithi063.stdout:5/144: chown d6/da/d19/f26 0 1 2024-09-17T01:56:25.948 INFO:tasks.workunit.client.0.smithi063.stdout:9/68: sync 2024-09-17T01:56:25.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:25.950 INFO:tasks.workunit.client.0.smithi063.stdout:0/93: stat d1/d3/db/d21 0 2024-09-17T01:56:25.950 INFO:tasks.workunit.client.0.smithi063.stdout:4/115: mkdir de/d18/d28 0 2024-09-17T01:56:25.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/176: dread - df/d12/d2d/f3c zero size 2024-09-17T01:56:25.950 INFO:tasks.workunit.client.0.smithi063.stdout:8/83: creat d1/f18 x:0 0 0 2024-09-17T01:56:25.951 INFO:tasks.workunit.client.0.smithi063.stdout:6/136: fsync dc/d14/d18/f16 0 2024-09-17T01:56:25.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/67: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:56:25.951 INFO:tasks.workunit.client.0.smithi063.stdout:0/94: chown d1/fa 359777223 1 2024-09-17T01:56:25.951 INFO:tasks.workunit.client.0.smithi063.stdout:3/177: readlink df/l1a 0 2024-09-17T01:56:25.952 INFO:tasks.workunit.client.0.smithi063.stdout:4/116: dread - de/d17/d1b/f1e zero size 2024-09-17T01:56:25.952 INFO:tasks.workunit.client.0.smithi063.stdout:9/69: symlink d9/d14/l15 0 2024-09-17T01:56:25.953 INFO:tasks.workunit.client.0.smithi063.stdout:5/145: dread - d6/d9/d13/d1d/f21 zero size 2024-09-17T01:56:25.953 INFO:tasks.workunit.client.0.smithi063.stdout:3/178: creat df/d12/d1e/f3e x:0 0 0 2024-09-17T01:56:25.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/84: symlink d1/d7/l19 0 2024-09-17T01:56:25.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/68: chown d3/d7/fa 0 1 2024-09-17T01:56:25.954 INFO:tasks.workunit.client.0.smithi063.stdout:7/133: truncate d2/f7 2509292 0 2024-09-17T01:56:25.955 INFO:tasks.workunit.client.0.smithi063.stdout:6/137: unlink dc/d14/d19/d20/l2b 0 2024-09-17T01:56:25.955 INFO:tasks.workunit.client.0.smithi063.stdout:3/179: symlink df/l3f 0 2024-09-17T01:56:25.956 INFO:tasks.workunit.client.0.smithi063.stdout:9/70: write d9/fc [590246,69895] 0 2024-09-17T01:56:25.956 INFO:tasks.workunit.client.0.smithi063.stdout:2/69: mknod d3/c13 0 2024-09-17T01:56:25.957 INFO:tasks.workunit.client.0.smithi063.stdout:7/134: rmdir d2/d3/d22 39 2024-09-17T01:56:25.957 INFO:tasks.workunit.client.0.smithi063.stdout:4/117: link cb de/d18/c29 0 2024-09-17T01:56:25.957 INFO:tasks.workunit.client.0.smithi063.stdout:6/138: write f3 [3230449,93622] 0 2024-09-17T01:56:25.958 INFO:tasks.workunit.client.0.smithi063.stdout:9/71: symlink d9/de/l16 0 2024-09-17T01:56:25.958 INFO:tasks.workunit.client.0.smithi063.stdout:4/118: rmdir de 39 2024-09-17T01:56:25.958 INFO:tasks.workunit.client.0.smithi063.stdout:8/85: dread d1/d7/f14 [0,4194304] 0 2024-09-17T01:56:25.960 INFO:tasks.workunit.client.0.smithi063.stdout:2/70: creat d3/d7/df/f14 x:0 0 0 2024-09-17T01:56:25.961 INFO:tasks.workunit.client.0.smithi063.stdout:0/95: dwrite d1/f6 [0,4194304] 0 2024-09-17T01:56:25.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/72: creat d9/de/f17 x:0 0 0 2024-09-17T01:56:25.962 INFO:tasks.workunit.client.0.smithi063.stdout:6/139: read dc/d14/d18/f16 [88049,4904] 0 2024-09-17T01:56:25.962 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:25.965+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:25.963 INFO:tasks.workunit.client.0.smithi063.stdout:2/71: symlink d3/l15 0 2024-09-17T01:56:25.963 INFO:tasks.workunit.client.0.smithi063.stdout:1/238: dread d0/d32/f42 [0,4194304] 0 2024-09-17T01:56:25.963 INFO:tasks.workunit.client.0.smithi063.stdout:4/119: symlink de/l2a 0 2024-09-17T01:56:25.963 INFO:tasks.workunit.client.0.smithi063.stdout:3/180: dread fc [0,4194304] 0 2024-09-17T01:56:25.964 INFO:tasks.workunit.client.0.smithi063.stdout:6/140: fsync dc/d14/d18/f16 0 2024-09-17T01:56:25.964 INFO:tasks.workunit.client.0.smithi063.stdout:7/135: fsync d2/fd 0 2024-09-17T01:56:25.965 INFO:tasks.workunit.client.0.smithi063.stdout:0/96: write d1/f1e [672583,41812] 0 2024-09-17T01:56:25.965 INFO:tasks.workunit.client.0.smithi063.stdout:4/120: mknod de/d17/d1b/c2b 0 2024-09-17T01:56:25.966 INFO:tasks.workunit.client.0.smithi063.stdout:6/141: read dc/d1b/f29 [765396,82294] 0 2024-09-17T01:56:25.966 INFO:tasks.workunit.client.0.smithi063.stdout:2/72: link d3/l15 d3/d7/l16 0 2024-09-17T01:56:25.967 INFO:tasks.workunit.client.0.smithi063.stdout:0/97: read f0 [3602803,100676] 0 2024-09-17T01:56:25.967 INFO:tasks.workunit.client.0.smithi063.stdout:7/136: mkdir d2/d15/d2f 0 2024-09-17T01:56:25.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/146: dwrite d6/da/d19/f26 [0,4194304] 0 2024-09-17T01:56:25.967 INFO:tasks.workunit.client.0.smithi063.stdout:1/239: dread d0/f1b [0,4194304] 0 2024-09-17T01:56:25.974 INFO:tasks.workunit.client.0.smithi063.stdout:7/137: stat d2/d3/d27/f28 0 2024-09-17T01:56:25.974 INFO:tasks.workunit.client.0.smithi063.stdout:8/86: dread d1/f10 [0,4194304] 0 2024-09-17T01:56:25.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/98: creat d1/d1d/f23 x:0 0 0 2024-09-17T01:56:25.975 INFO:tasks.workunit.client.0.smithi063.stdout:3/181: rename df/d12/f23 to df/d12/d2d/f40 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:6/142: dread f3 [0,4194304] 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:0/99: mknod d1/c24 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:8/87: creat d1/d7/f1a x:0 0 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:0/100: rename d1/d1f to d1/d1f/d25 22 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:3/182: symlink df/d12/d2d/l41 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:7/138: symlink d2/d3/d22/l30 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:6/143: mknod dc/d14/d19/c2e 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:1/240: getdents d0/d2d/d35/d3f 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/73: dread d3/f4 [0,4194304] 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:6/144: mkdir dc/d14/d2f 0 2024-09-17T01:56:25.976 INFO:tasks.workunit.client.0.smithi063.stdout:7/139: mknod d2/d15/d2a/c31 0 2024-09-17T01:56:25.977 INFO:tasks.workunit.client.0.smithi063.stdout:5/147: dwrite d6/da/fe [0,4194304] 0 2024-09-17T01:56:25.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/241: rename d0/d32/c4b to d0/d32/d50/c56 0 2024-09-17T01:56:25.980 INFO:tasks.workunit.client.0.smithi063.stdout:1/242: fsync d0/f2 0 2024-09-17T01:56:25.980 INFO:tasks.workunit.client.0.smithi063.stdout:2/74: rename d3/l11 to d3/d7/df/l17 0 2024-09-17T01:56:25.981 INFO:tasks.workunit.client.0.smithi063.stdout:5/148: mknod d6/d9/d13/c2d 0 2024-09-17T01:56:25.981 INFO:tasks.workunit.client.0.smithi063.stdout:0/101: dwrite d1/f7 [0,4194304] 0 2024-09-17T01:56:25.981 INFO:tasks.workunit.client.0.smithi063.stdout:7/140: write d2/d3/d27/f28 [3393926,26011] 0 2024-09-17T01:56:25.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/141: read - d2/d3/d27/f2d zero size 2024-09-17T01:56:25.982 INFO:tasks.workunit.client.0.smithi063.stdout:5/149: write d6/da/d19/f26 [2818321,104552] 0 2024-09-17T01:56:25.982 INFO:tasks.workunit.client.0.smithi063.stdout:5/150: stat d6/d23/d29 0 2024-09-17T01:56:25.983 INFO:tasks.workunit.client.0.smithi063.stdout:0/102: chown d1/c24 820 1 2024-09-17T01:56:25.984 INFO:tasks.workunit.client.0.smithi063.stdout:3/183: link df/d12/d1e/l2c df/d12/l42 0 2024-09-17T01:56:25.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/145: dwrite dc/f12 [0,4194304] 0 2024-09-17T01:56:25.985 INFO:tasks.workunit.client.0.smithi063.stdout:5/151: symlink d6/d23/d29/d2b/l2e 0 2024-09-17T01:56:25.986 INFO:tasks.workunit.client.0.smithi063.stdout:5/152: chown d6/f18 1121 1 2024-09-17T01:56:25.986 INFO:tasks.workunit.client.0.smithi063.stdout:5/153: readlink d6/l22 0 2024-09-17T01:56:25.987 INFO:tasks.workunit.client.0.smithi063.stdout:0/103: link d1/d1d/f23 d1/d3/db/d14/f26 0 2024-09-17T01:56:25.987 INFO:tasks.workunit.client.0.smithi063.stdout:6/146: dread dc/d14/d19/f1c [0,4194304] 0 2024-09-17T01:56:25.988 INFO:tasks.workunit.client.0.smithi063.stdout:5/154: creat d6/d9/d13/d1d/f2f x:0 0 0 2024-09-17T01:56:25.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/75: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:56:25.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/76: chown d3/d7/df 3717121 1 2024-09-17T01:56:25.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/147: fdatasync dc/d14/d19/f2d 0 2024-09-17T01:56:25.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/142: truncate d2/df/f10 2248115 0 2024-09-17T01:56:25.991 INFO:tasks.workunit.client.0.smithi063.stdout:2/77: unlink d3/d7/le 0 2024-09-17T01:56:25.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/184: getdents df/d12/d2d 0 2024-09-17T01:56:25.992 INFO:tasks.workunit.client.0.smithi063.stdout:5/155: chown d6/da/c17 12254 1 2024-09-17T01:56:25.992 INFO:tasks.workunit.client.0.smithi063.stdout:6/148: rmdir dc/d14/d19/d20 39 2024-09-17T01:56:25.992 INFO:tasks.workunit.client.0.smithi063.stdout:7/143: chown d2/d15/l1a 2082293 1 2024-09-17T01:56:25.992 INFO:tasks.workunit.client.0.smithi063.stdout:6/149: symlink dc/d1b/l30 0 2024-09-17T01:56:25.993 INFO:tasks.workunit.client.0.smithi063.stdout:0/104: unlink d1/c24 0 2024-09-17T01:56:25.993 INFO:tasks.workunit.client.0.smithi063.stdout:7/144: chown d2/d3/d17/c21 44 1 2024-09-17T01:56:25.993 INFO:tasks.workunit.client.0.smithi063.stdout:0/105: write d1/d3/f4 [3419534,43005] 0 2024-09-17T01:56:25.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/145: write d2/d3/d27/f28 [2833673,70462] 0 2024-09-17T01:56:25.995 INFO:tasks.workunit.client.0.smithi063.stdout:2/78: readlink d3/d7/df/l17 0 2024-09-17T01:56:25.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/146: creat d2/d3/d27/f32 x:0 0 0 2024-09-17T01:56:25.996 INFO:tasks.workunit.client.0.smithi063.stdout:4/121: dread de/d18/f21 [0,4194304] 0 2024-09-17T01:56:25.996 INFO:tasks.workunit.client.0.smithi063.stdout:2/79: readlink d3/l15 0 2024-09-17T01:56:25.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/185: read df/f11 [769506,3735] 0 2024-09-17T01:56:25.997 INFO:tasks.workunit.client.0.smithi063.stdout:7/147: mkdir d2/d3/d27/d33 0 2024-09-17T01:56:25.997 INFO:tasks.workunit.client.0.smithi063.stdout:4/122: write f4 [2801886,8613] 0 2024-09-17T01:56:25.999 INFO:tasks.workunit.client.0.smithi063.stdout:4/123: chown de/f24 13 1 2024-09-17T01:56:25.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/148: chown d2/df/f11 66203651 1 2024-09-17T01:56:26.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/106: dread d1/d3/db/f13 [0,4194304] 0 2024-09-17T01:56:26.000 INFO:tasks.workunit.client.0.smithi063.stdout:3/186: mkdir df/d12/d43 0 2024-09-17T01:56:26.002 INFO:tasks.workunit.client.0.smithi063.stdout:7/149: chown d2/d3/d22/l30 219 1 2024-09-17T01:56:26.002 INFO:tasks.workunit.client.0.smithi063.stdout:5/156: dwrite d6/da/d19/f26 [0,4194304] 0 2024-09-17T01:56:26.002 INFO:tasks.workunit.client.0.smithi063.stdout:4/124: link de/l15 de/l2c 0 2024-09-17T01:56:26.003 INFO:tasks.workunit.client.0.smithi063.stdout:6/150: dwrite dc/f1e [0,4194304] 0 2024-09-17T01:56:26.005 INFO:tasks.workunit.client.0.smithi063.stdout:5/157: symlink d6/d9/d13/d1d/l30 0 2024-09-17T01:56:26.006 INFO:tasks.workunit.client.0.smithi063.stdout:3/187: creat df/d12/d3a/f44 x:0 0 0 2024-09-17T01:56:26.006 INFO:tasks.workunit.client.0.smithi063.stdout:6/151: link f1 dc/d14/d18/f31 0 2024-09-17T01:56:26.006 INFO:tasks.workunit.client.0.smithi063.stdout:3/188: read fc [2522673,96947] 0 2024-09-17T01:56:26.007 INFO:tasks.workunit.client.0.smithi063.stdout:5/158: read - d6/da/d19/f2c zero size 2024-09-17T01:56:26.008 INFO:tasks.workunit.client.0.smithi063.stdout:6/152: unlink dc/d14/f1f 0 2024-09-17T01:56:26.008 INFO:tasks.workunit.client.0.smithi063.stdout:5/159: chown d6/l1a 2083122 1 2024-09-17T01:56:26.008 INFO:tasks.workunit.client.0.smithi063.stdout:3/189: creat df/d12/d30/f45 x:0 0 0 2024-09-17T01:56:26.008 INFO:tasks.workunit.client.0.smithi063.stdout:5/160: fsync d6/d23/f2a 0 2024-09-17T01:56:26.008 INFO:tasks.workunit.client.0.smithi063.stdout:6/153: mkdir dc/d14/d19/d20/d32 0 2024-09-17T01:56:26.009 INFO:tasks.workunit.client.0.smithi063.stdout:3/190: mknod df/d12/c46 0 2024-09-17T01:56:26.009 INFO:tasks.workunit.client.0.smithi063.stdout:6/154: read f3 [1510061,66410] 0 2024-09-17T01:56:26.009 INFO:tasks.workunit.client.0.smithi063.stdout:2/80: dread d3/f6 [0,4194304] 0 2024-09-17T01:56:26.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/107: dread d1/d3/f4 [4194304,4194304] 0 2024-09-17T01:56:26.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/108: rmdir d1 39 2024-09-17T01:56:26.011 INFO:tasks.workunit.client.0.smithi063.stdout:3/191: write df/d12/d2d/f3d [1173925,117349] 0 2024-09-17T01:56:26.011 INFO:tasks.workunit.client.0.smithi063.stdout:3/192: read df/d28/f2a [517347,124887] 0 2024-09-17T01:56:26.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/150: dwrite d2/fb [0,4194304] 0 2024-09-17T01:56:26.012 INFO:tasks.workunit.client.0.smithi063.stdout:3/193: creat df/d12/d30/f47 x:0 0 0 2024-09-17T01:56:26.013 INFO:tasks.workunit.client.0.smithi063.stdout:3/194: write df/d12/d1e/f21 [250293,7912] 0 2024-09-17T01:56:26.014 INFO:tasks.workunit.client.0.smithi063.stdout:3/195: creat df/d28/f48 x:0 0 0 2024-09-17T01:56:26.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/196: truncate df/d12/d1e/f3e 230007 0 2024-09-17T01:56:26.015 INFO:tasks.workunit.client.0.smithi063.stdout:6/155: truncate dc/d14/d19/f2d 203908 0 2024-09-17T01:56:26.016 INFO:tasks.workunit.client.0.smithi063.stdout:3/197: write df/d12/f2e [3741812,57356] 0 2024-09-17T01:56:26.016 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:26.016 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:11029 4.23 4:c77221f3:::100000031df.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:26.009429+0000", 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.012717358999999999, 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.012742346999999999, 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:26.017 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 11029 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.009429+0000", 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:26.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.009429+0000", 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.009431+0000", 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7940000000000001e-06 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:26.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.015860+0000", 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0064294189999999996 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.015880+0000", 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9165999999999999e-05 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.015891+0000", 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1137e-05 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.015978+0000", 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.7643000000000001e-05 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.016112+0000", 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133292 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.016341+0000", 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022961600000000001 2024-09-17T01:56:26.021 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:11034 4.4 4:2235f7a0:::100000030ff.00000000:head [write 1173925~117349 in=117349b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:26.017528+0000", 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0046186589999999998, 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0046963739999999997, 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:26.022 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 11034 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017528+0000", 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017528+0000", 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:26.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017530+0000", 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6980000000000001e-06 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017695+0000", 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016526299999999999 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:26.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017713+0000", 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8462e-05 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017725+0000", 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.189e-05 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017851+0000", 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012559100000000001 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.017975+0000", 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012376100000000001 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.018160+0000", 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018533499999999999 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.019824+0000", 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016645410000000001 2024-09-17T01:56:26.026 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:11037 4.a 4:51b6a63a:::100000030f2.00000000:head [write 250293~7912 in=7912b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:26.020134+0000", 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0020126829999999999, 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.002135662, 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 11037 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020134+0000", 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020134+0000", 2024-09-17T01:56:26.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020136+0000", 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9980000000000002e-06 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020240+0000", 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010430899999999999 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:26.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020258+0000", 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7360999999999999e-05 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020272+0000", 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4243000000000001e-05 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020656+0000", 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00038427300000000003 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:26.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:26.020786+0000", 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013011500000000001 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 3 2024-09-17T01:56:26.031 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:26.036 INFO:tasks.workunit.client.0.smithi063.stdout:3/198: creat df/f49 x:0 0 0 2024-09-17T01:56:26.036 INFO:tasks.workunit.client.0.smithi063.stdout:6/156: creat dc/d14/d19/d20/d32/f33 x:0 0 0 2024-09-17T01:56:26.036 INFO:tasks.workunit.client.0.smithi063.stdout:6/157: readlink l2 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:6/158: chown dc/d14/d19/d20 107284533 1 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:3/199: write df/d12/d1e/f2b [2761262,4099] 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/125: write de/f14 [2115074,81778] 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/243: dread d0/d1c/f1d [0,4194304] 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/151: dwrite d2/d3/d17/d25/f1b [4194304,4194304] 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/152: fsync d2/f1c 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/126: mkdir de/d2d 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:5/161: truncate d6/da/fe 3805178 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/153: dread - d2/d3/d27/f2d zero size 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/244: symlink d0/d32/d50/l57 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/127: fdatasync de/d18/f1d 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:3/200: getdents df/d12/d30 0 2024-09-17T01:56:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/245: rmdir d0/d32/d50 39 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:5/162: write d6/d9/d13/d1d/f21 [456441,69876] 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/128: creat de/f2e x:0 0 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:6/159: creat dc/d14/d18/f34 x:0 0 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:5/163: mkdir d6/d23/d29/d2b/d31 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/129: rename de/d18/f21 to de/f2f 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:6/160: creat dc/d14/d19/f35 x:0 0 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:1/246: getdents d0/d2d/d35/d3f 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:5/164: chown d6/d9/l1c 0 1 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/130: write de/f16 [1341083,86354] 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:1/247: fsync d0/f4a 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/131: read - de/f24 zero size 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:5/165: stat d6/d9/d13/f1e 0 2024-09-17T01:56:26.038 INFO:tasks.workunit.client.0.smithi063.stdout:1/248: mknod d0/d2d/d35/c58 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:6/161: rename dc/d14/d18/c25 to dc/d14/d19/d20/d32/c36 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/132: chown de/d17/f23 1476599 1 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/166: mkdir d6/d9/d32 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:2/81: dread d3/d7/fd [0,4194304] 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/249: stat d0/d1c/f4c 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:2/82: write d3/f9 [2444637,99271] 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/133: mkdir de/d18/d28/d30 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/250: mknod d0/d2d/d35/d3f/c59 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/134: fsync f4 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:2/83: creat d3/d7/df/f18 x:0 0 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:2/84: fdatasync d3/d7/fd 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/135: rename cb to de/d17/c31 0 2024-09-17T01:56:26.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/136: dread - de/f2e zero size 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:1/251: rename d0/c11 to d0/d32/d50/c5a 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/85: dread d3/d7/fd [0,4194304] 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/137: creat de/d17/d1b/f32 x:0 0 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/138: rename de/f24 to de/d2d/f33 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/86: link d3/f4 d3/d7/df/f19 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/139: write de/d17/d1b/f1c [137083,122431] 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/87: creat d3/d7/df/f1a x:0 0 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/140: read - de/d18/f1a zero size 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/88: symlink d3/l1b 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/89: truncate d3/f10 4659281 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/141: write de/d17/f23 [410991,64817] 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/90: creat d3/d7/f1c x:0 0 0 2024-09-17T01:56:26.040 INFO:tasks.workunit.client.0.smithi063.stdout:3/201: getdents df/d28 0 2024-09-17T01:56:26.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/162: truncate dc/d14/d19/f2d 1158572 0 2024-09-17T01:56:26.041 INFO:tasks.workunit.client.0.smithi063.stdout:5/167: read d6/da/fe [3279856,84400] 0 2024-09-17T01:56:26.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/163: symlink dc/d14/d18/l37 0 2024-09-17T01:56:26.041 INFO:tasks.workunit.client.0.smithi063.stdout:2/91: link d3/l15 d3/l1d 0 2024-09-17T01:56:26.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/154: truncate d2/d3/d27/f28 1946093 0 2024-09-17T01:56:26.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/155: write d2/fd [4841102,92067] 0 2024-09-17T01:56:26.042 INFO:tasks.workunit.client.0.smithi063.stdout:1/252: getdents d0/d2d/d35 0 2024-09-17T01:56:26.043 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:26.043 INFO:tasks.workunit.client.0.smithi063.stdout:4/142: fsync de/d17/d1b/f32 0 2024-09-17T01:56:26.044 INFO:tasks.workunit.client.0.smithi063.stdout:2/92: dwrite d3/f6 [4194304,4194304] 0 2024-09-17T01:56:26.044 INFO:tasks.workunit.client.0.smithi063.stdout:1/253: write d0/d2d/f37 [340900,106436] 0 2024-09-17T01:56:26.045 INFO:tasks.workunit.client.0.smithi063.stdout:2/93: chown d3/c12 3 1 2024-09-17T01:56:26.045 INFO:tasks.workunit.client.0.smithi063.stdout:6/164: dwrite dc/d14/d18/f16 [0,4194304] 0 2024-09-17T01:56:26.046 INFO:tasks.workunit.client.0.smithi063.stdout:6/165: chown dc/d14/d18/d21/f26 46 1 2024-09-17T01:56:26.050 INFO:tasks.workunit.client.0.smithi063.stdout:2/94: creat d3/d7/df/f1e x:0 0 0 2024-09-17T01:56:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:6/166: stat dc/d14/l2c 0 2024-09-17T01:56:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:1/254: link d0/d32/d50/c5a d0/d1c/c5b 0 2024-09-17T01:56:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/95: symlink d3/d7/df/l1f 0 2024-09-17T01:56:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/96: write d3/d7/df/f1a [38805,3554] 0 2024-09-17T01:56:26.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/167: creat dc/f38 x:0 0 0 2024-09-17T01:56:26.053 INFO:tasks.workunit.client.0.smithi063.stdout:2/97: truncate d3/d7/df/f14 498703 0 2024-09-17T01:56:26.053 INFO:tasks.workunit.client.0.smithi063.stdout:2/98: rmdir d3/d7 39 2024-09-17T01:56:26.054 INFO:tasks.workunit.client.0.smithi063.stdout:2/99: link d3/cc d3/d7/df/c20 0 2024-09-17T01:56:26.055 INFO:tasks.workunit.client.0.smithi063.stdout:4/143: dread de/d17/f23 [0,4194304] 0 2024-09-17T01:56:26.055 INFO:tasks.workunit.client.0.smithi063.stdout:2/100: write d3/d7/df/f18 [464606,61328] 0 2024-09-17T01:56:26.059 INFO:tasks.workunit.client.0.smithi063.stdout:4/144: symlink de/d18/d28/d30/l34 0 2024-09-17T01:56:26.060 INFO:tasks.workunit.client.0.smithi063.stdout:2/101: creat d3/f21 x:0 0 0 2024-09-17T01:56:26.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/255: dread d0/d1c/f4c [0,4194304] 0 2024-09-17T01:56:26.060 INFO:tasks.workunit.client.0.smithi063.stdout:4/145: truncate de/d17/d1b/f1c 958263 0 2024-09-17T01:56:26.061 INFO:tasks.workunit.client.0.smithi063.stdout:2/102: rename d3/d7/lb to d3/d7/df/l22 0 2024-09-17T01:56:26.061 INFO:tasks.workunit.client.0.smithi063.stdout:1/256: write d0/d1c/f48 [208302,99560] 0 2024-09-17T01:56:26.062 INFO:tasks.workunit.client.0.smithi063.stdout:4/146: truncate de/d17/d1b/f1e 538703 0 2024-09-17T01:56:26.062 INFO:tasks.workunit.client.0.smithi063.stdout:6/168: truncate dc/f12 3706619 0 2024-09-17T01:56:26.062 INFO:tasks.workunit.client.0.smithi063.stdout:1/257: write d0/f47 [381779,58613] 0 2024-09-17T01:56:26.062 INFO:tasks.workunit.client.0.smithi063.stdout:4/147: chown de/d18/c29 649896 1 2024-09-17T01:56:26.064 INFO:tasks.workunit.client.0.smithi063.stdout:3/202: dread fd [0,4194304] 0 2024-09-17T01:56:26.069 INFO:tasks.workunit.client.0.smithi063.stdout:1/258: dwrite d0/d1c/f4c [0,4194304] 0 2024-09-17T01:56:26.069 INFO:tasks.workunit.client.0.smithi063.stdout:3/203: dread df/f11 [0,4194304] 0 2024-09-17T01:56:26.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/204: truncate df/f26 82508 0 2024-09-17T01:56:26.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/205: truncate df/d12/d2d/f40 1241210 0 2024-09-17T01:56:26.074 INFO:tasks.workunit.client.0.smithi063.stdout:6/169: dwrite f1 [0,4194304] 0 2024-09-17T01:56:26.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/259: dread d0/f47 [0,4194304] 0 2024-09-17T01:56:26.075 INFO:tasks.workunit.client.0.smithi063.stdout:6/170: fsync dc/d14/d19/d20/d32/f33 0 2024-09-17T01:56:26.076 INFO:tasks.workunit.client.0.smithi063.stdout:6/171: symlink dc/d14/d19/l39 0 2024-09-17T01:56:26.077 INFO:tasks.workunit.client.0.smithi063.stdout:9/73: sync 2024-09-17T01:56:26.077 INFO:tasks.workunit.client.0.smithi063.stdout:9/74: chown d9 416482630 1 2024-09-17T01:56:26.078 INFO:tasks.workunit.client.0.smithi063.stdout:6/172: dread dc/d14/d19/f1c [0,4194304] 0 2024-09-17T01:56:26.078 INFO:tasks.workunit.client.0.smithi063.stdout:9/75: chown d9/de/ff 25 1 2024-09-17T01:56:26.078 INFO:tasks.workunit.client.0.smithi063.stdout:9/76: dread - d9/de/f17 zero size 2024-09-17T01:56:26.079 INFO:tasks.workunit.client.0.smithi063.stdout:9/77: readlink l3 0 2024-09-17T01:56:26.079 INFO:tasks.workunit.client.0.smithi063.stdout:6/173: rename dc/d14/d18/l2a to dc/d1b/l3a 0 2024-09-17T01:56:26.080 INFO:tasks.workunit.client.0.smithi063.stdout:1/260: dwrite d0/f4a [0,4194304] 0 2024-09-17T01:56:26.082 INFO:tasks.workunit.client.0.smithi063.stdout:9/78: link d9/cd d9/de/c18 0 2024-09-17T01:56:26.082 INFO:tasks.workunit.client.0.smithi063.stdout:1/261: creat d0/d1c/f5c x:0 0 0 2024-09-17T01:56:26.083 INFO:tasks.workunit.client.0.smithi063.stdout:9/79: creat d9/de/f19 x:0 0 0 2024-09-17T01:56:26.085 INFO:tasks.workunit.client.0.smithi063.stdout:1/262: rename d0/f4a to d0/d2d/d35/d3f/d4e/f5d 0 2024-09-17T01:56:26.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/80: mknod d9/d14/c1a 0 2024-09-17T01:56:26.085 INFO:tasks.workunit.client.0.smithi063.stdout:1/263: mkdir d0/d2d/d5e 0 2024-09-17T01:56:26.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/81: write d9/de/ff [1575603,82757] 0 2024-09-17T01:56:26.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/82: readlink l3 0 2024-09-17T01:56:26.085 INFO:tasks.workunit.client.0.smithi063.stdout:1/264: chown d0/d1c/f48 15680 1 2024-09-17T01:56:26.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/148: dread de/f16 [0,4194304] 0 2024-09-17T01:56:26.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/149: readlink ld 0 2024-09-17T01:56:26.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/265: creat d0/d2d/d35/d3f/d4e/f5f x:0 0 0 2024-09-17T01:56:26.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/174: read dc/d14/d19/f2d [649777,98305] 0 2024-09-17T01:56:26.087 INFO:tasks.workunit.client.0.smithi063.stdout:6/175: stat dc/d1b/l30 0 2024-09-17T01:56:26.087 INFO:tasks.workunit.client.0.smithi063.stdout:6/176: symlink dc/d14/d18/l3b 0 2024-09-17T01:56:26.089 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:26.094+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:26.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/177: write f3 [2974202,120258] 0 2024-09-17T01:56:26.089 INFO:tasks.workunit.client.0.smithi063.stdout:9/83: dread f7 [0,4194304] 0 2024-09-17T01:56:26.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/178: stat dc/f38 0 2024-09-17T01:56:26.090 INFO:tasks.workunit.client.0.smithi063.stdout:6/179: symlink dc/d14/d19/l3c 0 2024-09-17T01:56:26.090 INFO:tasks.workunit.client.0.smithi063.stdout:1/266: dread d0/f47 [0,4194304] 0 2024-09-17T01:56:26.092 INFO:tasks.workunit.client.0.smithi063.stdout:1/267: link d0/l13 d0/d2d/d5e/l60 0 2024-09-17T01:56:26.095 INFO:tasks.workunit.client.0.smithi063.stdout:1/268: rename d0/l13 to d0/d2d/l61 0 2024-09-17T01:56:26.095 INFO:tasks.workunit.client.0.smithi063.stdout:6/180: dread dc/d14/d18/f16 [0,4194304] 0 2024-09-17T01:56:26.095 INFO:tasks.workunit.client.0.smithi063.stdout:4/150: dread f4 [0,4194304] 0 2024-09-17T01:56:26.095 INFO:tasks.workunit.client.0.smithi063.stdout:1/269: mknod d0/d32/d50/c62 0 2024-09-17T01:56:26.096 INFO:tasks.workunit.client.0.smithi063.stdout:9/84: dread d9/de/ff [0,4194304] 0 2024-09-17T01:56:26.096 INFO:tasks.workunit.client.0.smithi063.stdout:4/151: symlink de/d2d/l35 0 2024-09-17T01:56:26.096 INFO:tasks.workunit.client.0.smithi063.stdout:1/270: symlink d0/d2d/d35/d3f/d4e/l63 0 2024-09-17T01:56:26.097 INFO:tasks.workunit.client.0.smithi063.stdout:9/85: mkdir d9/d14/d1b 0 2024-09-17T01:56:26.097 INFO:tasks.workunit.client.0.smithi063.stdout:4/152: mkdir de/d17/d36 0 2024-09-17T01:56:26.102 INFO:tasks.workunit.client.0.smithi063.stdout:6/181: dwrite dc/d14/d19/f35 [0,4194304] 0 2024-09-17T01:56:26.102 INFO:tasks.workunit.client.0.smithi063.stdout:3/206: dread df/d12/d1e/f2b [0,4194304] 0 2024-09-17T01:56:26.104 INFO:tasks.workunit.client.0.smithi063.stdout:9/86: dwrite f7 [0,4194304] 0 2024-09-17T01:56:26.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/153: getdents de/d2d 0 2024-09-17T01:56:26.105 INFO:tasks.workunit.client.0.smithi063.stdout:3/207: creat df/d12/d2d/f4a x:0 0 0 2024-09-17T01:56:26.106 INFO:tasks.workunit.client.0.smithi063.stdout:9/87: rmdir d9/de/d13 0 2024-09-17T01:56:26.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/154: creat de/d18/f37 x:0 0 0 2024-09-17T01:56:26.106 INFO:tasks.workunit.client.0.smithi063.stdout:3/208: creat df/d12/d2d/f4b x:0 0 0 2024-09-17T01:56:26.106 INFO:tasks.workunit.client.0.smithi063.stdout:9/88: stat d9/de/l11 0 2024-09-17T01:56:26.107 INFO:tasks.workunit.client.0.smithi063.stdout:9/89: readlink l3 0 2024-09-17T01:56:26.107 INFO:tasks.workunit.client.0.smithi063.stdout:4/155: creat de/f38 x:0 0 0 2024-09-17T01:56:26.107 INFO:tasks.workunit.client.0.smithi063.stdout:3/209: creat df/d12/d2d/f4c x:0 0 0 2024-09-17T01:56:26.109 INFO:tasks.workunit.client.0.smithi063.stdout:4/156: symlink de/d18/d28/d30/l39 0 2024-09-17T01:56:26.111 INFO:tasks.workunit.client.0.smithi063.stdout:6/182: dwrite dc/d14/d19/f1c [0,4194304] 0 2024-09-17T01:56:26.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/183: creat dc/d14/d19/f3d x:0 0 0 2024-09-17T01:56:26.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/184: mknod dc/d14/d18/d21/c3e 0 2024-09-17T01:56:26.114 INFO:tasks.workunit.client.0.smithi063.stdout:3/210: dwrite fc [0,4194304] 0 2024-09-17T01:56:26.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/157: truncate de/f14 915707 0 2024-09-17T01:56:26.117 INFO:tasks.workunit.client.0.smithi063.stdout:3/211: dread fd [0,4194304] 0 2024-09-17T01:56:26.118 INFO:tasks.workunit.client.0.smithi063.stdout:6/185: fdatasync dc/f13 0 2024-09-17T01:56:26.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/212: creat df/d12/d43/f4d x:0 0 0 2024-09-17T01:56:26.119 INFO:tasks.workunit.client.0.smithi063.stdout:4/158: getdents de 0 2024-09-17T01:56:26.119 INFO:tasks.workunit.client.0.smithi063.stdout:6/186: mknod dc/d14/d19/d20/c3f 0 2024-09-17T01:56:26.119 INFO:tasks.workunit.client.0.smithi063.stdout:4/159: dread - de/d2d/f33 zero size 2024-09-17T01:56:26.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/187: chown dc/d14/d19 2 1 2024-09-17T01:56:26.120 INFO:tasks.workunit.client.0.smithi063.stdout:1/271: dread d0/f1a [0,4194304] 0 2024-09-17T01:56:26.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/188: readlink l8 0 2024-09-17T01:56:26.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/272: link d0/l16 d0/d32/l64 0 2024-09-17T01:56:26.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/273: write d0/d1c/f48 [4960808,85611] 0 2024-09-17T01:56:26.123 INFO:tasks.workunit.client.0.smithi063.stdout:1/274: rename d0/f6 to d0/d2d/f65 0 2024-09-17T01:56:26.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/189: dwrite dc/f13 [0,4194304] 0 2024-09-17T01:56:26.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/103: sync 2024-09-17T01:56:26.126 INFO:tasks.workunit.client.0.smithi063.stdout:0/109: sync 2024-09-17T01:56:26.126 INFO:tasks.workunit.client.0.smithi063.stdout:7/156: sync 2024-09-17T01:56:26.126 INFO:tasks.workunit.client.0.smithi063.stdout:5/168: sync 2024-09-17T01:56:26.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/88: sync 2024-09-17T01:56:26.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/190: dread - dc/d14/d19/d20/f23 zero size 2024-09-17T01:56:26.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/275: dread d0/d1c/f1d [0,4194304] 0 2024-09-17T01:56:26.128 INFO:tasks.workunit.client.0.smithi063.stdout:8/89: creat d1/df/f1b x:0 0 0 2024-09-17T01:56:26.129 INFO:tasks.workunit.client.0.smithi063.stdout:6/191: creat dc/d14/d18/d21/f40 x:0 0 0 2024-09-17T01:56:26.131 INFO:tasks.workunit.client.0.smithi063.stdout:3/213: dread df/d12/d2d/f40 [0,4194304] 0 2024-09-17T01:56:26.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/276: truncate d0/d2d/f3d 4945326 0 2024-09-17T01:56:26.132 INFO:tasks.workunit.client.0.smithi063.stdout:3/214: mknod df/d28/c4e 0 2024-09-17T01:56:26.132 INFO:tasks.workunit.client.0.smithi063.stdout:8/90: getdents d1/df 0 2024-09-17T01:56:26.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/104: dread d3/f10 [0,4194304] 0 2024-09-17T01:56:26.134 INFO:tasks.workunit.client.0.smithi063.stdout:5/169: dread d6/da/d19/f26 [0,4194304] 0 2024-09-17T01:56:26.134 INFO:tasks.workunit.client.0.smithi063.stdout:6/192: write dc/d1b/f29 [5039511,13252] 0 2024-09-17T01:56:26.134 INFO:tasks.workunit.client.0.smithi063.stdout:4/160: dread de/f14 [0,4194304] 0 2024-09-17T01:56:26.134 INFO:tasks.workunit.client.0.smithi063.stdout:1/277: mkdir d0/d2d/d35/d3f/d4e/d66 0 2024-09-17T01:56:26.135 INFO:tasks.workunit.client.0.smithi063.stdout:1/278: rmdir d0/d2d/d35/d3f/d4e 39 2024-09-17T01:56:26.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/110: dread d1/f6 [0,4194304] 0 2024-09-17T01:56:26.137 INFO:tasks.workunit.client.0.smithi063.stdout:7/157: dwrite d2/df/f11 [4194304,4194304] 0 2024-09-17T01:56:26.137 INFO:tasks.workunit.client.0.smithi063.stdout:3/215: link df/d12/f16 df/d12/d1e/f4f 0 2024-09-17T01:56:26.138 INFO:tasks.workunit.client.0.smithi063.stdout:0/111: stat d1/d3/db/d14/c15 0 2024-09-17T01:56:26.138 INFO:tasks.workunit.client.0.smithi063.stdout:3/216: read fc [2444755,6514] 0 2024-09-17T01:56:26.140 INFO:tasks.workunit.client.0.smithi063.stdout:8/91: getdents d1 0 2024-09-17T01:56:26.140 INFO:tasks.workunit.client.0.smithi063.stdout:0/112: unlink d1/d1d/f23 0 2024-09-17T01:56:26.141 INFO:tasks.workunit.client.0.smithi063.stdout:1/279: dread d0/d32/d50/f54 [0,4194304] 0 2024-09-17T01:56:26.143 INFO:tasks.workunit.client.0.smithi063.stdout:4/161: dwrite de/f14 [0,4194304] 0 2024-09-17T01:56:26.145 INFO:tasks.workunit.client.0.smithi063.stdout:5/170: truncate d6/f18 4086287 0 2024-09-17T01:56:26.146 INFO:tasks.workunit.client.0.smithi063.stdout:8/92: symlink d1/l1c 0 2024-09-17T01:56:26.146 INFO:tasks.workunit.client.0.smithi063.stdout:0/113: mkdir d1/d27 0 2024-09-17T01:56:26.146 INFO:tasks.workunit.client.0.smithi063.stdout:9/90: sync 2024-09-17T01:56:26.146 INFO:tasks.workunit.client.0.smithi063.stdout:3/217: mkdir df/d12/d43/d50 0 2024-09-17T01:56:26.147 INFO:tasks.workunit.client.0.smithi063.stdout:4/162: symlink de/d17/d1b/l3a 0 2024-09-17T01:56:26.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/193: dwrite dc/f13 [0,4194304] 0 2024-09-17T01:56:26.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/163: chown c2 2 1 2024-09-17T01:56:26.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/280: dread d0/f47 [0,4194304] 0 2024-09-17T01:56:26.150 INFO:tasks.workunit.client.0.smithi063.stdout:6/194: chown dc/d14/l17 0 1 2024-09-17T01:56:26.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/281: stat d0/d2d/f3d 0 2024-09-17T01:56:26.151 INFO:tasks.workunit.client.0.smithi063.stdout:6/195: chown dc/d14/d18/f16 53409 1 2024-09-17T01:56:26.153 INFO:tasks.workunit.client.0.smithi063.stdout:2/105: dwrite d3/d7/df/f19 [0,4194304] 0 2024-09-17T01:56:26.153 INFO:tasks.workunit.client.0.smithi063.stdout:3/218: creat df/d12/d3a/f51 x:0 0 0 2024-09-17T01:56:26.154 INFO:tasks.workunit.client.0.smithi063.stdout:9/91: mknod d9/d12/c1c 0 2024-09-17T01:56:26.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/196: creat dc/d1b/f41 x:0 0 0 2024-09-17T01:56:26.156 INFO:tasks.workunit.client.0.smithi063.stdout:4/164: creat de/f3b x:0 0 0 2024-09-17T01:56:26.156 INFO:tasks.workunit.client.0.smithi063.stdout:2/106: mknod d3/c23 0 2024-09-17T01:56:26.158 INFO:tasks.workunit.client.0.smithi063.stdout:5/171: dwrite d6/d9/d13/f1e [0,4194304] 0 2024-09-17T01:56:26.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/165: readlink de/d18/d28/d30/l34 0 2024-09-17T01:56:26.159 INFO:tasks.workunit.client.0.smithi063.stdout:1/282: symlink d0/d32/l67 0 2024-09-17T01:56:26.159 INFO:tasks.workunit.client.0.smithi063.stdout:8/93: dread - d1/d7/f1a zero size 2024-09-17T01:56:26.159 INFO:tasks.workunit.client.0.smithi063.stdout:6/197: write f3 [862089,87027] 0 2024-09-17T01:56:26.160 INFO:tasks.workunit.client.0.smithi063.stdout:7/158: dwrite d2/d3/d27/f28 [0,4194304] 0 2024-09-17T01:56:26.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/107: mknod d3/d7/df/c24 0 2024-09-17T01:56:26.160 INFO:tasks.workunit.client.0.smithi063.stdout:4/166: rmdir de/d18 39 2024-09-17T01:56:26.163 INFO:tasks.workunit.client.0.smithi063.stdout:0/114: dwrite d1/d3/f4 [4194304,4194304] 0 2024-09-17T01:56:26.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-09-17T01:56:26.163 INFO:tasks.workunit.client.0.smithi063.stdout:8/94: dread - d1/f16 zero size 2024-09-17T01:56:26.164 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:26.166+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:26.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/283: creat d0/d2d/d35/d3f/f68 x:0 0 0 2024-09-17T01:56:26.166 INFO:tasks.workunit.client.0.smithi063.stdout:6/198: write dc/d14/d18/f34 [507456,17255] 0 2024-09-17T01:56:26.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/219: link df/d12/d1e/f3e df/d12/d2d/f52 0 2024-09-17T01:56:26.167 INFO:tasks.workunit.client.0.smithi063.stdout:4/167: mkdir de/d2d/d3c 0 2024-09-17T01:56:26.168 INFO:tasks.workunit.client.0.smithi063.stdout:7/159: symlink d2/d3/l34 0 2024-09-17T01:56:26.168 INFO:tasks.workunit.client.0.smithi063.stdout:8/95: unlink d1/d7/f15 0 2024-09-17T01:56:26.169 INFO:tasks.workunit.client.0.smithi063.stdout:0/115: mknod d1/d3/db/d21/c28 0 2024-09-17T01:56:26.169 INFO:tasks.workunit.client.0.smithi063.stdout:4/168: symlink de/l3d 0 2024-09-17T01:56:26.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/284: truncate d0/d32/f3e 170209 0 2024-09-17T01:56:26.172 INFO:tasks.workunit.client.0.smithi063.stdout:6/199: link f1 dc/d14/d18/f42 0 2024-09-17T01:56:26.173 INFO:tasks.workunit.client.0.smithi063.stdout:0/116: rmdir d1/d27 0 2024-09-17T01:56:26.176 INFO:tasks.workunit.client.0.smithi063.stdout:2/108: dwrite d3/d7/df/f1a [0,4194304] 0 2024-09-17T01:56:26.177 INFO:tasks.workunit.client.0.smithi063.stdout:7/160: write d2/d3/f1e [149339,116159] 0 2024-09-17T01:56:26.177 INFO:tasks.workunit.client.0.smithi063.stdout:4/169: symlink de/d18/d28/d30/l3e 0 2024-09-17T01:56:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:9/92: dwrite d9/fc [0,4194304] 0 2024-09-17T01:56:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/200: mkdir dc/d14/d18/d21/d43 0 2024-09-17T01:56:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:2/109: creat d3/d7/df/f25 x:0 0 0 2024-09-17T01:56:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/170: write de/f16 [955291,107422] 0 2024-09-17T01:56:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/117: creat d1/d3/d1b/f29 x:0 0 0 2024-09-17T01:56:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:8/96: getdents d1/d7 0 2024-09-17T01:56:26.179 INFO:tasks.workunit.client.0.smithi063.stdout:4/171: symlink de/d17/d36/l3f 0 2024-09-17T01:56:26.179 INFO:tasks.workunit.client.0.smithi063.stdout:6/201: getdents dc/d14/d18/d21/d43 0 2024-09-17T01:56:26.179 INFO:tasks.workunit.client.0.smithi063.stdout:2/110: unlink d3/d7/df/c20 0 2024-09-17T01:56:26.179 INFO:tasks.workunit.client.0.smithi063.stdout:9/93: link d9/cb d9/c1d 0 2024-09-17T01:56:26.179 INFO:tasks.workunit.client.0.smithi063.stdout:6/202: creat dc/f44 x:0 0 0 2024-09-17T01:56:26.180 INFO:tasks.workunit.client.0.smithi063.stdout:4/172: write de/f10 [4366677,75264] 0 2024-09-17T01:56:26.180 INFO:tasks.workunit.client.0.smithi063.stdout:9/94: rename d9/d12 to d9/d14/d1e 0 2024-09-17T01:56:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:26.180 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:26.180 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:26.180 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:26.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/172: fdatasync d6/d9/d13/f1e 0 2024-09-17T01:56:26.181 INFO:tasks.workunit.client.0.smithi063.stdout:6/203: write dc/d14/d18/d21/f40 [260280,89813] 0 2024-09-17T01:56:26.181 INFO:tasks.workunit.client.0.smithi063.stdout:4/173: dread de/d17/f23 [0,4194304] 0 2024-09-17T01:56:26.182 INFO:tasks.workunit.client.0.smithi063.stdout:8/97: write d1/d7/f14 [678269,34158] 0 2024-09-17T01:56:26.182 INFO:tasks.workunit.client.0.smithi063.stdout:8/98: mkdir d1/d7/d1d 0 2024-09-17T01:56:26.182 INFO:tasks.workunit.client.0.smithi063.stdout:4/174: symlink de/d17/d1b/l40 0 2024-09-17T01:56:26.182 INFO:tasks.workunit.client.0.smithi063.stdout:6/204: truncate dc/d1b/f41 728489 0 2024-09-17T01:56:26.183 INFO:tasks.workunit.client.0.smithi063.stdout:5/173: write d6/da/fe [4170668,83523] 0 2024-09-17T01:56:26.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/175: link de/d17/d1b/f32 de/d17/d36/f41 0 2024-09-17T01:56:26.183 INFO:tasks.workunit.client.0.smithi063.stdout:5/174: stat d6 0 2024-09-17T01:56:26.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/176: mknod de/d18/d28/c42 0 2024-09-17T01:56:26.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/177: dread - de/f3b zero size 2024-09-17T01:56:26.184 INFO:tasks.workunit.client.0.smithi063.stdout:5/175: write d6/da/f15 [1238563,102920] 0 2024-09-17T01:56:26.184 INFO:tasks.workunit.client.0.smithi063.stdout:1/285: dread d0/d2d/f37 [0,4194304] 0 2024-09-17T01:56:26.185 INFO:tasks.workunit.client.0.smithi063.stdout:5/176: creat d6/d23/d29/d2b/d31/f33 x:0 0 0 2024-09-17T01:56:26.185 INFO:tasks.workunit.client.0.smithi063.stdout:1/286: write d0/d1c/f5c [383573,109170] 0 2024-09-17T01:56:26.186 INFO:tasks.workunit.client.0.smithi063.stdout:8/99: dread d1/f10 [0,4194304] 0 2024-09-17T01:56:26.186 INFO:tasks.workunit.client.0.smithi063.stdout:4/178: fsync de/f16 0 2024-09-17T01:56:26.186 INFO:tasks.workunit.client.0.smithi063.stdout:4/179: stat de/c11 0 2024-09-17T01:56:26.187 INFO:tasks.workunit.client.0.smithi063.stdout:8/100: creat d1/d7/d1d/f1e x:0 0 0 2024-09-17T01:56:26.187 INFO:tasks.workunit.client.0.smithi063.stdout:1/287: rename d0/f47 to d0/d2d/d35/d3f/d4e/d66/f69 0 2024-09-17T01:56:26.187 INFO:tasks.workunit.client.0.smithi063.stdout:5/177: truncate d6/d9/d13/d1d/f24 1453946 0 2024-09-17T01:56:26.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/180: write de/d2d/f33 [496350,3676] 0 2024-09-17T01:56:26.188 INFO:tasks.workunit.client.0.smithi063.stdout:8/101: chown d1/d7/f14 2177585 1 2024-09-17T01:56:26.188 INFO:tasks.workunit.client.0.smithi063.stdout:8/102: dread - d1/f18 zero size 2024-09-17T01:56:26.189 INFO:tasks.workunit.client.0.smithi063.stdout:1/288: rename d0/d2d/f65 to d0/d2d/d35/d3f/d4e/f6a 0 2024-09-17T01:56:26.189 INFO:tasks.workunit.client.0.smithi063.stdout:5/178: getdents d6/d23/d29/d2b 0 2024-09-17T01:56:26.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/103: creat d1/d7/d1d/f1f x:0 0 0 2024-09-17T01:56:26.189 INFO:tasks.workunit.client.0.smithi063.stdout:1/289: chown d0/d32/d50/c52 11 1 2024-09-17T01:56:26.189 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:26.189 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:26.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/104: getdents d1 0 2024-09-17T01:56:26.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/105: readlink d1/d7/lb 0 2024-09-17T01:56:26.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/106: dread - d1/f18 zero size 2024-09-17T01:56:26.193 INFO:tasks.workunit.client.0.smithi063.stdout:1/290: dread d0/d2d/d35/d3f/d4e/f6a [0,4194304] 0 2024-09-17T01:56:26.194 INFO:tasks.workunit.client.0.smithi063.stdout:5/179: dwrite d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:26.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/291: mkdir d0/d2d/d35/d3f/d6b 0 2024-09-17T01:56:26.197 INFO:tasks.workunit.client.0.smithi063.stdout:5/180: symlink d6/d9/l34 0 2024-09-17T01:56:26.197 INFO:tasks.workunit.client.0.smithi063.stdout:8/107: dwrite d1/d7/f1a [0,4194304] 0 2024-09-17T01:56:26.197 INFO:tasks.workunit.client.0.smithi063.stdout:1/292: chown d0/d32/f42 2294118 1 2024-09-17T01:56:26.197 INFO:tasks.workunit.client.0.smithi063.stdout:5/181: readlink d6/d9/l34 0 2024-09-17T01:56:26.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/293: read d0/d1c/f1d [4149326,54962] 0 2024-09-17T01:56:26.198 INFO:tasks.workunit.client.0.smithi063.stdout:8/108: fsync d1/d7/d1d/f1e 0 2024-09-17T01:56:26.198 INFO:tasks.workunit.client.0.smithi063.stdout:5/182: fdatasync d6/da/f27 0 2024-09-17T01:56:26.199 INFO:tasks.workunit.client.0.smithi063.stdout:8/109: unlink d1/f17 0 2024-09-17T01:56:26.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:26.201 INFO:tasks.workunit.client.0.smithi063.stdout:5/183: dread - d6/d23/d29/d2b/d31/f33 zero size 2024-09-17T01:56:26.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/184: write d6/da/d19/f2c [4546,55587] 0 2024-09-17T01:56:26.207 INFO:tasks.workunit.client.0.smithi063.stdout:8/110: creat d1/d7/d1d/f20 x:0 0 0 2024-09-17T01:56:26.208 INFO:tasks.workunit.client.0.smithi063.stdout:5/185: dwrite d6/fd [4194304,4194304] 0 2024-09-17T01:56:26.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/111: mknod d1/df/c21 0 2024-09-17T01:56:26.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/112: dread - d1/d7/d1d/f1e zero size 2024-09-17T01:56:26.210 INFO:tasks.workunit.client.0.smithi063.stdout:8/113: truncate d1/df/f1b 350699 0 2024-09-17T01:56:26.210 INFO:tasks.workunit.client.0.smithi063.stdout:1/294: dwrite d0/d2d/d35/d3f/d4e/f6a [0,4194304] 0 2024-09-17T01:56:26.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/220: sync 2024-09-17T01:56:26.211 INFO:tasks.workunit.client.0.smithi063.stdout:0/118: sync 2024-09-17T01:56:26.211 INFO:tasks.workunit.client.0.smithi063.stdout:3/221: stat df/d12/f2e 0 2024-09-17T01:56:26.213 INFO:tasks.workunit.client.0.smithi063.stdout:5/186: mkdir d6/d35 0 2024-09-17T01:56:26.214 INFO:tasks.workunit.client.0.smithi063.stdout:8/114: mknod d1/d7/d1d/c22 0 2024-09-17T01:56:26.214 INFO:tasks.workunit.client.0.smithi063.stdout:0/119: creat d1/d3/d1b/f2a x:0 0 0 2024-09-17T01:56:26.214 INFO:tasks.workunit.client.0.smithi063.stdout:3/222: mkdir df/d12/d1e/d53 0 2024-09-17T01:56:26.214 INFO:tasks.workunit.client.0.smithi063.stdout:5/187: chown d6/da/f15 66021162 1 2024-09-17T01:56:26.215 INFO:tasks.workunit.client.0.smithi063.stdout:8/115: unlink d1/cd 0 2024-09-17T01:56:26.215 INFO:tasks.workunit.client.0.smithi063.stdout:3/223: symlink df/d12/d2d/l54 0 2024-09-17T01:56:26.215 INFO:tasks.workunit.client.0.smithi063.stdout:1/295: dread d0/d2d/d35/d3f/d4e/f5d [0,4194304] 0 2024-09-17T01:56:26.215 INFO:tasks.workunit.client.0.smithi063.stdout:5/188: chown d6/da/c17 6 1 2024-09-17T01:56:26.216 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:26.216 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:26.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/224: write df/d12/d1e/f2b [2031185,41291] 0 2024-09-17T01:56:26.217 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:26.217 INFO:tasks.workunit.client.0.smithi063.stdout:0/120: link d1/d3/l9 d1/d3/d1b/l2b 0 2024-09-17T01:56:26.220 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:26.220 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:26.221 INFO:tasks.workunit.client.0.smithi063.stdout:8/116: truncate d1/d7/f14 289581 0 2024-09-17T01:56:26.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/296: dwrite d0/d32/d50/f54 [0,4194304] 0 2024-09-17T01:56:26.221 INFO:tasks.workunit.client.0.smithi063.stdout:5/189: dread d6/da/d19/f26 [0,4194304] 0 2024-09-17T01:56:26.223 INFO:tasks.workunit.client.0.smithi063.stdout:8/117: rmdir d1/df 39 2024-09-17T01:56:26.223 INFO:tasks.workunit.client.0.smithi063.stdout:5/190: mkdir d6/d23/d29/d36 0 2024-09-17T01:56:26.225 INFO:tasks.workunit.client.0.smithi063.stdout:5/191: rename d6/da to d6/d37 0 2024-09-17T01:56:26.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/192: write d6/d37/d19/f26 [1941930,99437] 0 2024-09-17T01:56:26.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/193: link d6/l22 d6/d9/d32/l38 0 2024-09-17T01:56:26.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/194: symlink d6/d23/d29/d2b/l39 0 2024-09-17T01:56:26.233 INFO:tasks.workunit.client.0.smithi063.stdout:5/195: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:56:26.236 INFO:tasks.workunit.client.0.smithi063.stdout:8/118: write d1/d7/f14 [238082,10537] 0 2024-09-17T01:56:26.236 INFO:tasks.workunit.client.0.smithi063.stdout:3/225: dread df/f1c [0,4194304] 0 2024-09-17T01:56:26.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/119: creat d1/df/f23 x:0 0 0 2024-09-17T01:56:26.238 INFO:tasks.workunit.client.0.smithi063.stdout:8/120: truncate d1/df/f23 266246 0 2024-09-17T01:56:26.238 INFO:tasks.workunit.client.0.smithi063.stdout:0/121: dread d1/d3/f8 [4194304,4194304] 0 2024-09-17T01:56:26.238 INFO:tasks.workunit.client.0.smithi063.stdout:8/121: creat d1/d7/f24 x:0 0 0 2024-09-17T01:56:26.241 INFO:tasks.workunit.client.0.smithi063.stdout:5/196: dread d6/d37/f27 [0,4194304] 0 2024-09-17T01:56:26.242 INFO:tasks.workunit.client.0.smithi063.stdout:5/197: chown d6/fd 617 1 2024-09-17T01:56:26.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/226: dread df/d12/f16 [0,4194304] 0 2024-09-17T01:56:26.243 INFO:tasks.workunit.client.0.smithi063.stdout:3/227: creat df/d12/d1e/f55 x:0 0 0 2024-09-17T01:56:26.243 INFO:tasks.workunit.client.0.smithi063.stdout:0/122: truncate d1/f1e 542126 0 2024-09-17T01:56:26.243 INFO:tasks.workunit.client.0.smithi063.stdout:3/228: dread - df/d12/d2d/f3c zero size 2024-09-17T01:56:26.243 INFO:tasks.workunit.client.0.smithi063.stdout:0/123: mkdir d1/d3/db/d2c 0 2024-09-17T01:56:26.244 INFO:tasks.workunit.client.0.smithi063.stdout:3/229: dread - df/d12/d2d/f3c zero size 2024-09-17T01:56:26.244 INFO:tasks.workunit.client.0.smithi063.stdout:3/230: dread - df/d28/f48 zero size 2024-09-17T01:56:26.244 INFO:tasks.workunit.client.0.smithi063.stdout:3/231: chown df/f11 15053 1 2024-09-17T01:56:26.245 INFO:tasks.workunit.client.0.smithi063.stdout:5/198: dread d6/fd [4194304,4194304] 0 2024-09-17T01:56:26.249 INFO:tasks.workunit.client.0.smithi063.stdout:0/124: dwrite d1/d3/d1b/f2a [0,4194304] 0 2024-09-17T01:56:26.250 INFO:tasks.workunit.client.0.smithi063.stdout:5/199: dwrite d6/f12 [4194304,4194304] 0 2024-09-17T01:56:26.251 INFO:tasks.workunit.client.0.smithi063.stdout:3/232: dwrite df/d12/d3a/f51 [0,4194304] 0 2024-09-17T01:56:26.252 INFO:tasks.workunit.client.0.smithi063.stdout:5/200: write d6/f12 [9022787,43841] 0 2024-09-17T01:56:26.254 INFO:tasks.workunit.client.0.smithi063.stdout:5/201: mkdir d6/d23/d3a 0 2024-09-17T01:56:26.255 INFO:tasks.workunit.client.0.smithi063.stdout:4/181: sync 2024-09-17T01:56:26.255 INFO:tasks.workunit.client.0.smithi063.stdout:7/161: sync 2024-09-17T01:56:26.255 INFO:tasks.workunit.client.0.smithi063.stdout:6/205: sync 2024-09-17T01:56:26.255 INFO:tasks.workunit.client.0.smithi063.stdout:2/111: sync 2024-09-17T01:56:26.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/95: sync 2024-09-17T01:56:26.259 INFO:tasks.workunit.client.0.smithi063.stdout:4/182: truncate de/f16 1353098 0 2024-09-17T01:56:26.261 INFO:tasks.workunit.client.0.smithi063.stdout:4/183: chown de/d17/c31 36 1 2024-09-17T01:56:26.262 INFO:tasks.workunit.client.0.smithi063.stdout:3/233: dread df/d12/d1e/f3e [0,4194304] 0 2024-09-17T01:56:26.263 INFO:tasks.workunit.client.0.smithi063.stdout:2/112: dread d3/f4 [0,4194304] 0 2024-09-17T01:56:26.263 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:26.265+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:26.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/125: dwrite d1/d3/db/d14/f22 [0,4194304] 0 2024-09-17T01:56:26.264 INFO:tasks.workunit.client.0.smithi063.stdout:4/184: getdents de/d18 0 2024-09-17T01:56:26.265 INFO:tasks.workunit.client.0.smithi063.stdout:5/202: truncate d6/d9/f28 2322466 0 2024-09-17T01:56:26.265 INFO:tasks.workunit.client.0.smithi063.stdout:6/206: dwrite dc/d14/d19/d20/f23 [0,4194304] 0 2024-09-17T01:56:26.266 INFO:tasks.workunit.client.0.smithi063.stdout:6/207: write f7 [486342,87505] 0 2024-09-17T01:56:26.266 INFO:tasks.workunit.client.0.smithi063.stdout:5/203: chown d6/d37/cf 76940 1 2024-09-17T01:56:26.268 INFO:tasks.workunit.client.0.smithi063.stdout:2/113: creat d3/d7/f26 x:0 0 0 2024-09-17T01:56:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:9/96: dwrite d9/de/f17 [0,4194304] 0 2024-09-17T01:56:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:0/126: dread - d1/d3/db/d14/f26 zero size 2024-09-17T01:56:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:6/208: creat dc/d14/d19/f45 x:0 0 0 2024-09-17T01:56:26.270 INFO:tasks.workunit.client.0.smithi063.stdout:6/209: chown l2 0 1 2024-09-17T01:56:26.273 INFO:tasks.workunit.client.0.smithi063.stdout:0/127: fsync d1/d3/d1b/f2a 0 2024-09-17T01:56:26.274 INFO:tasks.workunit.client.0.smithi063.stdout:6/210: link dc/c11 dc/d14/d18/d21/c46 0 2024-09-17T01:56:26.275 INFO:tasks.workunit.client.0.smithi063.stdout:6/211: chown dc/f38 1034694459 1 2024-09-17T01:56:26.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/114: dwrite d3/d7/df/f14 [0,4194304] 0 2024-09-17T01:56:26.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/212: dread - dc/d14/d19/f45 zero size 2024-09-17T01:56:26.279 INFO:tasks.workunit.client.0.smithi063.stdout:4/185: dread de/d17/d1b/f1c [0,4194304] 0 2024-09-17T01:56:26.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/128: link d1/d3/db/d14/f26 d1/d1d/f2d 0 2024-09-17T01:56:26.279 INFO:tasks.workunit.client.0.smithi063.stdout:5/204: dwrite d6/d37/d19/f2c [0,4194304] 0 2024-09-17T01:56:26.279 INFO:tasks.workunit.client.0.smithi063.stdout:2/115: mknod d3/c27 0 2024-09-17T01:56:26.280 INFO:tasks.workunit.client.0.smithi063.stdout:9/97: dwrite d9/de/ff [0,4194304] 0 2024-09-17T01:56:26.280 INFO:tasks.workunit.client.0.smithi063.stdout:4/186: chown f8 320490 1 2024-09-17T01:56:26.280 INFO:tasks.workunit.client.0.smithi063.stdout:6/213: write dc/d14/d18/d21/f40 [75187,24741] 0 2024-09-17T01:56:26.281 INFO:tasks.workunit.client.0.smithi063.stdout:6/214: chown dc/d14/d19/d20/d32/f33 248 1 2024-09-17T01:56:26.281 INFO:tasks.workunit.client.0.smithi063.stdout:5/205: rmdir d6 39 2024-09-17T01:56:26.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/116: rmdir d3 39 2024-09-17T01:56:26.282 INFO:tasks.workunit.client.0.smithi063.stdout:0/129: write d1/d3/db/f13 [381204,57611] 0 2024-09-17T01:56:26.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/98: rename d9/de/f17 to d9/d14/d1b/f1f 0 2024-09-17T01:56:26.282 INFO:tasks.workunit.client.0.smithi063.stdout:4/187: creat de/d2d/f43 x:0 0 0 2024-09-17T01:56:26.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/188: write f8 [1207578,9295] 0 2024-09-17T01:56:26.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/117: unlink d3/d7/df/c24 0 2024-09-17T01:56:26.284 INFO:tasks.workunit.client.0.smithi063.stdout:2/118: fsync d3/d7/f1c 0 2024-09-17T01:56:26.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/189: mknod de/d18/d28/d30/c44 0 2024-09-17T01:56:26.285 INFO:tasks.workunit.client.0.smithi063.stdout:6/215: truncate dc/d1b/f29 5483241 0 2024-09-17T01:56:26.286 INFO:tasks.workunit.client.0.smithi063.stdout:4/190: read de/d17/d1b/f1c [405036,11897] 0 2024-09-17T01:56:26.286 INFO:tasks.workunit.client.0.smithi063.stdout:6/216: mknod dc/d14/d19/d20/d32/c47 0 2024-09-17T01:56:26.286 INFO:tasks.workunit.client.0.smithi063.stdout:4/191: chown de/d17/d1b/f32 113446 1 2024-09-17T01:56:26.287 INFO:tasks.workunit.client.0.smithi063.stdout:5/206: dread d6/d37/d19/f26 [0,4194304] 0 2024-09-17T01:56:26.287 INFO:tasks.workunit.client.0.smithi063.stdout:4/192: write de/d18/f1d [1597003,70936] 0 2024-09-17T01:56:26.288 INFO:tasks.workunit.client.0.smithi063.stdout:9/99: rename d9/d14 to d9/de/d20 0 2024-09-17T01:56:26.288 INFO:tasks.workunit.client.0.smithi063.stdout:4/193: stat de/d2d/l35 0 2024-09-17T01:56:26.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/207: mknod d6/c3b 0 2024-09-17T01:56:26.291 INFO:tasks.workunit.client.0.smithi063.stdout:9/100: write d9/de/d20/d1b/f1f [223040,89136] 0 2024-09-17T01:56:26.291 INFO:tasks.workunit.client.0.smithi063.stdout:4/194: symlink de/d18/d28/d30/l45 0 2024-09-17T01:56:26.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/195: stat de/d17/f23 0 2024-09-17T01:56:26.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/217: dread dc/d14/d19/f35 [0,4194304] 0 2024-09-17T01:56:26.292 INFO:tasks.workunit.client.0.smithi063.stdout:2/119: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:56:26.292 INFO:tasks.workunit.client.0.smithi063.stdout:0/130: dwrite d1/f6 [4194304,4194304] 0 2024-09-17T01:56:26.293 INFO:tasks.workunit.client.0.smithi063.stdout:4/196: chown de/d2d/l35 174749 1 2024-09-17T01:56:26.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/101: mknod d9/de/d20/d1e/c21 0 2024-09-17T01:56:26.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/102: read d9/fc [267782,49282] 0 2024-09-17T01:56:26.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/103: fdatasync f7 0 2024-09-17T01:56:26.296 INFO:tasks.workunit.client.0.smithi063.stdout:6/218: creat dc/d14/d18/d21/f48 x:0 0 0 2024-09-17T01:56:26.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/208: link d6/d9/d13/c2d d6/d23/d29/d2b/c3c 0 2024-09-17T01:56:26.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/209: write d6/fd [4975411,33339] 0 2024-09-17T01:56:26.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/219: truncate dc/d14/d19/d20/f23 5077939 0 2024-09-17T01:56:26.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/210: stat d6/d23/f2a 0 2024-09-17T01:56:26.299 INFO:tasks.workunit.client.0.smithi063.stdout:6/220: rmdir dc/d14/d19 39 2024-09-17T01:56:26.300 INFO:tasks.workunit.client.0.smithi063.stdout:5/211: unlink c4 0 2024-09-17T01:56:26.300 INFO:tasks.workunit.client.0.smithi063.stdout:6/221: stat l8 0 2024-09-17T01:56:26.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/234: dread f3 [0,4194304] 0 2024-09-17T01:56:26.302 INFO:tasks.workunit.client.0.smithi063.stdout:6/222: fsync dc/d14/d19/f1a 0 2024-09-17T01:56:26.302 INFO:tasks.workunit.client.0.smithi063.stdout:3/235: mknod df/d12/d1e/d39/c56 0 2024-09-17T01:56:26.303 INFO:tasks.workunit.client.0.smithi063.stdout:2/120: dwrite d3/d7/df/f19 [0,4194304] 0 2024-09-17T01:56:26.303 INFO:tasks.workunit.client.0.smithi063.stdout:3/236: creat df/d12/d1e/f57 x:0 0 0 2024-09-17T01:56:26.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/197: dwrite de/d17/f23 [0,4194304] 0 2024-09-17T01:56:26.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/223: creat dc/d14/d18/d21/d43/f49 x:0 0 0 2024-09-17T01:56:26.304 INFO:tasks.workunit.client.0.smithi063.stdout:3/237: dread - df/d12/d2d/f3c zero size 2024-09-17T01:56:26.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/212: dread d6/d37/d19/f2c [0,4194304] 0 2024-09-17T01:56:26.306 INFO:tasks.workunit.client.0.smithi063.stdout:0/131: truncate d1/d3/f8 7830311 0 2024-09-17T01:56:26.306 INFO:tasks.workunit.client.0.smithi063.stdout:9/104: truncate d9/de/ff 3898661 0 2024-09-17T01:56:26.307 INFO:tasks.workunit.client.0.smithi063.stdout:2/121: mkdir d3/d28 0 2024-09-17T01:56:26.308 INFO:tasks.workunit.client.0.smithi063.stdout:4/198: link de/c13 de/d18/d28/d30/c46 0 2024-09-17T01:56:26.308 INFO:tasks.workunit.client.0.smithi063.stdout:9/105: mkdir d9/de/d20/d22 0 2024-09-17T01:56:26.309 INFO:tasks.workunit.client.0.smithi063.stdout:4/199: truncate de/d2d/f43 139440 0 2024-09-17T01:56:26.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/200: symlink de/d2d/l47 0 2024-09-17T01:56:26.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/122: creat d3/d7/df/f29 x:0 0 0 2024-09-17T01:56:26.311 INFO:tasks.workunit.client.0.smithi063.stdout:9/106: rmdir d9/de/d20/d22 0 2024-09-17T01:56:26.312 INFO:tasks.workunit.client.0.smithi063.stdout:2/123: mkdir d3/d2a 0 2024-09-17T01:56:26.312 INFO:tasks.workunit.client.0.smithi063.stdout:2/124: readlink d3/d7/l16 0 2024-09-17T01:56:26.312 INFO:tasks.workunit.client.0.smithi063.stdout:9/107: symlink d9/de/l23 0 2024-09-17T01:56:26.313 INFO:tasks.workunit.client.0.smithi063.stdout:2/125: fsync d3/f8 0 2024-09-17T01:56:26.313 INFO:tasks.workunit.client.0.smithi063.stdout:9/108: creat d9/de/d20/f24 x:0 0 0 2024-09-17T01:56:26.313 INFO:tasks.workunit.client.0.smithi063.stdout:2/126: mkdir d3/d2a/d2b 0 2024-09-17T01:56:26.313 INFO:tasks.workunit.client.0.smithi063.stdout:5/213: read d6/fd [2249448,79895] 0 2024-09-17T01:56:26.314 INFO:tasks.workunit.client.0.smithi063.stdout:6/224: read dc/d1b/f29 [770755,70121] 0 2024-09-17T01:56:26.314 INFO:tasks.workunit.client.0.smithi063.stdout:2/127: mkdir d3/d2c 0 2024-09-17T01:56:26.314 INFO:tasks.workunit.client.0.smithi063.stdout:9/109: mkdir d9/de/d20/d1b/d25 0 2024-09-17T01:56:26.314 INFO:tasks.workunit.client.0.smithi063.stdout:2/128: stat f2 0 2024-09-17T01:56:26.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/214: mknod d6/d23/d29/d2b/c3d 0 2024-09-17T01:56:26.314 INFO:tasks.workunit.client.0.smithi063.stdout:3/238: read df/d12/d1e/f24 [199242,85423] 0 2024-09-17T01:56:26.315 INFO:tasks.workunit.client.0.smithi063.stdout:3/239: read fd [585532,91748] 0 2024-09-17T01:56:26.315 INFO:tasks.workunit.client.0.smithi063.stdout:5/215: write d6/d9/d13/f1e [181556,127963] 0 2024-09-17T01:56:26.316 INFO:tasks.workunit.client.0.smithi063.stdout:3/240: fdatasync df/d12/f16 0 2024-09-17T01:56:26.316 INFO:tasks.workunit.client.0.smithi063.stdout:5/216: chown d6/f12 15708282 1 2024-09-17T01:56:26.316 INFO:tasks.workunit.client.0.smithi063.stdout:5/217: mknod d6/d9/c3e 0 2024-09-17T01:56:26.317 INFO:tasks.workunit.client.0.smithi063.stdout:3/241: mkdir df/d12/d43/d50/d58 0 2024-09-17T01:56:26.318 INFO:tasks.workunit.client.0.smithi063.stdout:5/218: dread d6/d37/f27 [0,4194304] 0 2024-09-17T01:56:26.318 INFO:tasks.workunit.client.0.smithi063.stdout:4/201: getdents de/d18/d28/d30 0 2024-09-17T01:56:26.318 INFO:tasks.workunit.client.0.smithi063.stdout:5/219: mkdir d6/d23/d3f 0 2024-09-17T01:56:26.318 INFO:tasks.workunit.client.0.smithi063.stdout:4/202: symlink de/d18/d28/d30/l48 0 2024-09-17T01:56:26.320 INFO:tasks.workunit.client.0.smithi063.stdout:5/220: creat d6/d9/f40 x:0 0 0 2024-09-17T01:56:26.320 INFO:tasks.workunit.client.0.smithi063.stdout:4/203: dread - de/f38 zero size 2024-09-17T01:56:26.320 INFO:tasks.workunit.client.0.smithi063.stdout:9/110: getdents d9/de/d20 0 2024-09-17T01:56:26.320 INFO:tasks.workunit.client.0.smithi063.stdout:2/129: write d3/d7/fd [1171259,99065] 0 2024-09-17T01:56:26.322 INFO:tasks.workunit.client.0.smithi063.stdout:4/204: mknod de/c49 0 2024-09-17T01:56:26.322 INFO:tasks.workunit.client.0.smithi063.stdout:0/132: write d1/d3/f8 [6199810,130065] 0 2024-09-17T01:56:26.322 INFO:tasks.workunit.client.0.smithi063.stdout:5/221: symlink d6/d9/d13/l41 0 2024-09-17T01:56:26.323 INFO:tasks.workunit.client.0.smithi063.stdout:2/130: readlink d3/d7/df/l1f 0 2024-09-17T01:56:26.323 INFO:tasks.workunit.client.0.smithi063.stdout:3/242: dread f3 [0,4194304] 0 2024-09-17T01:56:26.323 INFO:tasks.workunit.client.0.smithi063.stdout:2/131: fdatasync d3/f8 0 2024-09-17T01:56:26.324 INFO:tasks.workunit.client.0.smithi063.stdout:9/111: link c4 d9/de/d20/d1e/c26 0 2024-09-17T01:56:26.324 INFO:tasks.workunit.client.0.smithi063.stdout:3/243: mknod df/d28/c59 0 2024-09-17T01:56:26.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/225: dwrite dc/d14/d19/f2d [0,4194304] 0 2024-09-17T01:56:26.325 INFO:tasks.workunit.client.0.smithi063.stdout:5/222: dread - d6/d9/d13/d1d/f2f zero size 2024-09-17T01:56:26.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/132: mknod d3/c2d 0 2024-09-17T01:56:26.325 INFO:tasks.workunit.client.0.smithi063.stdout:9/112: read - d9/de/d20/f24 zero size 2024-09-17T01:56:26.327 INFO:tasks.workunit.client.0.smithi063.stdout:3/244: rename l5 to df/d12/d43/d50/l5a 0 2024-09-17T01:56:26.329 INFO:tasks.workunit.client.0.smithi063.stdout:6/226: symlink dc/l4a 0 2024-09-17T01:56:26.329 INFO:tasks.workunit.client.0.smithi063.stdout:9/113: unlink d9/de/l23 0 2024-09-17T01:56:26.329 INFO:tasks.workunit.client.0.smithi063.stdout:2/133: getdents d3/d28 0 2024-09-17T01:56:26.329 INFO:tasks.workunit.client.0.smithi063.stdout:9/114: chown d9/de 3038 1 2024-09-17T01:56:26.329 INFO:tasks.workunit.client.0.smithi063.stdout:2/134: readlink d3/l1d 0 2024-09-17T01:56:26.330 INFO:tasks.workunit.client.0.smithi063.stdout:0/133: dwrite d1/f2 [4194304,4194304] 0 2024-09-17T01:56:26.331 INFO:tasks.workunit.client.0.smithi063.stdout:6/227: creat dc/d1b/f4b x:0 0 0 2024-09-17T01:56:26.331 INFO:tasks.workunit.client.0.smithi063.stdout:4/205: dwrite de/d17/d1b/f1e [0,4194304] 0 2024-09-17T01:56:26.333 INFO:tasks.workunit.client.0.smithi063.stdout:4/206: read - de/d17/d1b/f32 zero size 2024-09-17T01:56:26.334 INFO:tasks.workunit.client.0.smithi063.stdout:3/245: creat df/d12/d43/d50/d58/f5b x:0 0 0 2024-09-17T01:56:26.334 INFO:tasks.workunit.client.0.smithi063.stdout:6/228: mknod dc/c4c 0 2024-09-17T01:56:26.336 INFO:tasks.workunit.client.0.smithi063.stdout:3/246: chown df/f20 28203674 1 2024-09-17T01:56:26.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/223: dwrite d6/d23/f2a [0,4194304] 0 2024-09-17T01:56:26.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/207: write de/d17/d1b/f1e [3173396,67334] 0 2024-09-17T01:56:26.338 INFO:tasks.workunit.client.0.smithi063.stdout:2/135: dwrite d3/d7/df/f25 [0,4194304] 0 2024-09-17T01:56:26.339 INFO:tasks.workunit.client.0.smithi063.stdout:3/247: write df/f49 [919313,94452] 0 2024-09-17T01:56:26.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/115: dwrite f7 [0,4194304] 0 2024-09-17T01:56:26.339 INFO:tasks.workunit.client.0.smithi063.stdout:6/229: rename dc/d14/d19/d20/d32 to dc/d14/d19/d20/d32/d4d 22 2024-09-17T01:56:26.340 INFO:tasks.workunit.client.0.smithi063.stdout:4/208: chown de/f38 8 1 2024-09-17T01:56:26.340 INFO:tasks.workunit.client.0.smithi063.stdout:0/134: dread d1/d3/d1b/f2a [0,4194304] 0 2024-09-17T01:56:26.340 INFO:tasks.workunit.client.0.smithi063.stdout:9/116: mkdir d9/d27 0 2024-09-17T01:56:26.346 INFO:tasks.workunit.client.0.smithi063.stdout:2/136: dread d3/f10 [0,4194304] 0 2024-09-17T01:56:26.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/248: symlink df/d28/l5c 0 2024-09-17T01:56:26.346 INFO:tasks.workunit.client.0.smithi063.stdout:0/135: creat d1/d3/db/d21/f2e x:0 0 0 2024-09-17T01:56:26.347 INFO:tasks.workunit.client.0.smithi063.stdout:6/230: dwrite f7 [0,4194304] 0 2024-09-17T01:56:26.348 INFO:tasks.workunit.client.0.smithi063.stdout:4/209: creat de/d2d/f4a x:0 0 0 2024-09-17T01:56:26.348 INFO:tasks.workunit.client.0.smithi063.stdout:9/117: dread d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:26.348 INFO:tasks.workunit.client.0.smithi063.stdout:4/210: dread - de/d17/d36/f41 zero size 2024-09-17T01:56:26.349 INFO:tasks.workunit.client.0.smithi063.stdout:9/118: rename c6 to d9/de/d20/d1b/c28 0 2024-09-17T01:56:26.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/211: read - de/d17/d36/f41 zero size 2024-09-17T01:56:26.350 INFO:tasks.workunit.client.0.smithi063.stdout:6/231: getdents dc/d14/d2f 0 2024-09-17T01:56:26.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/212: chown f7 362455210 1 2024-09-17T01:56:26.353 INFO:tasks.workunit.client.0.smithi063.stdout:6/232: getdents dc/d14/d18/d21/d43 0 2024-09-17T01:56:26.354 INFO:tasks.workunit.client.0.smithi063.stdout:6/233: creat dc/f4e x:0 0 0 2024-09-17T01:56:26.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/234: fdatasync dc/d14/d18/d21/d43/f49 0 2024-09-17T01:56:26.356 INFO:tasks.workunit.client.0.smithi063.stdout:2/137: truncate d3/d7/df/f25 1015491 0 2024-09-17T01:56:26.356 INFO:tasks.workunit.client.0.smithi063.stdout:3/249: write fc [3603595,126700] 0 2024-09-17T01:56:26.357 INFO:tasks.workunit.client.0.smithi063.stdout:3/250: creat df/d12/d43/d50/f5d x:0 0 0 2024-09-17T01:56:26.357 INFO:tasks.workunit.client.0.smithi063.stdout:4/213: dwrite de/f3b [0,4194304] 0 2024-09-17T01:56:26.357 INFO:tasks.workunit.client.0.smithi063.stdout:3/251: fsync df/d12/d3a/f51 0 2024-09-17T01:56:26.358 INFO:tasks.workunit.client.0.smithi063.stdout:3/252: dread - df/d12/d2d/f36 zero size 2024-09-17T01:56:26.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/214: link de/d18/f1d de/d2d/d3c/f4b 0 2024-09-17T01:56:26.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/215: dread - de/d2d/f4a zero size 2024-09-17T01:56:26.361 INFO:tasks.workunit.client.0.smithi063.stdout:8/122: sync 2024-09-17T01:56:26.361 INFO:tasks.workunit.client.0.smithi063.stdout:7/162: sync 2024-09-17T01:56:26.361 INFO:tasks.workunit.client.0.smithi063.stdout:1/297: sync 2024-09-17T01:56:26.361 INFO:tasks.workunit.client.0.smithi063.stdout:5/224: dread d6/d9/d13/d1d/f21 [0,4194304] 0 2024-09-17T01:56:26.362 INFO:tasks.workunit.client.0.smithi063.stdout:4/216: read de/d2d/f33 [402894,108897] 0 2024-09-17T01:56:26.363 INFO:tasks.workunit.client.0.smithi063.stdout:8/123: symlink d1/d7/l25 0 2024-09-17T01:56:26.363 INFO:tasks.workunit.client.0.smithi063.stdout:7/163: mknod d2/d3/c35 0 2024-09-17T01:56:26.363 INFO:tasks.workunit.client.0.smithi063.stdout:6/235: dwrite dc/f38 [0,4194304] 0 2024-09-17T01:56:26.364 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:26.365+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:26.364 INFO:tasks.workunit.client.0.smithi063.stdout:6/236: fsync dc/d14/d19/f1a 0 2024-09-17T01:56:26.365 INFO:tasks.workunit.client.0.smithi063.stdout:5/225: symlink d6/d23/d29/d2b/l42 0 2024-09-17T01:56:26.365 INFO:tasks.workunit.client.0.smithi063.stdout:7/164: symlink d2/d3/d27/l36 0 2024-09-17T01:56:26.366 INFO:tasks.workunit.client.0.smithi063.stdout:6/237: chown dc/d14/d18/d21/c3e 0 1 2024-09-17T01:56:26.367 INFO:tasks.workunit.client.0.smithi063.stdout:4/217: link de/d18/f1d de/f4c 0 2024-09-17T01:56:26.367 INFO:tasks.workunit.client.0.smithi063.stdout:9/119: dwrite d9/fc [0,4194304] 0 2024-09-17T01:56:26.368 INFO:tasks.workunit.client.0.smithi063.stdout:7/165: write d2/f1c [3157017,31411] 0 2024-09-17T01:56:26.368 INFO:tasks.workunit.client.0.smithi063.stdout:9/120: readlink l5 0 2024-09-17T01:56:26.368 INFO:tasks.workunit.client.0.smithi063.stdout:6/238: chown dc/f38 166 1 2024-09-17T01:56:26.369 INFO:tasks.workunit.client.0.smithi063.stdout:6/239: fdatasync dc/d1b/f4b 0 2024-09-17T01:56:26.369 INFO:tasks.workunit.client.0.smithi063.stdout:9/121: creat d9/de/d20/f29 x:0 0 0 2024-09-17T01:56:26.369 INFO:tasks.workunit.client.0.smithi063.stdout:6/240: rename dc to dc/d4f 22 2024-09-17T01:56:26.370 INFO:tasks.workunit.client.0.smithi063.stdout:9/122: dread - d9/de/f19 zero size 2024-09-17T01:56:26.371 INFO:tasks.workunit.client.0.smithi063.stdout:9/123: read d9/de/d20/d1b/f1f [1720415,93353] 0 2024-09-17T01:56:26.371 INFO:tasks.workunit.client.0.smithi063.stdout:9/124: unlink c4 0 2024-09-17T01:56:26.372 INFO:tasks.workunit.client.0.smithi063.stdout:1/298: dwrite d0/d2d/d35/d3f/f68 [0,4194304] 0 2024-09-17T01:56:26.374 INFO:tasks.workunit.client.0.smithi063.stdout:9/125: mkdir d9/de/d20/d1e/d2a 0 2024-09-17T01:56:26.378 INFO:tasks.workunit.client.0.smithi063.stdout:1/299: fsync d0/d1c/f1d 0 2024-09-17T01:56:26.378 INFO:tasks.workunit.client.0.smithi063.stdout:6/241: dwrite dc/d14/d18/d21/d43/f49 [0,4194304] 0 2024-09-17T01:56:26.378 INFO:tasks.workunit.client.0.smithi063.stdout:1/300: readlink d0/d1c/l43 0 2024-09-17T01:56:26.378 INFO:tasks.workunit.client.0.smithi063.stdout:9/126: dread d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:26.379 INFO:tasks.workunit.client.0.smithi063.stdout:8/124: getdents d1/d7 0 2024-09-17T01:56:26.379 INFO:tasks.workunit.client.0.smithi063.stdout:5/226: truncate d6/d37/f27 1392630 0 2024-09-17T01:56:26.379 INFO:tasks.workunit.client.0.smithi063.stdout:1/301: mkdir d0/d32/d50/d6c 0 2024-09-17T01:56:26.380 INFO:tasks.workunit.client.0.smithi063.stdout:8/125: rmdir d1/d7 39 2024-09-17T01:56:26.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/127: creat d9/de/d20/d1b/d25/f2b x:0 0 0 2024-09-17T01:56:26.380 INFO:tasks.workunit.client.0.smithi063.stdout:1/302: symlink d0/d2d/d5e/l6d 0 2024-09-17T01:56:26.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/128: dread - d9/de/d20/d1b/d25/f2b zero size 2024-09-17T01:56:26.381 INFO:tasks.workunit.client.0.smithi063.stdout:8/126: rename d1/d7/f24 to d1/d7/f26 0 2024-09-17T01:56:26.381 INFO:tasks.workunit.client.0.smithi063.stdout:9/129: readlink d9/de/l16 0 2024-09-17T01:56:26.381 INFO:tasks.workunit.client.0.smithi063.stdout:1/303: symlink d0/d32/l6e 0 2024-09-17T01:56:26.382 INFO:tasks.workunit.client.0.smithi063.stdout:5/227: truncate d6/d9/d13/f1e 5128942 0 2024-09-17T01:56:26.384 INFO:tasks.workunit.client.0.smithi063.stdout:1/304: mkdir d0/d2d/d35/d6f 0 2024-09-17T01:56:26.384 INFO:tasks.workunit.client.0.smithi063.stdout:9/130: rename d9/c1d to d9/de/c2c 0 2024-09-17T01:56:26.384 INFO:tasks.workunit.client.0.smithi063.stdout:1/305: readlink d0/l24 0 2024-09-17T01:56:26.385 INFO:tasks.workunit.client.0.smithi063.stdout:4/218: dwrite de/d17/d36/f41 [0,4194304] 0 2024-09-17T01:56:26.386 INFO:tasks.workunit.client.0.smithi063.stdout:4/219: chown de/d18/d28/d30/l48 23 1 2024-09-17T01:56:26.387 INFO:tasks.workunit.client.0.smithi063.stdout:7/166: dwrite d2/df/f10 [0,4194304] 0 2024-09-17T01:56:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:26.387 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:26.388 INFO:tasks.workunit.client.0.smithi063.stdout:8/127: dread d1/f10 [0,4194304] 0 2024-09-17T01:56:26.389 INFO:tasks.workunit.client.0.smithi063.stdout:9/131: creat d9/de/d20/d1b/f2d x:0 0 0 2024-09-17T01:56:26.389 INFO:tasks.workunit.client.0.smithi063.stdout:1/306: creat d0/d32/d50/f70 x:0 0 0 2024-09-17T01:56:26.389 INFO:tasks.workunit.client.0.smithi063.stdout:4/220: symlink de/d18/l4d 0 2024-09-17T01:56:26.389 INFO:tasks.workunit.client.0.smithi063.stdout:8/128: rmdir d1/d7/d1d 39 2024-09-17T01:56:26.391 INFO:tasks.workunit.client.0.smithi063.stdout:4/221: write de/f14 [4852553,48592] 0 2024-09-17T01:56:26.392 INFO:tasks.workunit.client.0.smithi063.stdout:8/129: write d1/f10 [531118,73951] 0 2024-09-17T01:56:26.392 INFO:tasks.workunit.client.0.smithi063.stdout:7/167: getdents d2/d3 0 2024-09-17T01:56:26.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/222: readlink l6 0 2024-09-17T01:56:26.393 INFO:tasks.workunit.client.0.smithi063.stdout:7/168: rename d2/d3/d22 to d2/d3/d22/d37 22 2024-09-17T01:56:26.395 INFO:tasks.workunit.client.0.smithi063.stdout:7/169: getdents d2/d15 0 2024-09-17T01:56:26.397 INFO:tasks.workunit.client.0.smithi063.stdout:9/132: dwrite d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:26.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/307: dwrite d0/d2d/d35/d3f/f68 [0,4194304] 0 2024-09-17T01:56:26.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/308: fdatasync d0/f4 0 2024-09-17T01:56:26.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/223: dread de/d2d/f43 [0,4194304] 0 2024-09-17T01:56:26.399 INFO:tasks.workunit.client.0.smithi063.stdout:9/133: write d9/de/d20/d1b/d25/f2b [2067969,21592] 0 2024-09-17T01:56:26.399 INFO:tasks.workunit.client.0.smithi063.stdout:7/170: rename d2/df/f12 to d2/f38 0 2024-09-17T01:56:26.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/309: rename d0/d32/l4f to d0/d1c/l71 0 2024-09-17T01:56:26.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/171: fsync d2/d3/d27/f32 0 2024-09-17T01:56:26.401 INFO:tasks.workunit.client.0.smithi063.stdout:7/172: mkdir d2/d3/d27/d39 0 2024-09-17T01:56:26.404 INFO:tasks.workunit.client.0.smithi063.stdout:8/130: dwrite d1/f10 [4194304,4194304] 0 2024-09-17T01:56:26.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/134: symlink d9/de/d20/d1e/d2a/l2e 0 2024-09-17T01:56:26.404 INFO:tasks.workunit.client.0.smithi063.stdout:7/173: write d2/fd [3977368,41627] 0 2024-09-17T01:56:26.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/135: write f7 [5230974,39841] 0 2024-09-17T01:56:26.404 INFO:tasks.workunit.client.0.smithi063.stdout:8/131: mkdir d1/d27 0 2024-09-17T01:56:26.405 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:26.409 INFO:tasks.workunit.client.0.smithi063.stdout:3/253: dread df/d12/d1e/f27 [0,4194304] 0 2024-09-17T01:56:26.409 INFO:tasks.workunit.client.0.smithi063.stdout:4/224: dwrite de/f10 [4194304,4194304] 0 2024-09-17T01:56:26.410 INFO:tasks.workunit.client.0.smithi063.stdout:5/228: dread d6/d37/f15 [0,4194304] 0 2024-09-17T01:56:26.412 INFO:tasks.workunit.client.0.smithi063.stdout:3/254: mkdir df/d12/d1e/d5e 0 2024-09-17T01:56:26.412 INFO:tasks.workunit.client.0.smithi063.stdout:4/225: write de/f26 [11380,108947] 0 2024-09-17T01:56:26.413 INFO:tasks.workunit.client.0.smithi063.stdout:5/229: chown d6/d9/l1c 8177284 1 2024-09-17T01:56:26.414 INFO:tasks.workunit.client.0.smithi063.stdout:1/310: dwrite d0/d1c/f4c [0,4194304] 0 2024-09-17T01:56:26.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/136: dwrite d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:26.415 INFO:tasks.workunit.client.0.smithi063.stdout:3/255: read - df/d12/d2d/f3c zero size 2024-09-17T01:56:26.416 INFO:tasks.workunit.client.0.smithi063.stdout:5/230: unlink d6/d37/f27 0 2024-09-17T01:56:26.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/137: creat d9/de/f2f x:0 0 0 2024-09-17T01:56:26.417 INFO:tasks.workunit.client.0.smithi063.stdout:8/132: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:26.419 INFO:tasks.workunit.client.0.smithi063.stdout:3/256: symlink df/d12/d2d/d2f/l5f 0 2024-09-17T01:56:26.419 INFO:tasks.workunit.client.0.smithi063.stdout:9/138: stat d9/de/d20/d1e/c1c 0 2024-09-17T01:56:26.419 INFO:tasks.workunit.client.0.smithi063.stdout:7/174: dwrite d2/f7 [0,4194304] 0 2024-09-17T01:56:26.420 INFO:tasks.workunit.client.0.smithi063.stdout:3/257: fdatasync df/d12/d43/f4d 0 2024-09-17T01:56:26.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/139: chown d9/de/d20/d1e/d2a 9148731 1 2024-09-17T01:56:26.421 INFO:tasks.workunit.client.0.smithi063.stdout:7/175: mkdir d2/d3/d22/d3a 0 2024-09-17T01:56:26.421 INFO:tasks.workunit.client.0.smithi063.stdout:8/133: truncate d1/d7/d1d/f20 953727 0 2024-09-17T01:56:26.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/140: dread - d9/de/d20/f29 zero size 2024-09-17T01:56:26.423 INFO:tasks.workunit.client.0.smithi063.stdout:9/141: chown d9/de/f2f 32716 1 2024-09-17T01:56:26.423 INFO:tasks.workunit.client.0.smithi063.stdout:1/311: dread d0/d32/d50/f54 [0,4194304] 0 2024-09-17T01:56:26.423 INFO:tasks.workunit.client.0.smithi063.stdout:5/231: truncate d6/d37/fe 1377743 0 2024-09-17T01:56:26.423 INFO:tasks.workunit.client.0.smithi063.stdout:8/134: write d1/f18 [482100,70674] 0 2024-09-17T01:56:26.424 INFO:tasks.workunit.client.0.smithi063.stdout:4/226: dwrite de/d17/f23 [0,4194304] 0 2024-09-17T01:56:26.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/312: write d0/d32/f45 [436831,55531] 0 2024-09-17T01:56:26.424 INFO:tasks.workunit.client.0.smithi063.stdout:7/176: getdents d2/df 0 2024-09-17T01:56:26.425 INFO:tasks.workunit.client.0.smithi063.stdout:8/135: write d1/f2 [1922851,111626] 0 2024-09-17T01:56:26.425 INFO:tasks.workunit.client.0.smithi063.stdout:7/177: fsync d2/df/f10 0 2024-09-17T01:56:26.427 INFO:tasks.workunit.client.0.smithi063.stdout:9/142: symlink d9/de/d20/d1b/l30 0 2024-09-17T01:56:26.427 INFO:tasks.workunit.client.0.smithi063.stdout:0/136: sync 2024-09-17T01:56:26.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/242: sync 2024-09-17T01:56:26.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/258: dwrite df/d12/d1e/f21 [0,4194304] 0 2024-09-17T01:56:26.428 INFO:tasks.workunit.client.0.smithi063.stdout:4/227: creat de/d18/f4e x:0 0 0 2024-09-17T01:56:26.428 INFO:tasks.workunit.client.0.smithi063.stdout:0/137: chown d1/d1d/l20 794640 1 2024-09-17T01:56:26.428 INFO:tasks.workunit.client.0.smithi063.stdout:7/178: write d2/d3/d27/f28 [1867940,111206] 0 2024-09-17T01:56:26.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/228: creat de/d17/d1b/f4f x:0 0 0 2024-09-17T01:56:26.430 INFO:tasks.workunit.client.0.smithi063.stdout:6/243: write dc/d14/d19/d20/d32/f33 [911317,97554] 0 2024-09-17T01:56:26.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/259: rename df/d12/d1e/f3e to df/f60 0 2024-09-17T01:56:26.431 INFO:tasks.workunit.client.0.smithi063.stdout:0/138: mkdir d1/d3/db/d14/d2f 0 2024-09-17T01:56:26.432 INFO:tasks.workunit.client.0.smithi063.stdout:5/232: symlink d6/d23/d29/d2b/d31/l43 0 2024-09-17T01:56:26.433 INFO:tasks.workunit.client.0.smithi063.stdout:9/143: truncate d9/de/f19 175819 0 2024-09-17T01:56:26.434 INFO:tasks.workunit.client.0.smithi063.stdout:5/233: creat d6/f44 x:0 0 0 2024-09-17T01:56:26.434 INFO:tasks.workunit.client.0.smithi063.stdout:8/136: dwrite d1/df/f1b [0,4194304] 0 2024-09-17T01:56:26.435 INFO:tasks.workunit.client.0.smithi063.stdout:8/137: readlink d1/d7/l25 0 2024-09-17T01:56:26.436 INFO:tasks.workunit.client.0.smithi063.stdout:6/244: rename dc/d14/d18/f34 to dc/d14/d18/d21/d43/f50 0 2024-09-17T01:56:26.437 INFO:tasks.workunit.client.0.smithi063.stdout:8/138: read d1/df/f1b [3604446,89281] 0 2024-09-17T01:56:26.438 INFO:tasks.workunit.client.0.smithi063.stdout:6/245: chown dc/d14/d19/f3d 30687437 1 2024-09-17T01:56:26.438 INFO:tasks.workunit.client.0.smithi063.stdout:1/313: dwrite d0/f1b [0,4194304] 0 2024-09-17T01:56:26.438 INFO:tasks.workunit.client.0.smithi063.stdout:3/260: dread fd [0,4194304] 0 2024-09-17T01:56:26.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/229: getdents de/d2d/d3c 0 2024-09-17T01:56:26.439 INFO:tasks.workunit.client.0.smithi063.stdout:6/246: read dc/d14/d19/f2d [255558,112001] 0 2024-09-17T01:56:26.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/139: mkdir d1/d7/d28 0 2024-09-17T01:56:26.441 INFO:tasks.workunit.client.0.smithi063.stdout:3/261: chown df/d12/d2d/f36 8 1 2024-09-17T01:56:26.442 INFO:tasks.workunit.client.0.smithi063.stdout:1/314: rmdir d0/d2d/d35/d3f/d4e/d66 39 2024-09-17T01:56:26.443 INFO:tasks.workunit.client.0.smithi063.stdout:3/262: fdatasync df/d12/d3a/f51 0 2024-09-17T01:56:26.443 INFO:tasks.workunit.client.0.smithi063.stdout:0/139: dwrite d1/d3/f8 [0,4194304] 0 2024-09-17T01:56:26.443 INFO:tasks.workunit.client.0.smithi063.stdout:6/247: chown dc/d14/d18/d21/c3e 11995 1 2024-09-17T01:56:26.445 INFO:tasks.workunit.client.0.smithi063.stdout:4/230: write de/d18/f1d [4250519,21277] 0 2024-09-17T01:56:26.446 INFO:tasks.workunit.client.0.smithi063.stdout:3/263: unlink df/d12/d2d/f3d 0 2024-09-17T01:56:26.446 INFO:tasks.workunit.client.0.smithi063.stdout:8/140: link d1/d7/d1d/c22 d1/d7/c29 0 2024-09-17T01:56:26.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/231: chown l6 2542 1 2024-09-17T01:56:26.448 INFO:tasks.workunit.client.0.smithi063.stdout:9/144: dwrite d9/de/ff [0,4194304] 0 2024-09-17T01:56:26.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/141: chown d1/l3 301374069 1 2024-09-17T01:56:26.448 INFO:tasks.workunit.client.0.smithi063.stdout:5/234: dwrite d6/f18 [0,4194304] 0 2024-09-17T01:56:26.449 INFO:tasks.workunit.client.0.smithi063.stdout:0/140: write d1/d1d/f2d [478369,76377] 0 2024-09-17T01:56:26.449 INFO:tasks.workunit.client.0.smithi063.stdout:1/315: link d0/d1c/c46 d0/d2d/d35/d3f/c72 0 2024-09-17T01:56:26.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/232: mknod de/d2d/c50 0 2024-09-17T01:56:26.450 INFO:tasks.workunit.client.0.smithi063.stdout:9/145: read f7 [3485559,78991] 0 2024-09-17T01:56:26.450 INFO:tasks.workunit.client.0.smithi063.stdout:9/146: chown d9/de 7126 1 2024-09-17T01:56:26.450 INFO:tasks.workunit.client.0.smithi063.stdout:4/233: dread - de/d18/f1a zero size 2024-09-17T01:56:26.450 INFO:tasks.workunit.client.0.smithi063.stdout:0/141: write d1/d1d/f2d [249298,52086] 0 2024-09-17T01:56:26.450 INFO:tasks.workunit.client.0.smithi063.stdout:1/316: read d0/d1c/f1d [276535,81210] 0 2024-09-17T01:56:26.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/147: write d9/fc [1109607,40898] 0 2024-09-17T01:56:26.451 INFO:tasks.workunit.client.0.smithi063.stdout:3/264: rename df/d28/c4e to df/d12/d43/c61 0 2024-09-17T01:56:26.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/235: rename d6/d37/f1b to d6/d9/f45 0 2024-09-17T01:56:26.453 INFO:tasks.workunit.client.0.smithi063.stdout:4/234: truncate de/d18/f1a 469725 0 2024-09-17T01:56:26.453 INFO:tasks.workunit.client.0.smithi063.stdout:5/236: creat d6/d23/d3f/f46 x:0 0 0 2024-09-17T01:56:26.455 INFO:tasks.workunit.client.0.smithi063.stdout:4/235: symlink de/d17/d1b/l51 0 2024-09-17T01:56:26.455 INFO:tasks.workunit.client.0.smithi063.stdout:8/142: truncate d1/d7/d1d/f1f 949598 0 2024-09-17T01:56:26.455 INFO:tasks.workunit.client.0.smithi063.stdout:5/237: write d6/d37/d19/f26 [474059,62299] 0 2024-09-17T01:56:26.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/317: read d0/d1c/f28 [39479,2020] 0 2024-09-17T01:56:26.456 INFO:tasks.workunit.client.0.smithi063.stdout:5/238: chown d6/d23/d29/d2b 2002363 1 2024-09-17T01:56:26.458 INFO:tasks.workunit.client.0.smithi063.stdout:8/143: mkdir d1/d7/d28/d2a 0 2024-09-17T01:56:26.458 INFO:tasks.workunit.client.0.smithi063.stdout:5/239: dread - d6/d23/d3f/f46 zero size 2024-09-17T01:56:26.459 INFO:tasks.workunit.client.0.smithi063.stdout:1/318: write d0/f8 [4827301,104830] 0 2024-09-17T01:56:26.459 INFO:tasks.workunit.client.0.smithi063.stdout:0/142: dwrite f0 [0,4194304] 0 2024-09-17T01:56:26.459 INFO:tasks.workunit.client.0.smithi063.stdout:9/148: dwrite d9/de/ff [0,4194304] 0 2024-09-17T01:56:26.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/144: mknod d1/c2b 0 2024-09-17T01:56:26.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/240: rmdir d6/d23/d3f 39 2024-09-17T01:56:26.463 INFO:tasks.workunit.client.0.smithi063.stdout:1/319: rename d0/c18 to d0/d32/d50/c73 0 2024-09-17T01:56:26.463 INFO:tasks.workunit.client.0.smithi063.stdout:8/145: dread - d1/d7/d1d/f1e zero size 2024-09-17T01:56:26.463 INFO:tasks.workunit.client.0.smithi063.stdout:3/265: dread df/f33 [0,4194304] 0 2024-09-17T01:56:26.464 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:26.465+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:26.465 INFO:tasks.workunit.client.0.smithi063.stdout:1/320: truncate d0/d1c/f41 1221376 0 2024-09-17T01:56:26.465 INFO:tasks.workunit.client.0.smithi063.stdout:1/321: dread - d0/d32/d50/f70 zero size 2024-09-17T01:56:26.465 INFO:tasks.workunit.client.0.smithi063.stdout:2/138: sync 2024-09-17T01:56:26.467 INFO:tasks.workunit.client.0.smithi063.stdout:4/236: sync 2024-09-17T01:56:26.467 INFO:tasks.workunit.client.0.smithi063.stdout:8/146: mknod d1/d7/d1d/c2c 0 2024-09-17T01:56:26.467 INFO:tasks.workunit.client.0.smithi063.stdout:1/322: mkdir d0/d32/d50/d6c/d74 0 2024-09-17T01:56:26.467 INFO:tasks.workunit.client.0.smithi063.stdout:8/147: truncate d1/f18 949905 0 2024-09-17T01:56:26.467 INFO:tasks.workunit.client.0.smithi063.stdout:1/323: fdatasync d0/d32/f3e 0 2024-09-17T01:56:26.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/149: dread d9/de/f19 [0,4194304] 0 2024-09-17T01:56:26.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/143: dwrite d1/d3/db/d14/f22 [0,4194304] 0 2024-09-17T01:56:26.473 INFO:tasks.workunit.client.0.smithi063.stdout:4/237: mkdir de/d2d/d52 0 2024-09-17T01:56:26.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/139: dwrite d3/f21 [0,4194304] 0 2024-09-17T01:56:26.474 INFO:tasks.workunit.client.0.smithi063.stdout:8/148: rename d1/d7/f26 to d1/df/f2d 0 2024-09-17T01:56:26.474 INFO:tasks.workunit.client.0.smithi063.stdout:9/150: mknod d9/de/d20/c31 0 2024-09-17T01:56:26.474 INFO:tasks.workunit.client.0.smithi063.stdout:0/144: creat d1/d3/db/d18/f30 x:0 0 0 2024-09-17T01:56:26.474 INFO:tasks.workunit.client.0.smithi063.stdout:1/324: symlink d0/d2d/d35/d3f/d6b/l75 0 2024-09-17T01:56:26.474 INFO:tasks.workunit.client.0.smithi063.stdout:9/151: readlink d9/de/d20/d1b/l30 0 2024-09-17T01:56:26.475 INFO:tasks.workunit.client.0.smithi063.stdout:1/325: chown d0/d2d/l61 70 1 2024-09-17T01:56:26.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/152: mkdir d9/de/d20/d32 0 2024-09-17T01:56:26.475 INFO:tasks.workunit.client.0.smithi063.stdout:1/326: dread - d0/d2d/d35/d3f/d4e/f5f zero size 2024-09-17T01:56:26.475 INFO:tasks.workunit.client.0.smithi063.stdout:8/149: truncate d1/d7/d1d/f1e 858574 0 2024-09-17T01:56:26.476 INFO:tasks.workunit.client.0.smithi063.stdout:0/145: mknod d1/d3/db/d14/d2f/c31 0 2024-09-17T01:56:26.477 INFO:tasks.workunit.client.0.smithi063.stdout:0/146: sync 2024-09-17T01:56:26.477 INFO:tasks.workunit.client.0.smithi063.stdout:9/153: mkdir d9/de/d33 0 2024-09-17T01:56:26.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/140: dread d3/d7/df/f14 [0,4194304] 0 2024-09-17T01:56:26.478 INFO:tasks.workunit.client.0.smithi063.stdout:4/238: dread de/d17/d1b/f1e [0,4194304] 0 2024-09-17T01:56:26.479 INFO:tasks.workunit.client.0.smithi063.stdout:5/241: dread d6/d9/d13/d1d/f24 [0,4194304] 0 2024-09-17T01:56:26.479 INFO:tasks.workunit.client.0.smithi063.stdout:5/242: fdatasync d6/f44 0 2024-09-17T01:56:26.480 INFO:tasks.workunit.client.0.smithi063.stdout:0/147: mkdir d1/d3/d32 0 2024-09-17T01:56:26.480 INFO:tasks.workunit.client.0.smithi063.stdout:4/239: symlink de/d17/d36/l53 0 2024-09-17T01:56:26.481 INFO:tasks.workunit.client.0.smithi063.stdout:5/243: fdatasync d6/d37/f15 0 2024-09-17T01:56:26.481 INFO:tasks.workunit.client.0.smithi063.stdout:9/154: rename d9/de/d20/f29 to d9/de/d20/d1e/f34 0 2024-09-17T01:56:26.482 INFO:tasks.workunit.client.0.smithi063.stdout:5/244: readlink d6/d23/d29/d2b/l42 0 2024-09-17T01:56:26.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/245: mknod d6/d23/d3f/c47 0 2024-09-17T01:56:26.484 INFO:tasks.workunit.client.0.smithi063.stdout:2/141: read d3/f6 [2036760,87456] 0 2024-09-17T01:56:26.484 INFO:tasks.workunit.client.0.smithi063.stdout:9/155: creat d9/de/d20/d1e/d2a/f35 x:0 0 0 2024-09-17T01:56:26.486 INFO:tasks.workunit.client.0.smithi063.stdout:1/327: dread d0/f1b [0,4194304] 0 2024-09-17T01:56:26.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/150: dwrite d1/d7/d1d/f20 [0,4194304] 0 2024-09-17T01:56:26.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/328: chown d0/d2d/d35/d6f 815538173 1 2024-09-17T01:56:26.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/156: mkdir d9/de/d20/d1e/d2a/d36 0 2024-09-17T01:56:26.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/142: rename d3/d7/df/l1f to d3/d7/df/l2e 0 2024-09-17T01:56:26.489 INFO:tasks.workunit.client.0.smithi063.stdout:5/246: truncate d6/d23/f2a 480462 0 2024-09-17T01:56:26.490 INFO:tasks.workunit.client.0.smithi063.stdout:8/151: chown d1/f16 1415137 1 2024-09-17T01:56:26.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/157: mkdir d9/de/d20/d37 0 2024-09-17T01:56:26.490 INFO:tasks.workunit.client.0.smithi063.stdout:0/148: dread d1/fa [0,4194304] 0 2024-09-17T01:56:26.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/240: dwrite de/d17/d1b/f1e [0,4194304] 0 2024-09-17T01:56:26.491 INFO:tasks.workunit.client.0.smithi063.stdout:9/158: chown d9/de/d20/d37 3715 1 2024-09-17T01:56:26.491 INFO:tasks.workunit.client.0.smithi063.stdout:4/241: stat de/d17/d1b/l3a 0 2024-09-17T01:56:26.491 INFO:tasks.workunit.client.0.smithi063.stdout:0/149: fdatasync d1/d3/f4 0 2024-09-17T01:56:26.491 INFO:tasks.workunit.client.0.smithi063.stdout:5/247: write d6/d9/d13/d1d/f2f [1035680,55944] 0 2024-09-17T01:56:26.494 INFO:tasks.workunit.client.0.smithi063.stdout:2/143: creat d3/d7/df/f2f x:0 0 0 2024-09-17T01:56:26.494 INFO:tasks.workunit.client.0.smithi063.stdout:1/329: write d0/d2d/d35/d3f/d4e/d66/f69 [1839030,44910] 0 2024-09-17T01:56:26.497 INFO:tasks.workunit.client.0.smithi063.stdout:9/159: creat d9/de/d33/f38 x:0 0 0 2024-09-17T01:56:26.498 INFO:tasks.workunit.client.0.smithi063.stdout:5/248: rename d6/d9/d32/l38 to d6/d35/l48 0 2024-09-17T01:56:26.498 INFO:tasks.workunit.client.0.smithi063.stdout:8/152: creat d1/f2e x:0 0 0 2024-09-17T01:56:26.498 INFO:tasks.workunit.client.0.smithi063.stdout:2/144: mkdir d3/d7/df/d30 0 2024-09-17T01:56:26.499 INFO:tasks.workunit.client.0.smithi063.stdout:7/179: dread d2/fb [4194304,4194304] 0 2024-09-17T01:56:26.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/150: rename d1/d3/db/d21 to d1/d3/db/d18/d33 0 2024-09-17T01:56:26.500 INFO:tasks.workunit.client.0.smithi063.stdout:8/153: readlink d1/la 0 2024-09-17T01:56:26.500 INFO:tasks.workunit.client.0.smithi063.stdout:2/145: write d3/f8 [1219445,99155] 0 2024-09-17T01:56:26.500 INFO:tasks.workunit.client.0.smithi063.stdout:3/266: dread df/d12/d30/f32 [0,4194304] 0 2024-09-17T01:56:26.500 INFO:tasks.workunit.client.0.smithi063.stdout:5/249: stat d6/d23/d29/d2b/l39 0 2024-09-17T01:56:26.501 INFO:tasks.workunit.client.0.smithi063.stdout:8/154: chown d1/df/f1b 35707151 1 2024-09-17T01:56:26.501 INFO:tasks.workunit.client.0.smithi063.stdout:5/250: mknod d6/d9/c49 0 2024-09-17T01:56:26.501 INFO:tasks.workunit.client.0.smithi063.stdout:7/180: read - d2/d3/d27/f32 zero size 2024-09-17T01:56:26.501 INFO:tasks.workunit.client.0.smithi063.stdout:3/267: read df/d12/d30/f32 [3574453,77419] 0 2024-09-17T01:56:26.501 INFO:tasks.workunit.client.0.smithi063.stdout:2/146: write d3/d7/fa [2331,117531] 0 2024-09-17T01:56:26.501 INFO:tasks.workunit.client.0.smithi063.stdout:9/160: link d9/de/c18 d9/de/d20/d1e/d2a/d36/c39 0 2024-09-17T01:56:26.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/251: write d6/d9/f40 [487765,76653] 0 2024-09-17T01:56:26.502 INFO:tasks.workunit.client.0.smithi063.stdout:8/155: mkdir d1/d7/d28/d2f 0 2024-09-17T01:56:26.502 INFO:tasks.workunit.client.0.smithi063.stdout:7/181: rmdir d2/d15 39 2024-09-17T01:56:26.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/147: write d3/d7/df/f19 [2440602,23993] 0 2024-09-17T01:56:26.503 INFO:tasks.workunit.client.0.smithi063.stdout:9/161: rmdir d9/de/d33 39 2024-09-17T01:56:26.503 INFO:tasks.workunit.client.0.smithi063.stdout:3/268: creat df/d12/d43/f62 x:0 0 0 2024-09-17T01:56:26.503 INFO:tasks.workunit.client.0.smithi063.stdout:1/330: fsync d0/d1c/f41 0 2024-09-17T01:56:26.504 INFO:tasks.workunit.client.0.smithi063.stdout:8/156: write d1/f10 [9055419,14062] 0 2024-09-17T01:56:26.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/182: symlink d2/d15/l3b 0 2024-09-17T01:56:26.505 INFO:tasks.workunit.client.0.smithi063.stdout:7/183: sync 2024-09-17T01:56:26.505 INFO:tasks.workunit.client.0.smithi063.stdout:2/148: chown d3/d7/df/f29 157 1 2024-09-17T01:56:26.505 INFO:tasks.workunit.client.0.smithi063.stdout:3/269: creat df/f63 x:0 0 0 2024-09-17T01:56:26.506 INFO:tasks.workunit.client.0.smithi063.stdout:1/331: write d0/d2d/d35/d3f/f68 [4409019,41815] 0 2024-09-17T01:56:26.506 INFO:tasks.workunit.client.0.smithi063.stdout:5/252: getdents d6/d23/d3f 0 2024-09-17T01:56:26.506 INFO:tasks.workunit.client.0.smithi063.stdout:7/184: chown d2/d3/d27/d33 21 1 2024-09-17T01:56:26.506 INFO:tasks.workunit.client.0.smithi063.stdout:6/248: dread dc/d14/d18/f42 [0,4194304] 0 2024-09-17T01:56:26.507 INFO:tasks.workunit.client.0.smithi063.stdout:2/149: read d3/f21 [3578310,51542] 0 2024-09-17T01:56:26.507 INFO:tasks.workunit.client.0.smithi063.stdout:3/270: creat df/d12/d3a/f64 x:0 0 0 2024-09-17T01:56:26.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/332: chown d0/d2d/d35/l3b 0 1 2024-09-17T01:56:26.508 INFO:tasks.workunit.client.0.smithi063.stdout:8/157: link d1/d7/d1d/f20 d1/d7/d28/d2f/f30 0 2024-09-17T01:56:26.508 INFO:tasks.workunit.client.0.smithi063.stdout:0/151: dwrite d1/d1d/f2d [0,4194304] 0 2024-09-17T01:56:26.509 INFO:tasks.workunit.client.0.smithi063.stdout:4/242: dread de/f4c [0,4194304] 0 2024-09-17T01:56:26.509 INFO:tasks.workunit.client.0.smithi063.stdout:6/249: creat dc/d14/d2f/f51 x:0 0 0 2024-09-17T01:56:26.509 INFO:tasks.workunit.client.0.smithi063.stdout:2/150: truncate d3/d7/df/f18 1061869 0 2024-09-17T01:56:26.510 INFO:tasks.workunit.client.0.smithi063.stdout:4/243: write de/d17/d1b/f4f [177509,31335] 0 2024-09-17T01:56:26.511 INFO:tasks.workunit.client.0.smithi063.stdout:4/244: readlink de/d18/d28/d30/l48 0 2024-09-17T01:56:26.511 INFO:tasks.workunit.client.0.smithi063.stdout:5/253: dread d6/d9/f40 [0,4194304] 0 2024-09-17T01:56:26.511 INFO:tasks.workunit.client.0.smithi063.stdout:9/162: truncate d9/de/d20/d1b/f1f 3719761 0 2024-09-17T01:56:26.511 INFO:tasks.workunit.client.0.smithi063.stdout:4/245: readlink de/d2d/l47 0 2024-09-17T01:56:26.512 INFO:tasks.workunit.client.0.smithi063.stdout:5/254: chown d6/d9/f45 55688080 1 2024-09-17T01:56:26.512 INFO:tasks.workunit.client.0.smithi063.stdout:9/163: fsync d9/de/d20/f24 0 2024-09-17T01:56:26.513 INFO:tasks.workunit.client.0.smithi063.stdout:1/333: symlink d0/d2d/d35/l76 0 2024-09-17T01:56:26.513 INFO:tasks.workunit.client.0.smithi063.stdout:0/152: mknod d1/d3/c34 0 2024-09-17T01:56:26.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/185: creat d2/d3/d27/d39/f3c x:0 0 0 2024-09-17T01:56:26.515 INFO:tasks.workunit.client.0.smithi063.stdout:6/250: write dc/d14/d18/f31 [2561744,116555] 0 2024-09-17T01:56:26.515 INFO:tasks.workunit.client.0.smithi063.stdout:2/151: read f2 [146273,78267] 0 2024-09-17T01:56:26.516 INFO:tasks.workunit.client.0.smithi063.stdout:3/271: rename df/d12/c15 to df/d12/c65 0 2024-09-17T01:56:26.516 INFO:tasks.workunit.client.0.smithi063.stdout:7/186: write d2/f7 [1616616,80048] 0 2024-09-17T01:56:26.517 INFO:tasks.workunit.client.0.smithi063.stdout:1/334: symlink d0/d32/l77 0 2024-09-17T01:56:26.517 INFO:tasks.workunit.client.0.smithi063.stdout:0/153: fsync d1/d3/db/d18/f1a 0 2024-09-17T01:56:26.517 INFO:tasks.workunit.client.0.smithi063.stdout:0/154: sync 2024-09-17T01:56:26.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/155: sync 2024-09-17T01:56:26.518 INFO:tasks.workunit.client.0.smithi063.stdout:2/152: dread - d3/d7/df/f29 zero size 2024-09-17T01:56:26.518 INFO:tasks.workunit.client.0.smithi063.stdout:3/272: symlink df/d28/l66 0 2024-09-17T01:56:26.520 INFO:tasks.workunit.client.0.smithi063.stdout:4/246: dread de/d17/d36/f41 [0,4194304] 0 2024-09-17T01:56:26.520 INFO:tasks.workunit.client.0.smithi063.stdout:7/187: write d2/d3/d27/f32 [854052,94811] 0 2024-09-17T01:56:26.520 INFO:tasks.workunit.client.0.smithi063.stdout:0/156: rename d1/d3/db/cd to d1/c35 0 2024-09-17T01:56:26.520 INFO:tasks.workunit.client.0.smithi063.stdout:1/335: symlink d0/d2d/d35/d3f/d4e/d66/l78 0 2024-09-17T01:56:26.520 INFO:tasks.workunit.client.0.smithi063.stdout:2/153: mknod d3/d7/df/c31 0 2024-09-17T01:56:26.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/247: stat de/d18/d28 0 2024-09-17T01:56:26.522 INFO:tasks.workunit.client.0.smithi063.stdout:0/157: dread - d1/d3/db/d18/f1a zero size 2024-09-17T01:56:26.522 INFO:tasks.workunit.client.0.smithi063.stdout:8/158: dwrite d1/df/f2d [0,4194304] 0 2024-09-17T01:56:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/154: stat d3/d7/df/f19 0 2024-09-17T01:56:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:5/255: dwrite d6/d37/d19/f26 [0,4194304] 0 2024-09-17T01:56:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:8/159: fdatasync d1/d7/f14 0 2024-09-17T01:56:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:4/248: write de/d17/d1b/f4f [379531,77290] 0 2024-09-17T01:56:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:8/160: sync 2024-09-17T01:56:26.524 INFO:tasks.workunit.client.0.smithi063.stdout:4/249: chown de/f2e 786978572 1 2024-09-17T01:56:26.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/250: chown de/c49 13 1 2024-09-17T01:56:26.525 INFO:tasks.workunit.client.0.smithi063.stdout:8/161: write d1/f16 [753302,9344] 0 2024-09-17T01:56:26.528 INFO:tasks.workunit.client.0.smithi063.stdout:6/251: dwrite dc/d14/d19/d20/d32/f33 [0,4194304] 0 2024-09-17T01:56:26.528 INFO:tasks.workunit.client.0.smithi063.stdout:2/155: creat d3/d7/df/f32 x:0 0 0 2024-09-17T01:56:26.528 INFO:tasks.workunit.client.0.smithi063.stdout:5/256: chown d6/l22 544687 1 2024-09-17T01:56:26.529 INFO:tasks.workunit.client.0.smithi063.stdout:1/336: symlink d0/d2d/d35/d6f/l79 0 2024-09-17T01:56:26.529 INFO:tasks.workunit.client.0.smithi063.stdout:4/251: symlink de/d17/l54 0 2024-09-17T01:56:26.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/273: getdents df/d12/d1e/d39 0 2024-09-17T01:56:26.530 INFO:tasks.workunit.client.0.smithi063.stdout:6/252: chown dc/d14/d18/f42 114538 1 2024-09-17T01:56:26.533 INFO:tasks.workunit.client.0.smithi063.stdout:5/257: creat d6/d35/f4a x:0 0 0 2024-09-17T01:56:26.533 INFO:tasks.workunit.client.0.smithi063.stdout:4/252: creat de/d18/f55 x:0 0 0 2024-09-17T01:56:26.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/253: mkdir dc/d14/d19/d20/d32/d52 0 2024-09-17T01:56:26.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/156: symlink d3/d28/l33 0 2024-09-17T01:56:26.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/337: chown d0/d2d/d35/c44 127958 1 2024-09-17T01:56:26.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/158: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:26.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/162: getdents d1/d7 0 2024-09-17T01:56:26.534 INFO:tasks.workunit.client.0.smithi063.stdout:1/338: chown d0/l16 7007595 1 2024-09-17T01:56:26.534 INFO:tasks.workunit.client.0.smithi063.stdout:4/253: symlink de/d2d/d52/l56 0 2024-09-17T01:56:26.534 INFO:tasks.workunit.client.0.smithi063.stdout:3/274: chown df/d12/d2d/d2f/c35 31 1 2024-09-17T01:56:26.535 INFO:tasks.workunit.client.0.smithi063.stdout:5/258: truncate d6/f44 600938 0 2024-09-17T01:56:26.535 INFO:tasks.workunit.client.0.smithi063.stdout:3/275: symlink df/d12/d30/l67 0 2024-09-17T01:56:26.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/259: dread - d6/d23/d29/d2b/d31/f33 zero size 2024-09-17T01:56:26.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/276: stat df/d12/d2d/f52 0 2024-09-17T01:56:26.537 INFO:tasks.workunit.client.0.smithi063.stdout:2/157: dread d3/d7/df/f25 [0,4194304] 0 2024-09-17T01:56:26.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/277: link df/d12/f2e df/d12/d2d/d2f/f68 0 2024-09-17T01:56:26.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/339: truncate d0/d2d/d35/d3f/d4e/f5f 191923 0 2024-09-17T01:56:26.540 INFO:tasks.workunit.client.0.smithi063.stdout:8/163: dread d1/d7/f14 [0,4194304] 0 2024-09-17T01:56:26.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/254: dread de/d17/d1b/f1e [0,4194304] 0 2024-09-17T01:56:26.540 INFO:tasks.workunit.client.0.smithi063.stdout:0/159: dread f0 [0,4194304] 0 2024-09-17T01:56:26.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/340: chown d0/d2d/d35 0 1 2024-09-17T01:56:26.540 INFO:tasks.workunit.client.0.smithi063.stdout:8/164: readlink d1/d7/l19 0 2024-09-17T01:56:26.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/278: creat df/d12/d43/f69 x:0 0 0 2024-09-17T01:56:26.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/255: unlink c2 0 2024-09-17T01:56:26.541 INFO:tasks.workunit.client.0.smithi063.stdout:0/160: creat d1/d3/db/d18/d33/f36 x:0 0 0 2024-09-17T01:56:26.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/279: readlink df/d12/d1e/l37 0 2024-09-17T01:56:26.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/341: creat d0/d2d/f7a x:0 0 0 2024-09-17T01:56:26.543 INFO:tasks.workunit.client.0.smithi063.stdout:0/161: creat d1/d3/db/d14/f37 x:0 0 0 2024-09-17T01:56:26.544 INFO:tasks.workunit.client.0.smithi063.stdout:7/188: dread d2/d3/d27/f32 [0,4194304] 0 2024-09-17T01:56:26.545 INFO:tasks.workunit.client.0.smithi063.stdout:5/260: dwrite d6/d35/f4a [0,4194304] 0 2024-09-17T01:56:26.546 INFO:tasks.workunit.client.0.smithi063.stdout:0/162: truncate d1/d3/db/d18/d33/f2e 305598 0 2024-09-17T01:56:26.547 INFO:tasks.workunit.client.0.smithi063.stdout:5/261: symlink d6/d37/d19/l4b 0 2024-09-17T01:56:26.547 INFO:tasks.workunit.client.0.smithi063.stdout:7/189: truncate d2/df/f10 5128229 0 2024-09-17T01:56:26.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/165: dread f0 [0,4194304] 0 2024-09-17T01:56:26.548 INFO:tasks.workunit.client.0.smithi063.stdout:0/163: chown d1/d3/db/d18/d33 4710454 1 2024-09-17T01:56:26.549 INFO:tasks.workunit.client.0.smithi063.stdout:3/280: dread df/d12/d1e/f27 [0,4194304] 0 2024-09-17T01:56:26.549 INFO:tasks.workunit.client.0.smithi063.stdout:6/254: truncate dc/f38 2065701 0 2024-09-17T01:56:26.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/158: write d3/d7/df/f1a [4555248,16914] 0 2024-09-17T01:56:26.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/256: dwrite de/d18/f1d [0,4194304] 0 2024-09-17T01:56:26.550 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:26.550 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:26.551 INFO:tasks.workunit.client.0.smithi063.stdout:6/255: fdatasync dc/d1b/f41 0 2024-09-17T01:56:26.551 INFO:tasks.workunit.client.0.smithi063.stdout:3/281: chown df/d12/d2d/f4c 0 1 2024-09-17T01:56:26.551 INFO:tasks.workunit.client.0.smithi063.stdout:0/164: rename d1/f2 to d1/d3/d1b/f38 0 2024-09-17T01:56:26.552 INFO:tasks.workunit.client.0.smithi063.stdout:7/190: chown d2/d3/d22/l2e 3590063 1 2024-09-17T01:56:26.552 INFO:tasks.workunit.client.0.smithi063.stdout:2/159: creat d3/d7/f34 x:0 0 0 2024-09-17T01:56:26.553 INFO:tasks.workunit.client.0.smithi063.stdout:3/282: dread - df/d12/d43/f69 zero size 2024-09-17T01:56:26.554 INFO:tasks.workunit.client.0.smithi063.stdout:1/342: dwrite d0/d2d/d35/d3f/d4e/d66/f69 [0,4194304] 0 2024-09-17T01:56:26.555 INFO:tasks.workunit.client.0.smithi063.stdout:2/160: write d3/d7/df/f18 [425210,97814] 0 2024-09-17T01:56:26.556 INFO:tasks.workunit.client.0.smithi063.stdout:5/262: getdents d6 0 2024-09-17T01:56:26.556 INFO:tasks.workunit.client.0.smithi063.stdout:1/343: chown d0/d32 56 1 2024-09-17T01:56:26.556 INFO:tasks.workunit.client.0.smithi063.stdout:0/165: fdatasync d1/d3/db/d14/f1c 0 2024-09-17T01:56:26.557 INFO:tasks.workunit.client.0.smithi063.stdout:8/166: dread d1/df/f2d [0,4194304] 0 2024-09-17T01:56:26.557 INFO:tasks.workunit.client.0.smithi063.stdout:1/344: write d0/d2d/d35/d3f/d4e/d66/f69 [4395854,8251] 0 2024-09-17T01:56:26.558 INFO:tasks.workunit.client.0.smithi063.stdout:7/191: write d2/df/f20 [852853,75293] 0 2024-09-17T01:56:26.559 INFO:tasks.workunit.client.0.smithi063.stdout:1/345: stat d0/d2d/d35 0 2024-09-17T01:56:26.560 INFO:tasks.workunit.client.0.smithi063.stdout:9/164: dwrite d9/de/d20/d1b/f1f [4194304,4194304] 0 2024-09-17T01:56:26.561 INFO:tasks.workunit.client.0.smithi063.stdout:6/256: rename dc/d14/d19/f45 to dc/d14/d19/f53 0 2024-09-17T01:56:26.563 INFO:tasks.workunit.client.0.smithi063.stdout:9/165: fsync d9/de/d20/d1b/f2d 0 2024-09-17T01:56:26.563 INFO:tasks.workunit.client.0.smithi063.stdout:6/257: fsync dc/d14/d18/d21/f48 0 2024-09-17T01:56:26.565 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:26.570+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:26.566 INFO:tasks.workunit.client.0.smithi063.stdout:1/346: creat d0/d2d/d35/d3f/f7b x:0 0 0 2024-09-17T01:56:26.566 INFO:tasks.workunit.client.0.smithi063.stdout:2/161: getdents d3/d7/df 0 2024-09-17T01:56:26.566 INFO:tasks.workunit.client.0.smithi063.stdout:3/283: dwrite fc [0,4194304] 0 2024-09-17T01:56:26.566 INFO:tasks.workunit.client.0.smithi063.stdout:9/166: creat d9/d27/f3a x:0 0 0 2024-09-17T01:56:26.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/166: dwrite d1/d3/db/d14/f26 [0,4194304] 0 2024-09-17T01:56:26.568 INFO:tasks.workunit.client.0.smithi063.stdout:5/263: dwrite d6/d9/d13/d1d/f24 [0,4194304] 0 2024-09-17T01:56:26.568 INFO:tasks.workunit.client.0.smithi063.stdout:2/162: chown d3/d7/df/l2e 56538895 1 2024-09-17T01:56:26.568 INFO:tasks.workunit.client.0.smithi063.stdout:1/347: fsync d0/d32/f42 0 2024-09-17T01:56:26.569 INFO:tasks.workunit.client.0.smithi063.stdout:8/167: dwrite d1/f16 [0,4194304] 0 2024-09-17T01:56:26.569 INFO:tasks.workunit.client.0.smithi063.stdout:6/258: link dc/d14/d18/d21/f48 dc/d14/d19/d20/d32/f54 0 2024-09-17T01:56:26.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/284: creat df/d12/d43/d50/f6a x:0 0 0 2024-09-17T01:56:26.569 INFO:tasks.workunit.client.0.smithi063.stdout:0/167: creat d1/d3/db/f39 x:0 0 0 2024-09-17T01:56:26.572 INFO:tasks.workunit.client.0.smithi063.stdout:1/348: write d0/f2 [3587436,74493] 0 2024-09-17T01:56:26.574 INFO:tasks.workunit.client.0.smithi063.stdout:5/264: unlink d6/d9/d13/d1d/f2f 0 2024-09-17T01:56:26.575 INFO:tasks.workunit.client.0.smithi063.stdout:9/167: dread f7 [0,4194304] 0 2024-09-17T01:56:26.576 INFO:tasks.workunit.client.0.smithi063.stdout:3/285: creat df/d12/d43/d50/d58/f6b x:0 0 0 2024-09-17T01:56:26.576 INFO:tasks.workunit.client.0.smithi063.stdout:1/349: mknod d0/d32/d50/d6c/d74/c7c 0 2024-09-17T01:56:26.576 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:26.577 INFO:tasks.workunit.client.0.smithi063.stdout:3/286: creat df/d12/d1e/d39/f6c x:0 0 0 2024-09-17T01:56:26.577 INFO:tasks.workunit.client.0.smithi063.stdout:5/265: creat d6/d23/d3a/f4c x:0 0 0 2024-09-17T01:56:26.577 INFO:tasks.workunit.client.0.smithi063.stdout:2/163: dwrite d3/f9 [4194304,4194304] 0 2024-09-17T01:56:26.579 INFO:tasks.workunit.client.0.smithi063.stdout:3/287: mknod df/d12/d1e/d39/c6d 0 2024-09-17T01:56:26.579 INFO:tasks.workunit.client.0.smithi063.stdout:1/350: chown d0/d32/d50/d6c 45457 1 2024-09-17T01:56:26.581 INFO:tasks.workunit.client.0.smithi063.stdout:1/351: readlink d0/d32/l64 0 2024-09-17T01:56:26.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/168: dwrite d1/f19 [0,4194304] 0 2024-09-17T01:56:26.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/164: unlink d3/d7/df/f32 0 2024-09-17T01:56:26.582 INFO:tasks.workunit.client.0.smithi063.stdout:0/169: readlink d1/l5 0 2024-09-17T01:56:26.582 INFO:tasks.workunit.client.0.smithi063.stdout:5/266: rename d6/d23/d29/d2b/d31/l43 to d6/d9/d13/d1d/l4d 0 2024-09-17T01:56:26.582 INFO:tasks.workunit.client.0.smithi063.stdout:1/352: mknod d0/d32/d50/c7d 0 2024-09-17T01:56:26.583 INFO:tasks.workunit.client.0.smithi063.stdout:2/165: creat d3/d2c/f35 x:0 0 0 2024-09-17T01:56:26.583 INFO:tasks.workunit.client.0.smithi063.stdout:8/168: read d1/df/f23 [175583,118120] 0 2024-09-17T01:56:26.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/259: dwrite dc/f12 [4194304,4194304] 0 2024-09-17T01:56:26.585 INFO:tasks.workunit.client.0.smithi063.stdout:0/170: fsync d1/d3/db/d14/f37 0 2024-09-17T01:56:26.585 INFO:tasks.workunit.client.0.smithi063.stdout:5/267: chown d6/d23/d3a/f4c 85521 1 2024-09-17T01:56:26.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/288: write df/d12/d2d/f40 [38141,70833] 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:2/166: mknod d3/d7/df/d30/c36 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:1/353: write d0/d1c/f5c [493615,88066] 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/257: dread f8 [0,4194304] 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:3/289: write df/d12/d2d/f4a [1044656,98657] 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:2/167: write d3/d7/f26 [222973,43803] 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:5/268: mknod d6/d23/d29/d2b/c4e 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:1/354: mkdir d0/d2d/d5e/d7e 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/171: rmdir d1/d3/db/d2c 0 2024-09-17T01:56:26.589 INFO:tasks.workunit.client.0.smithi063.stdout:3/290: chown df/d12/f2e 640793937 1 2024-09-17T01:56:26.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/258: link de/d18/f55 de/f57 0 2024-09-17T01:56:26.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/269: mkdir d6/d23/d29/d2b/d4f 0 2024-09-17T01:56:26.592 INFO:tasks.workunit.client.0.smithi063.stdout:2/168: rename d3/l15 to d3/d7/df/d30/l37 0 2024-09-17T01:56:26.592 INFO:tasks.workunit.client.0.smithi063.stdout:3/291: rmdir df/d12/d2d 39 2024-09-17T01:56:26.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/355: link d0/d32/d50/f70 d0/d2d/d35/f7f 0 2024-09-17T01:56:26.594 INFO:tasks.workunit.client.0.smithi063.stdout:9/168: dwrite d9/de/f2f [0,4194304] 0 2024-09-17T01:56:26.594 INFO:tasks.workunit.client.0.smithi063.stdout:5/270: fsync d6/d35/f4a 0 2024-09-17T01:56:26.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/172: truncate d1/d3/d1b/f2a 2311950 0 2024-09-17T01:56:26.595 INFO:tasks.workunit.client.0.smithi063.stdout:0/173: dread - d1/d3/d1b/f29 zero size 2024-09-17T01:56:26.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/356: write d0/d2d/f33 [62887,80766] 0 2024-09-17T01:56:26.596 INFO:tasks.workunit.client.0.smithi063.stdout:9/169: creat d9/d27/f3b x:0 0 0 2024-09-17T01:56:26.596 INFO:tasks.workunit.client.0.smithi063.stdout:4/259: symlink de/d17/d1b/l58 0 2024-09-17T01:56:26.596 INFO:tasks.workunit.client.0.smithi063.stdout:0/174: mknod d1/d3/d32/c3a 0 2024-09-17T01:56:26.597 INFO:tasks.workunit.client.0.smithi063.stdout:1/357: creat d0/d2d/d35/d3f/d6b/f80 x:0 0 0 2024-09-17T01:56:26.598 INFO:tasks.workunit.client.0.smithi063.stdout:4/260: mknod de/d17/d36/c59 0 2024-09-17T01:56:26.601 INFO:tasks.workunit.client.0.smithi063.stdout:1/358: rename d0/d32 to d0/d2d/d35/d3f/d81 0 2024-09-17T01:56:26.602 INFO:tasks.workunit.client.0.smithi063.stdout:2/169: dwrite d3/d7/df/f1e [0,4194304] 0 2024-09-17T01:56:26.603 INFO:tasks.workunit.client.0.smithi063.stdout:1/359: dread - d0/d2d/d35/f7f zero size 2024-09-17T01:56:26.605 INFO:tasks.workunit.client.0.smithi063.stdout:8/169: dwrite d1/f16 [4194304,4194304] 0 2024-09-17T01:56:26.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/360: stat d0/d2d/d35/d3f/d81/d50/l57 0 2024-09-17T01:56:26.607 INFO:tasks.workunit.client.0.smithi063.stdout:9/170: dwrite d9/de/d20/d1e/f34 [0,4194304] 0 2024-09-17T01:56:26.607 INFO:tasks.workunit.client.0.smithi063.stdout:0/175: dwrite d1/d3/db/d18/f30 [0,4194304] 0 2024-09-17T01:56:26.608 INFO:tasks.workunit.client.0.smithi063.stdout:4/261: chown de/d17/d1b/f1c 14384833 1 2024-09-17T01:56:26.608 INFO:tasks.workunit.client.0.smithi063.stdout:9/171: fdatasync d9/de/d20/f24 0 2024-09-17T01:56:26.610 INFO:tasks.workunit.client.0.smithi063.stdout:8/170: mknod d1/c31 0 2024-09-17T01:56:26.611 INFO:tasks.workunit.client.0.smithi063.stdout:8/171: stat d1/d27 0 2024-09-17T01:56:26.611 INFO:tasks.workunit.client.0.smithi063.stdout:4/262: write de/f3b [2397706,28946] 0 2024-09-17T01:56:26.611 INFO:tasks.workunit.client.0.smithi063.stdout:1/361: rename d0/d2d/d35/d3f/d4e/d66/l78 to d0/l82 0 2024-09-17T01:56:26.612 INFO:tasks.workunit.client.0.smithi063.stdout:4/263: chown de/d18/d28/d30/l48 6459558 1 2024-09-17T01:56:26.614 INFO:tasks.workunit.client.0.smithi063.stdout:8/172: rename d1/d7/f1a to d1/d7/f32 0 2024-09-17T01:56:26.615 INFO:tasks.workunit.client.0.smithi063.stdout:9/172: mknod d9/de/d20/d1e/d2a/c3c 0 2024-09-17T01:56:26.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/170: dwrite d3/d7/df/f1e [0,4194304] 0 2024-09-17T01:56:26.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/173: fdatasync d1/d7/d1d/f1f 0 2024-09-17T01:56:26.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/171: fdatasync d3/f9 0 2024-09-17T01:56:26.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/174: readlink d1/d7/l25 0 2024-09-17T01:56:26.618 INFO:tasks.workunit.client.0.smithi063.stdout:2/172: truncate d3/d7/df/f29 394573 0 2024-09-17T01:56:26.618 INFO:tasks.workunit.client.0.smithi063.stdout:8/175: fdatasync d1/d7/d1d/f1f 0 2024-09-17T01:56:26.620 INFO:tasks.workunit.client.0.smithi063.stdout:2/173: truncate d3/f8 1666125 0 2024-09-17T01:56:26.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/176: creat d1/df/f33 x:0 0 0 2024-09-17T01:56:26.622 INFO:tasks.workunit.client.0.smithi063.stdout:0/176: dwrite d1/d3/f4 [0,4194304] 0 2024-09-17T01:56:26.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/264: dwrite de/f4c [0,4194304] 0 2024-09-17T01:56:26.623 INFO:tasks.workunit.client.0.smithi063.stdout:8/177: write d1/d7/d1d/f1f [1238807,110299] 0 2024-09-17T01:56:26.626 INFO:tasks.workunit.client.0.smithi063.stdout:0/177: creat d1/d1d/f3b x:0 0 0 2024-09-17T01:56:26.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/260: dread dc/d1b/f29 [0,4194304] 0 2024-09-17T01:56:26.626 INFO:tasks.workunit.client.0.smithi063.stdout:1/362: dwrite d0/f4 [0,4194304] 0 2024-09-17T01:56:26.627 INFO:tasks.workunit.client.0.smithi063.stdout:9/173: dwrite d9/de/d20/d1e/d2a/f35 [0,4194304] 0 2024-09-17T01:56:26.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/178: rename d1/d3/lf to d1/d3/l3c 0 2024-09-17T01:56:26.629 INFO:tasks.workunit.client.0.smithi063.stdout:6/261: mknod dc/d14/d19/d20/d32/c55 0 2024-09-17T01:56:26.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/265: getdents de/d2d 0 2024-09-17T01:56:26.629 INFO:tasks.workunit.client.0.smithi063.stdout:9/174: mknod d9/d27/c3d 0 2024-09-17T01:56:26.629 INFO:tasks.workunit.client.0.smithi063.stdout:2/174: dwrite d3/d7/df/f1e [0,4194304] 0 2024-09-17T01:56:26.630 INFO:tasks.workunit.client.0.smithi063.stdout:1/363: write d0/d2d/d35/d3f/d81/d50/f54 [971819,70941] 0 2024-09-17T01:56:26.630 INFO:tasks.workunit.client.0.smithi063.stdout:0/179: creat d1/f3d x:0 0 0 2024-09-17T01:56:26.631 INFO:tasks.workunit.client.0.smithi063.stdout:6/262: symlink dc/d14/d2f/l56 0 2024-09-17T01:56:26.631 INFO:tasks.workunit.client.0.smithi063.stdout:9/175: rmdir d9/de/d20/d1e/d2a/d36 39 2024-09-17T01:56:26.631 INFO:tasks.workunit.client.0.smithi063.stdout:0/180: rename d1/d3/db/d18/f1a to d1/d3/db/f3e 0 2024-09-17T01:56:26.632 INFO:tasks.workunit.client.0.smithi063.stdout:6/263: write dc/d1b/f4b [820258,99841] 0 2024-09-17T01:56:26.632 INFO:tasks.workunit.client.0.smithi063.stdout:0/181: readlink d1/d1d/l20 0 2024-09-17T01:56:26.633 INFO:tasks.workunit.client.0.smithi063.stdout:8/178: read d1/d7/f32 [509272,13022] 0 2024-09-17T01:56:26.634 INFO:tasks.workunit.client.0.smithi063.stdout:9/176: symlink d9/de/d20/d1b/d25/l3e 0 2024-09-17T01:56:26.634 INFO:tasks.workunit.client.0.smithi063.stdout:5/271: dread d6/d23/f2a [0,4194304] 0 2024-09-17T01:56:26.635 INFO:tasks.workunit.client.0.smithi063.stdout:0/182: mknod d1/d3/db/d14/d2f/c3f 0 2024-09-17T01:56:26.635 INFO:tasks.workunit.client.0.smithi063.stdout:8/179: readlink d1/l1c 0 2024-09-17T01:56:26.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/266: write de/d18/f55 [565044,13915] 0 2024-09-17T01:56:26.635 INFO:tasks.workunit.client.0.smithi063.stdout:6/264: truncate dc/f4e 390976 0 2024-09-17T01:56:26.635 INFO:tasks.workunit.client.0.smithi063.stdout:1/364: dread d0/d2d/d35/d3f/f68 [4194304,4194304] 0 2024-09-17T01:56:26.636 INFO:tasks.workunit.client.0.smithi063.stdout:4/267: sync 2024-09-17T01:56:26.636 INFO:tasks.workunit.client.0.smithi063.stdout:9/177: chown l3 270609753 1 2024-09-17T01:56:26.636 INFO:tasks.workunit.client.0.smithi063.stdout:7/192: dread d2/f1c [0,4194304] 0 2024-09-17T01:56:26.637 INFO:tasks.workunit.client.0.smithi063.stdout:5/272: mkdir d6/d37/d19/d50 0 2024-09-17T01:56:26.637 INFO:tasks.workunit.client.0.smithi063.stdout:8/180: chown d1/f18 121125 1 2024-09-17T01:56:26.637 INFO:tasks.workunit.client.0.smithi063.stdout:3/292: dread df/d12/d1e/f24 [0,4194304] 0 2024-09-17T01:56:26.637 INFO:tasks.workunit.client.0.smithi063.stdout:6/265: write dc/d14/d19/f1a [548386,55336] 0 2024-09-17T01:56:26.637 INFO:tasks.workunit.client.0.smithi063.stdout:1/365: readlink d0/d2d/l61 0 2024-09-17T01:56:26.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/273: read d6/d37/f15 [1169586,73315] 0 2024-09-17T01:56:26.638 INFO:tasks.workunit.client.0.smithi063.stdout:0/183: mknod d1/d3/d1b/c40 0 2024-09-17T01:56:26.639 INFO:tasks.workunit.client.0.smithi063.stdout:3/293: chown df/d12/d2d/f3c 47883 1 2024-09-17T01:56:26.639 INFO:tasks.workunit.client.0.smithi063.stdout:7/193: creat d2/d15/d2f/f3d x:0 0 0 2024-09-17T01:56:26.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/175: dwrite f2 [0,4194304] 0 2024-09-17T01:56:26.640 INFO:tasks.workunit.client.0.smithi063.stdout:9/178: creat d9/de/d20/d1e/d2a/f3f x:0 0 0 2024-09-17T01:56:26.641 INFO:tasks.workunit.client.0.smithi063.stdout:8/181: write d1/d7/f13 [2235513,80246] 0 2024-09-17T01:56:26.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/176: dread d3/d7/df/f25 [0,4194304] 0 2024-09-17T01:56:26.643 INFO:tasks.workunit.client.0.smithi063.stdout:6/266: write dc/d14/d19/d20/d32/f54 [389963,83476] 0 2024-09-17T01:56:26.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/366: write d0/d2d/d35/f7f [578560,114059] 0 2024-09-17T01:56:26.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/294: fdatasync df/d28/f2a 0 2024-09-17T01:56:26.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/179: read d9/de/f19 [59742,3603] 0 2024-09-17T01:56:26.646 INFO:tasks.workunit.client.0.smithi063.stdout:0/184: creat d1/d1f/f41 x:0 0 0 2024-09-17T01:56:26.646 INFO:tasks.workunit.client.0.smithi063.stdout:0/185: fdatasync d1/d3/db/f13 0 2024-09-17T01:56:26.647 INFO:tasks.workunit.client.0.smithi063.stdout:2/177: mkdir d3/d7/d38 0 2024-09-17T01:56:26.647 INFO:tasks.workunit.client.0.smithi063.stdout:6/267: mknod dc/d14/d19/d20/c57 0 2024-09-17T01:56:26.647 INFO:tasks.workunit.client.0.smithi063.stdout:4/268: dwrite de/d2d/d3c/f4b [0,4194304] 0 2024-09-17T01:56:26.650 INFO:tasks.workunit.client.0.smithi063.stdout:9/180: mkdir d9/de/d20/d1e/d2a/d40 0 2024-09-17T01:56:26.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/178: symlink d3/d7/l39 0 2024-09-17T01:56:26.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/274: truncate d6/d37/d19/f2c 2875023 0 2024-09-17T01:56:26.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/295: dread df/d12/d1e/f27 [0,4194304] 0 2024-09-17T01:56:26.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/194: dwrite d2/f1c [0,4194304] 0 2024-09-17T01:56:26.654 INFO:tasks.workunit.client.0.smithi063.stdout:2/179: chown d3/d7/df/f25 2 1 2024-09-17T01:56:26.656 INFO:tasks.workunit.client.0.smithi063.stdout:7/195: chown d2/d3/d22/d3a 0 1 2024-09-17T01:56:26.656 INFO:tasks.workunit.client.0.smithi063.stdout:9/181: truncate d9/d27/f3b 235730 0 2024-09-17T01:56:26.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/367: dwrite d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:26.658 INFO:tasks.workunit.client.0.smithi063.stdout:5/275: mknod d6/d9/d13/d1d/c51 0 2024-09-17T01:56:26.658 INFO:tasks.workunit.client.0.smithi063.stdout:8/182: dwrite d1/d7/d1d/f1f [0,4194304] 0 2024-09-17T01:56:26.659 INFO:tasks.workunit.client.0.smithi063.stdout:2/180: read d3/f6 [4664021,76586] 0 2024-09-17T01:56:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:9/182: mknod d9/de/d20/d1b/d25/c41 0 2024-09-17T01:56:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:4/269: dread de/d2d/d3c/f4b [0,4194304] 0 2024-09-17T01:56:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:1/368: stat d0/d2d/d5e/d7e 0 2024-09-17T01:56:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/268: dread dc/d14/d19/f2d [0,4194304] 0 2024-09-17T01:56:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/296: creat df/d12/d1e/f6e x:0 0 0 2024-09-17T01:56:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/186: dwrite d1/d3/f4 [0,4194304] 0 2024-09-17T01:56:26.661 INFO:tasks.workunit.client.0.smithi063.stdout:7/196: rename d2/d15/d2a to d2/d15/d2f/d3e 0 2024-09-17T01:56:26.661 INFO:tasks.workunit.client.0.smithi063.stdout:2/181: dread - d3/d7/f34 zero size 2024-09-17T01:56:26.661 INFO:tasks.workunit.client.0.smithi063.stdout:4/270: truncate de/f3b 4482488 0 2024-09-17T01:56:26.661 INFO:tasks.workunit.client.0.smithi063.stdout:3/297: truncate df/d12/d30/f47 502952 0 2024-09-17T01:56:26.663 INFO:tasks.workunit.client.0.smithi063.stdout:3/298: write df/d28/f48 [83552,92788] 0 2024-09-17T01:56:26.664 INFO:tasks.workunit.client.0.smithi063.stdout:5/276: creat d6/d23/d29/d2b/d4f/f52 x:0 0 0 2024-09-17T01:56:26.664 INFO:tasks.workunit.client.0.smithi063.stdout:4/271: mknod de/d2d/c5a 0 2024-09-17T01:56:26.664 INFO:tasks.workunit.client.0.smithi063.stdout:7/197: mknod d2/d3/d22/c3f 0 2024-09-17T01:56:26.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/187: creat d1/d3/db/f42 x:0 0 0 2024-09-17T01:56:26.666 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:26.669+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:26.667 INFO:tasks.workunit.client.0.smithi063.stdout:8/183: rename d1/d7/l19 to d1/d7/d1d/l34 0 2024-09-17T01:56:26.667 INFO:tasks.workunit.client.0.smithi063.stdout:4/272: fsync de/d18/f55 0 2024-09-17T01:56:26.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/369: truncate d0/f14 1395405 0 2024-09-17T01:56:26.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/269: mknod dc/d14/d19/d20/d32/d52/c58 0 2024-09-17T01:56:26.667 INFO:tasks.workunit.client.0.smithi063.stdout:7/198: mkdir d2/d3/d27/d39/d40 0 2024-09-17T01:56:26.668 INFO:tasks.workunit.client.0.smithi063.stdout:1/370: stat d0/d2d/d35 0 2024-09-17T01:56:26.668 INFO:tasks.workunit.client.0.smithi063.stdout:0/188: mkdir d1/d3/db/d18/d43 0 2024-09-17T01:56:26.668 INFO:tasks.workunit.client.0.smithi063.stdout:8/184: mknod d1/df/c35 0 2024-09-17T01:56:26.669 INFO:tasks.workunit.client.0.smithi063.stdout:0/189: stat d1/d3 0 2024-09-17T01:56:26.669 INFO:tasks.workunit.client.0.smithi063.stdout:5/277: symlink d6/d23/d29/d2b/d31/l53 0 2024-09-17T01:56:26.670 INFO:tasks.workunit.client.0.smithi063.stdout:0/190: truncate d1/fa 1555426 0 2024-09-17T01:56:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:3/299: getdents df/d12 0 2024-09-17T01:56:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:7/199: rename d2/df/f20 to d2/d3/d27/f41 0 2024-09-17T01:56:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:5/278: readlink d6/d9/d13/l41 0 2024-09-17T01:56:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:9/183: dwrite d9/de/d20/d1e/d2a/f3f [0,4194304] 0 2024-09-17T01:56:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:8/185: mknod d1/d27/c36 0 2024-09-17T01:56:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:6/270: creat dc/d14/d19/f59 x:0 0 0 2024-09-17T01:56:26.672 INFO:tasks.workunit.client.0.smithi063.stdout:6/271: truncate dc/f44 162952 0 2024-09-17T01:56:26.674 INFO:tasks.workunit.client.0.smithi063.stdout:7/200: rename d2/f1c to d2/d3/d27/d39/f42 0 2024-09-17T01:56:26.674 INFO:tasks.workunit.client.0.smithi063.stdout:6/272: fdatasync dc/d14/d18/f16 0 2024-09-17T01:56:26.674 INFO:tasks.workunit.client.0.smithi063.stdout:3/300: dread - df/d12/d1e/f55 zero size 2024-09-17T01:56:26.674 INFO:tasks.workunit.client.0.smithi063.stdout:0/191: mkdir d1/d44 0 2024-09-17T01:56:26.674 INFO:tasks.workunit.client.0.smithi063.stdout:5/279: mkdir d6/d23/d54 0 2024-09-17T01:56:26.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/184: mkdir d9/de/d20/d37/d42 0 2024-09-17T01:56:26.675 INFO:tasks.workunit.client.0.smithi063.stdout:8/186: chown d1/d7/lb 219038222 1 2024-09-17T01:56:26.675 INFO:tasks.workunit.client.0.smithi063.stdout:0/192: chown d1/d3/c34 414 1 2024-09-17T01:56:26.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/201: symlink d2/d3/d27/l43 0 2024-09-17T01:56:26.676 INFO:tasks.workunit.client.0.smithi063.stdout:5/280: write d6/d35/f4a [878686,70234] 0 2024-09-17T01:56:26.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/187: read d1/f18 [115928,118403] 0 2024-09-17T01:56:26.676 INFO:tasks.workunit.client.0.smithi063.stdout:2/182: dread d3/d7/df/f18 [0,4194304] 0 2024-09-17T01:56:26.677 INFO:tasks.workunit.client.0.smithi063.stdout:9/185: read d9/de/d20/d1e/f34 [851895,30684] 0 2024-09-17T01:56:26.678 INFO:tasks.workunit.client.0.smithi063.stdout:4/273: dwrite de/f4c [0,4194304] 0 2024-09-17T01:56:26.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/188: write d1/d7/d1d/f1f [2098534,90819] 0 2024-09-17T01:56:26.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/273: rename dc/d14/d18/d21 to dc/d14/d19/d20/d32/d52/d5a 0 2024-09-17T01:56:26.679 INFO:tasks.workunit.client.0.smithi063.stdout:2/183: write d3/f21 [237714,104667] 0 2024-09-17T01:56:26.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/281: creat d6/d9/d13/d1d/f55 x:0 0 0 2024-09-17T01:56:26.679 INFO:tasks.workunit.client.0.smithi063.stdout:1/371: truncate d0/d2d/d35/d3f/d4e/f6a 3825418 0 2024-09-17T01:56:26.680 INFO:tasks.workunit.client.0.smithi063.stdout:8/189: chown d1/d7/d1d 375320136 1 2024-09-17T01:56:26.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/202: rename d2/d15/d2f/d3e/c31 to d2/d3/d27/c44 0 2024-09-17T01:56:26.680 INFO:tasks.workunit.client.0.smithi063.stdout:6/274: readlink l2 0 2024-09-17T01:56:26.680 INFO:tasks.workunit.client.0.smithi063.stdout:4/274: unlink de/d18/d28/d30/l39 0 2024-09-17T01:56:26.681 INFO:tasks.workunit.client.0.smithi063.stdout:5/282: creat d6/d9/d13/d1d/f56 x:0 0 0 2024-09-17T01:56:26.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/203: chown d2/f4 7606 1 2024-09-17T01:56:26.681 INFO:tasks.workunit.client.0.smithi063.stdout:5/283: dread - d6/d23/d29/d2b/d31/f33 zero size 2024-09-17T01:56:26.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/184: creat d3/d7/df/d30/f3a x:0 0 0 2024-09-17T01:56:26.683 INFO:tasks.workunit.client.0.smithi063.stdout:9/186: getdents d9/d27 0 2024-09-17T01:56:26.684 INFO:tasks.workunit.client.0.smithi063.stdout:5/284: dread d6/d37/f15 [0,4194304] 0 2024-09-17T01:56:26.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/301: truncate df/d12/d1e/f24 120740 0 2024-09-17T01:56:26.684 INFO:tasks.workunit.client.0.smithi063.stdout:7/204: mkdir d2/d15/d2f/d45 0 2024-09-17T01:56:26.685 INFO:tasks.workunit.client.0.smithi063.stdout:4/275: link de/d18/f37 de/d17/d36/f5b 0 2024-09-17T01:56:26.685 INFO:tasks.workunit.client.0.smithi063.stdout:7/205: sync 2024-09-17T01:56:26.685 INFO:tasks.workunit.client.0.smithi063.stdout:8/190: mkdir d1/d7/d28/d2a/d37 0 2024-09-17T01:56:26.686 INFO:tasks.workunit.client.0.smithi063.stdout:5/285: write d6/f12 [3694832,5867] 0 2024-09-17T01:56:26.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/372: creat d0/d2d/d35/d3f/d4e/f83 x:0 0 0 2024-09-17T01:56:26.686 INFO:tasks.workunit.client.0.smithi063.stdout:4/276: mknod de/d2d/c5c 0 2024-09-17T01:56:26.687 INFO:tasks.workunit.client.0.smithi063.stdout:3/302: chown df/d12/d43/d50/l5a 30 1 2024-09-17T01:56:26.687 INFO:tasks.workunit.client.0.smithi063.stdout:3/303: sync 2024-09-17T01:56:26.687 INFO:tasks.workunit.client.0.smithi063.stdout:9/187: mknod d9/de/d20/d37/d42/c43 0 2024-09-17T01:56:26.689 INFO:tasks.workunit.client.0.smithi063.stdout:7/206: dread d2/d3/d27/f32 [0,4194304] 0 2024-09-17T01:56:26.689 INFO:tasks.workunit.client.0.smithi063.stdout:6/275: dwrite dc/f13 [0,4194304] 0 2024-09-17T01:56:26.689 INFO:tasks.workunit.client.0.smithi063.stdout:2/185: truncate d3/f21 1102636 0 2024-09-17T01:56:26.689 INFO:tasks.workunit.client.0.smithi063.stdout:2/186: fdatasync d3/d7/fa 0 2024-09-17T01:56:26.692 INFO:tasks.workunit.client.0.smithi063.stdout:6/276: rename dc/d14/d19/d20/d32/f33 to dc/d14/d2f/f5b 0 2024-09-17T01:56:26.693 INFO:tasks.workunit.client.0.smithi063.stdout:6/277: fdatasync dc/d1b/f41 0 2024-09-17T01:56:26.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/286: link d6/d9/f40 d6/d35/f57 0 2024-09-17T01:56:26.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/191: link d1/f16 d1/f38 0 2024-09-17T01:56:26.695 INFO:tasks.workunit.client.0.smithi063.stdout:4/277: fdatasync de/f4c 0 2024-09-17T01:56:26.695 INFO:tasks.workunit.client.0.smithi063.stdout:1/373: dwrite d0/d2d/d35/f7f [0,4194304] 0 2024-09-17T01:56:26.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/193: dread d1/d3/f8 [4194304,4194304] 0 2024-09-17T01:56:26.696 INFO:tasks.workunit.client.0.smithi063.stdout:4/278: sync 2024-09-17T01:56:26.697 INFO:tasks.workunit.client.0.smithi063.stdout:5/287: write d6/f44 [1086571,7689] 0 2024-09-17T01:56:26.699 INFO:tasks.workunit.client.0.smithi063.stdout:6/278: rename f7 to dc/d14/d19/d20/d32/d52/f5c 0 2024-09-17T01:56:26.699 INFO:tasks.workunit.client.0.smithi063.stdout:0/194: rmdir d1/d1d 39 2024-09-17T01:56:26.699 INFO:tasks.workunit.client.0.smithi063.stdout:9/188: dwrite d9/de/d20/d1e/d2a/f3f [0,4194304] 0 2024-09-17T01:56:26.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/207: dwrite d2/df/f11 [0,4194304] 0 2024-09-17T01:56:26.702 INFO:tasks.workunit.client.0.smithi063.stdout:6/279: write dc/d14/d19/f1c [1385311,101466] 0 2024-09-17T01:56:26.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/280: sync 2024-09-17T01:56:26.706 INFO:tasks.workunit.client.0.smithi063.stdout:9/189: creat d9/de/d20/d37/f44 x:0 0 0 2024-09-17T01:56:26.706 INFO:tasks.workunit.client.0.smithi063.stdout:6/281: chown f3 2803 1 2024-09-17T01:56:26.706 INFO:tasks.workunit.client.0.smithi063.stdout:5/288: creat d6/d23/f58 x:0 0 0 2024-09-17T01:56:26.707 INFO:tasks.workunit.client.0.smithi063.stdout:1/374: creat d0/d2d/d35/d3f/d4e/f84 x:0 0 0 2024-09-17T01:56:26.708 INFO:tasks.workunit.client.0.smithi063.stdout:7/208: link d2/d3/d27/d39/f42 d2/d3/d27/d39/f46 0 2024-09-17T01:56:26.708 INFO:tasks.workunit.client.0.smithi063.stdout:8/192: write d1/d7/d28/d2f/f30 [4391713,110391] 0 2024-09-17T01:56:26.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/195: dread d1/f7 [4194304,4194304] 0 2024-09-17T01:56:26.709 INFO:tasks.workunit.client.0.smithi063.stdout:6/282: stat dc/d14/d19/d20/d32/d52/c58 0 2024-09-17T01:56:26.709 INFO:tasks.workunit.client.0.smithi063.stdout:5/289: write d6/d23/f58 [328997,130489] 0 2024-09-17T01:56:26.709 INFO:tasks.workunit.client.0.smithi063.stdout:4/279: dwrite de/f3b [0,4194304] 0 2024-09-17T01:56:26.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/304: dwrite df/d12/f16 [0,4194304] 0 2024-09-17T01:56:26.710 INFO:tasks.workunit.client.0.smithi063.stdout:2/187: dread d3/f6 [4194304,4194304] 0 2024-09-17T01:56:26.711 INFO:tasks.workunit.client.0.smithi063.stdout:3/305: chown df/d12/d1e/d39/f6c 704992739 1 2024-09-17T01:56:26.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/190: dread d9/de/f2f [0,4194304] 0 2024-09-17T01:56:26.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/191: dread - d9/de/d20/f24 zero size 2024-09-17T01:56:26.713 INFO:tasks.workunit.client.0.smithi063.stdout:7/209: mkdir d2/d15/d2f/d47 0 2024-09-17T01:56:26.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/375: mknod d0/d2d/d35/d3f/d81/d50/d6c/c85 0 2024-09-17T01:56:26.713 INFO:tasks.workunit.client.0.smithi063.stdout:5/290: symlink d6/d9/d32/l59 0 2024-09-17T01:56:26.714 INFO:tasks.workunit.client.0.smithi063.stdout:0/196: unlink d1/fa 0 2024-09-17T01:56:26.714 INFO:tasks.workunit.client.0.smithi063.stdout:7/210: readlink d2/d15/l1f 0 2024-09-17T01:56:26.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/188: creat d3/d2a/d2b/f3b x:0 0 0 2024-09-17T01:56:26.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/306: symlink df/d12/d1e/d5e/l6f 0 2024-09-17T01:56:26.717 INFO:tasks.workunit.client.0.smithi063.stdout:2/189: truncate d3/d7/f1c 272347 0 2024-09-17T01:56:26.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/280: getdents de/d17/d1b 0 2024-09-17T01:56:26.718 INFO:tasks.workunit.client.0.smithi063.stdout:1/376: mkdir d0/d2d/d35/d3f/d86 0 2024-09-17T01:56:26.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/211: mkdir d2/d15/d2f/d45/d48 0 2024-09-17T01:56:26.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/197: creat d1/d3/db/d14/f45 x:0 0 0 2024-09-17T01:56:26.719 INFO:tasks.workunit.client.0.smithi063.stdout:3/307: rmdir df/d12/d1e 39 2024-09-17T01:56:26.719 INFO:tasks.workunit.client.0.smithi063.stdout:7/212: write d2/d3/d27/f2d [438196,40473] 0 2024-09-17T01:56:26.720 INFO:tasks.workunit.client.0.smithi063.stdout:2/190: read d3/f21 [994106,130956] 0 2024-09-17T01:56:26.720 INFO:tasks.workunit.client.0.smithi063.stdout:1/377: mknod d0/d2d/d35/d3f/c87 0 2024-09-17T01:56:26.721 INFO:tasks.workunit.client.0.smithi063.stdout:2/191: readlink d3/l1d 0 2024-09-17T01:56:26.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/192: truncate d9/de/d20/d1b/f1f 6707619 0 2024-09-17T01:56:26.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/308: write df/d28/f2a [266340,77430] 0 2024-09-17T01:56:26.723 INFO:tasks.workunit.client.0.smithi063.stdout:5/291: dwrite d6/f18 [0,4194304] 0 2024-09-17T01:56:26.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/283: dwrite dc/d1b/f29 [4194304,4194304] 0 2024-09-17T01:56:26.727 INFO:tasks.workunit.client.0.smithi063.stdout:6/284: write dc/d14/d18/f42 [6288913,24261] 0 2024-09-17T01:56:26.728 INFO:tasks.workunit.client.0.smithi063.stdout:2/192: creat d3/d2a/f3c x:0 0 0 2024-09-17T01:56:26.728 INFO:tasks.workunit.client.0.smithi063.stdout:9/193: unlink d9/de/d20/d37/f44 0 2024-09-17T01:56:26.729 INFO:tasks.workunit.client.0.smithi063.stdout:2/193: stat d3/d7/f1c 0 2024-09-17T01:56:26.730 INFO:tasks.workunit.client.0.smithi063.stdout:5/292: chown d6/d9/f28 2568 1 2024-09-17T01:56:26.731 INFO:tasks.workunit.client.0.smithi063.stdout:6/285: mknod dc/d14/d19/d20/c5d 0 2024-09-17T01:56:26.731 INFO:tasks.workunit.client.0.smithi063.stdout:4/281: dwrite de/d17/d1b/f1e [0,4194304] 0 2024-09-17T01:56:26.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/213: dwrite d2/f38 [0,4194304] 0 2024-09-17T01:56:26.732 INFO:tasks.workunit.client.0.smithi063.stdout:6/286: mkdir dc/d1b/d5e 0 2024-09-17T01:56:26.732 INFO:tasks.workunit.client.0.smithi063.stdout:4/282: write de/f26 [174304,31786] 0 2024-09-17T01:56:26.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/198: dwrite d1/d3/f4 [4194304,4194304] 0 2024-09-17T01:56:26.733 INFO:tasks.workunit.client.0.smithi063.stdout:2/194: fdatasync d3/f10 0 2024-09-17T01:56:26.733 INFO:tasks.workunit.client.0.smithi063.stdout:7/214: symlink d2/d3/d27/l49 0 2024-09-17T01:56:26.734 INFO:tasks.workunit.client.0.smithi063.stdout:5/293: getdents d6/d9 0 2024-09-17T01:56:26.734 INFO:tasks.workunit.client.0.smithi063.stdout:6/287: read dc/d14/d2f/f5b [2009794,14298] 0 2024-09-17T01:56:26.735 INFO:tasks.workunit.client.0.smithi063.stdout:4/283: creat de/d2d/d52/f5d x:0 0 0 2024-09-17T01:56:26.736 INFO:tasks.workunit.client.0.smithi063.stdout:2/195: write d3/d7/df/d30/f3a [980548,8546] 0 2024-09-17T01:56:26.736 INFO:tasks.workunit.client.0.smithi063.stdout:1/378: dwrite d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:26.739 INFO:tasks.workunit.client.0.smithi063.stdout:4/284: symlink de/d18/d28/d30/l5e 0 2024-09-17T01:56:26.739 INFO:tasks.workunit.client.0.smithi063.stdout:6/288: rmdir dc/d1b 39 2024-09-17T01:56:26.739 INFO:tasks.workunit.client.0.smithi063.stdout:0/199: readlink d1/d1d/l20 0 2024-09-17T01:56:26.739 INFO:tasks.workunit.client.0.smithi063.stdout:5/294: unlink d6/l8 0 2024-09-17T01:56:26.739 INFO:tasks.workunit.client.0.smithi063.stdout:1/379: stat d0/d2d/d35/d3f 0 2024-09-17T01:56:26.740 INFO:tasks.workunit.client.0.smithi063.stdout:5/295: dread - d6/d23/d3a/f4c zero size 2024-09-17T01:56:26.741 INFO:tasks.workunit.client.0.smithi063.stdout:0/200: truncate d1/d3/db/d18/d33/f2e 1215296 0 2024-09-17T01:56:26.741 INFO:tasks.workunit.client.0.smithi063.stdout:3/309: dwrite df/d12/d43/d50/f5d [0,4194304] 0 2024-09-17T01:56:26.743 INFO:tasks.workunit.client.0.smithi063.stdout:2/196: unlink d3/d7/l16 0 2024-09-17T01:56:26.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/285: dread de/d17/d1b/f32 [0,4194304] 0 2024-09-17T01:56:26.744 INFO:tasks.workunit.client.0.smithi063.stdout:7/215: dwrite d2/f23 [0,4194304] 0 2024-09-17T01:56:26.745 INFO:tasks.workunit.client.0.smithi063.stdout:7/216: chown d2/f4 1868727 1 2024-09-17T01:56:26.745 INFO:tasks.workunit.client.0.smithi063.stdout:0/201: symlink d1/d3/db/d18/l46 0 2024-09-17T01:56:26.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/296: fsync d6/d9/f40 0 2024-09-17T01:56:26.746 INFO:tasks.workunit.client.0.smithi063.stdout:7/217: mknod d2/d3/d27/d39/c4a 0 2024-09-17T01:56:26.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/297: write d6/f18 [1702071,108554] 0 2024-09-17T01:56:26.748 INFO:tasks.workunit.client.0.smithi063.stdout:7/218: creat d2/d3/d27/d39/f4b x:0 0 0 2024-09-17T01:56:26.749 INFO:tasks.workunit.client.0.smithi063.stdout:7/219: stat d2/f7 0 2024-09-17T01:56:26.749 INFO:tasks.workunit.client.0.smithi063.stdout:0/202: link d1/d3/db/c12 d1/d1d/c47 0 2024-09-17T01:56:26.751 INFO:tasks.workunit.client.0.smithi063.stdout:7/220: unlink d2/f38 0 2024-09-17T01:56:26.751 INFO:tasks.workunit.client.0.smithi063.stdout:2/197: dwrite d3/d2a/d2b/f3b [0,4194304] 0 2024-09-17T01:56:26.752 INFO:tasks.workunit.client.0.smithi063.stdout:2/198: chown d3/c23 12466919 1 2024-09-17T01:56:26.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/221: symlink d2/d3/d27/l4c 0 2024-09-17T01:56:26.753 INFO:tasks.workunit.client.0.smithi063.stdout:2/199: dread - d3/d7/df/f2f zero size 2024-09-17T01:56:26.754 INFO:tasks.workunit.client.0.smithi063.stdout:4/286: dwrite de/f14 [0,4194304] 0 2024-09-17T01:56:26.754 INFO:tasks.workunit.client.0.smithi063.stdout:0/203: link d1/d3/db/d14/d2f/c3f d1/d3/d1b/c48 0 2024-09-17T01:56:26.754 INFO:tasks.workunit.client.0.smithi063.stdout:3/310: read df/d12/d2d/f40 [235682,64064] 0 2024-09-17T01:56:26.756 INFO:tasks.workunit.client.0.smithi063.stdout:7/222: rmdir d2/d3/d17/d25 39 2024-09-17T01:56:26.756 INFO:tasks.workunit.client.0.smithi063.stdout:4/287: rename de/d17/d36/f41 to de/d2d/d52/f5f 0 2024-09-17T01:56:26.757 INFO:tasks.workunit.client.0.smithi063.stdout:3/311: symlink df/d12/d1e/d5e/l70 0 2024-09-17T01:56:26.758 INFO:tasks.workunit.client.0.smithi063.stdout:4/288: creat de/d18/f60 x:0 0 0 2024-09-17T01:56:26.758 INFO:tasks.workunit.client.0.smithi063.stdout:5/298: read d6/d9/d13/f1e [3178428,39588] 0 2024-09-17T01:56:26.758 INFO:tasks.workunit.client.0.smithi063.stdout:7/223: symlink d2/d15/d2f/d45/d48/l4d 0 2024-09-17T01:56:26.760 INFO:tasks.workunit.client.0.smithi063.stdout:4/289: creat de/d18/d28/d30/f61 x:0 0 0 2024-09-17T01:56:26.761 INFO:tasks.workunit.client.0.smithi063.stdout:3/312: dread df/d12/d2d/f52 [0,4194304] 0 2024-09-17T01:56:26.761 INFO:tasks.workunit.client.0.smithi063.stdout:4/290: dread - f7 zero size 2024-09-17T01:56:26.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/193: dread d1/d7/f32 [0,4194304] 0 2024-09-17T01:56:26.762 INFO:tasks.workunit.client.0.smithi063.stdout:0/204: dread d1/d3/db/d18/d33/f2e [0,4194304] 0 2024-09-17T01:56:26.762 INFO:tasks.workunit.client.0.smithi063.stdout:4/291: chown de/d17/d1b/c2b 4 1 2024-09-17T01:56:26.762 INFO:tasks.workunit.client.0.smithi063.stdout:2/200: dwrite d3/f10 [4194304,4194304] 0 2024-09-17T01:56:26.762 INFO:tasks.workunit.client.0.smithi063.stdout:0/205: read d1/f19 [833823,7690] 0 2024-09-17T01:56:26.763 INFO:tasks.workunit.client.0.smithi063.stdout:4/292: chown de/d17/d36/c59 2766 1 2024-09-17T01:56:26.764 INFO:tasks.workunit.client.0.smithi063.stdout:7/224: getdents d2/d15/d2f/d47 0 2024-09-17T01:56:26.764 INFO:tasks.workunit.client.0.smithi063.stdout:0/206: creat d1/d3/d1b/f49 x:0 0 0 2024-09-17T01:56:26.764 INFO:tasks.workunit.client.0.smithi063.stdout:4/293: creat de/d17/d1b/f62 x:0 0 0 2024-09-17T01:56:26.765 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:26.765 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:26.766 INFO:tasks.workunit.client.0.smithi063.stdout:7/225: readlink d2/d3/d22/l2e 0 2024-09-17T01:56:26.766 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:26.769+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:26.767 INFO:tasks.workunit.client.0.smithi063.stdout:4/294: write de/f26 [616782,67246] 0 2024-09-17T01:56:26.767 INFO:tasks.workunit.client.0.smithi063.stdout:8/194: creat d1/d7/f39 x:0 0 0 2024-09-17T01:56:26.769 INFO:tasks.workunit.client.0.smithi063.stdout:7/226: write d2/d3/d27/f41 [618363,30075] 0 2024-09-17T01:56:26.769 INFO:tasks.workunit.client.0.smithi063.stdout:6/289: dread dc/d14/d19/d20/d32/d52/d5a/f48 [0,4194304] 0 2024-09-17T01:56:26.769 INFO:tasks.workunit.client.0.smithi063.stdout:4/295: dread - de/f2e zero size 2024-09-17T01:56:26.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/195: mkdir d1/d7/d28/d2a/d37/d3a 0 2024-09-17T01:56:26.770 INFO:tasks.workunit.client.0.smithi063.stdout:1/380: sync 2024-09-17T01:56:26.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/196: stat d1/c31 0 2024-09-17T01:56:26.770 INFO:tasks.workunit.client.0.smithi063.stdout:5/299: dwrite d6/d9/f45 [0,4194304] 0 2024-09-17T01:56:26.772 INFO:tasks.workunit.client.0.smithi063.stdout:2/201: dwrite d3/d7/fa [0,4194304] 0 2024-09-17T01:56:26.772 INFO:tasks.workunit.client.0.smithi063.stdout:6/290: creat dc/d14/d2f/f5f x:0 0 0 2024-09-17T01:56:26.774 INFO:tasks.workunit.client.0.smithi063.stdout:5/300: rmdir d6/d9/d13 39 2024-09-17T01:56:26.774 INFO:tasks.workunit.client.0.smithi063.stdout:2/202: creat d3/d2a/f3d x:0 0 0 2024-09-17T01:56:26.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/381: symlink d0/d2d/d35/d3f/d81/l88 0 2024-09-17T01:56:26.774 INFO:tasks.workunit.client.0.smithi063.stdout:0/207: truncate d1/d3/d1b/f38 3842223 0 2024-09-17T01:56:26.775 INFO:tasks.workunit.client.0.smithi063.stdout:8/197: link d1/df/f23 d1/df/f3b 0 2024-09-17T01:56:26.775 INFO:tasks.workunit.client.0.smithi063.stdout:4/296: dread de/f4c [0,4194304] 0 2024-09-17T01:56:26.776 INFO:tasks.workunit.client.0.smithi063.stdout:5/301: mknod d6/d35/c5a 0 2024-09-17T01:56:26.777 INFO:tasks.workunit.client.0.smithi063.stdout:1/382: read d0/d2d/d35/d3f/f68 [1576671,2358] 0 2024-09-17T01:56:26.777 INFO:tasks.workunit.client.0.smithi063.stdout:4/297: mknod de/d18/c63 0 2024-09-17T01:56:26.777 INFO:tasks.workunit.client.0.smithi063.stdout:2/203: link d3/f8 d3/d7/df/d30/f3e 0 2024-09-17T01:56:26.777 INFO:tasks.workunit.client.0.smithi063.stdout:8/198: dread d1/d7/d1d/f1e [0,4194304] 0 2024-09-17T01:56:26.778 INFO:tasks.workunit.client.0.smithi063.stdout:2/204: write d3/f9 [797901,119842] 0 2024-09-17T01:56:26.779 INFO:tasks.workunit.client.0.smithi063.stdout:9/194: dread d9/de/ff [0,4194304] 0 2024-09-17T01:56:26.779 INFO:tasks.workunit.client.0.smithi063.stdout:7/227: creat d2/d3/d27/d39/f4e x:0 0 0 2024-09-17T01:56:26.779 INFO:tasks.workunit.client.0.smithi063.stdout:2/205: symlink d3/d28/l3f 0 2024-09-17T01:56:26.779 INFO:tasks.workunit.client.0.smithi063.stdout:1/383: mknod d0/d2d/d5e/c89 0 2024-09-17T01:56:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:5/302: chown d6/d9/d13/d1d/l30 62 1 2024-09-17T01:56:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:4/298: fsync de/d17/d1b/f62 0 2024-09-17T01:56:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:1/384: readlink d0/d2d/d35/l76 0 2024-09-17T01:56:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:2/206: chown d3/d7/df/d30/c36 2015573523 1 2024-09-17T01:56:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/291: read dc/d14/d19/d20/d32/d52/f5c [1811426,47355] 0 2024-09-17T01:56:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:9/195: mkdir d9/de/d20/d37/d42/d45 0 2024-09-17T01:56:26.781 INFO:tasks.workunit.client.0.smithi063.stdout:4/299: read f4 [893599,47370] 0 2024-09-17T01:56:26.781 INFO:tasks.workunit.client.0.smithi063.stdout:9/196: fsync d9/d27/f3b 0 2024-09-17T01:56:26.781 INFO:tasks.workunit.client.0.smithi063.stdout:0/208: dread d1/f19 [0,4194304] 0 2024-09-17T01:56:26.781 INFO:tasks.workunit.client.0.smithi063.stdout:2/207: write d3/d7/fa [516809,50301] 0 2024-09-17T01:56:26.782 INFO:tasks.workunit.client.0.smithi063.stdout:5/303: link d6/d23/d29/d2b/d4f/f52 d6/d23/d29/d36/f5b 0 2024-09-17T01:56:26.783 INFO:tasks.workunit.client.0.smithi063.stdout:5/304: readlink d6/d23/d29/d2b/d31/l53 0 2024-09-17T01:56:26.783 INFO:tasks.workunit.client.0.smithi063.stdout:8/199: truncate d1/d7/f32 1989962 0 2024-09-17T01:56:26.783 INFO:tasks.workunit.client.0.smithi063.stdout:6/292: rename dc/d14/d19/f59 to dc/d14/d19/d20/d32/d52/f60 0 2024-09-17T01:56:26.784 INFO:tasks.workunit.client.0.smithi063.stdout:9/197: write d9/de/f2f [4611459,86490] 0 2024-09-17T01:56:26.784 INFO:tasks.workunit.client.0.smithi063.stdout:0/209: mknod d1/d3/d1b/c4a 0 2024-09-17T01:56:26.785 INFO:tasks.workunit.client.0.smithi063.stdout:9/198: write d9/de/f2f [5310315,82818] 0 2024-09-17T01:56:26.786 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:26.787 INFO:tasks.workunit.client.0.smithi063.stdout:8/200: truncate d1/f2 869762 0 2024-09-17T01:56:26.787 INFO:tasks.workunit.client.0.smithi063.stdout:0/210: unlink d1/c35 0 2024-09-17T01:56:26.788 INFO:tasks.workunit.client.0.smithi063.stdout:8/201: readlink d1/la 0 2024-09-17T01:56:26.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/300: dread de/d18/f1d [0,4194304] 0 2024-09-17T01:56:26.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/301: chown de 540042 1 2024-09-17T01:56:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:0/211: rename d1/d3/db/d14 to d1/d3/db/d4b 0 2024-09-17T01:56:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:4/302: read de/d18/f1d [721845,80956] 0 2024-09-17T01:56:26.789 INFO:tasks.workunit.client.0.smithi063.stdout:9/199: creat d9/de/d20/d1e/f46 x:0 0 0 2024-09-17T01:56:26.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/212: unlink d1/d3/l9 0 2024-09-17T01:56:26.792 INFO:tasks.workunit.client.0.smithi063.stdout:6/293: dwrite dc/d14/d19/d20/f23 [4194304,4194304] 0 2024-09-17T01:56:26.792 INFO:tasks.workunit.client.0.smithi063.stdout:9/200: mkdir d9/de/d20/d1e/d2a/d36/d47 0 2024-09-17T01:56:26.793 INFO:tasks.workunit.client.0.smithi063.stdout:2/208: dwrite d3/d7/df/f25 [0,4194304] 0 2024-09-17T01:56:26.793 INFO:tasks.workunit.client.0.smithi063.stdout:0/213: dread - d1/d3/d1b/f49 zero size 2024-09-17T01:56:26.793 INFO:tasks.workunit.client.0.smithi063.stdout:6/294: readlink dc/d14/d18/l3b 0 2024-09-17T01:56:26.794 INFO:tasks.workunit.client.0.smithi063.stdout:9/201: truncate d9/de/d20/d1e/d2a/f3f 4308539 0 2024-09-17T01:56:26.795 INFO:tasks.workunit.client.0.smithi063.stdout:6/295: read dc/d14/d19/d20/d32/d52/d5a/f26 [4609280,69798] 0 2024-09-17T01:56:26.796 INFO:tasks.workunit.client.0.smithi063.stdout:6/296: write dc/d14/d19/d20/d32/d52/d5a/d43/f49 [4924293,124946] 0 2024-09-17T01:56:26.797 INFO:tasks.workunit.client.0.smithi063.stdout:8/202: fsync d1/f2 0 2024-09-17T01:56:26.798 INFO:tasks.workunit.client.0.smithi063.stdout:6/297: write f1 [2551601,64241] 0 2024-09-17T01:56:26.800 INFO:tasks.workunit.client.0.smithi063.stdout:2/209: mknod d3/d7/df/d30/c40 0 2024-09-17T01:56:26.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/303: dwrite de/d17/d1b/f1c [0,4194304] 0 2024-09-17T01:56:26.801 INFO:tasks.workunit.client.0.smithi063.stdout:9/202: symlink d9/de/d20/d37/d42/l48 0 2024-09-17T01:56:26.801 INFO:tasks.workunit.client.0.smithi063.stdout:7/228: dread d2/df/f11 [4194304,4194304] 0 2024-09-17T01:56:26.801 INFO:tasks.workunit.client.0.smithi063.stdout:6/298: chown dc/f13 3119 1 2024-09-17T01:56:26.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/385: dread d0/f1b [0,4194304] 0 2024-09-17T01:56:26.802 INFO:tasks.workunit.client.0.smithi063.stdout:8/203: creat d1/d7/d28/d2a/d37/d3a/f3c x:0 0 0 2024-09-17T01:56:26.803 INFO:tasks.workunit.client.0.smithi063.stdout:4/304: write de/d18/f1a [724682,107005] 0 2024-09-17T01:56:26.804 INFO:tasks.workunit.client.0.smithi063.stdout:0/214: dwrite d1/d3/db/d18/f30 [0,4194304] 0 2024-09-17T01:56:26.806 INFO:tasks.workunit.client.0.smithi063.stdout:6/299: unlink dc/d1b/l3a 0 2024-09-17T01:56:26.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/210: creat d3/d2a/d2b/f41 x:0 0 0 2024-09-17T01:56:26.806 INFO:tasks.workunit.client.0.smithi063.stdout:8/204: mknod d1/d7/d1d/c3d 0 2024-09-17T01:56:26.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/211: write d3/d2a/d2b/f3b [3650386,61763] 0 2024-09-17T01:56:26.807 INFO:tasks.workunit.client.0.smithi063.stdout:1/386: write d0/d2d/d35/f7f [3956735,110818] 0 2024-09-17T01:56:26.808 INFO:tasks.workunit.client.0.smithi063.stdout:8/205: dread - d1/df/f33 zero size 2024-09-17T01:56:26.809 INFO:tasks.workunit.client.0.smithi063.stdout:2/212: mknod d3/d2a/c42 0 2024-09-17T01:56:26.809 INFO:tasks.workunit.client.0.smithi063.stdout:6/300: link dc/d14/d19/d20/f23 dc/d14/d19/d20/d32/f61 0 2024-09-17T01:56:26.809 INFO:tasks.workunit.client.0.smithi063.stdout:8/206: chown d1/f16 553333 1 2024-09-17T01:56:26.810 INFO:tasks.workunit.client.0.smithi063.stdout:2/213: truncate d3/d7/f1c 441640 0 2024-09-17T01:56:26.810 INFO:tasks.workunit.client.0.smithi063.stdout:6/301: mkdir dc/d14/d19/d20/d32/d52/d5a/d62 0 2024-09-17T01:56:26.811 INFO:tasks.workunit.client.0.smithi063.stdout:6/302: stat dc/d14/c22 0 2024-09-17T01:56:26.813 INFO:tasks.workunit.client.0.smithi063.stdout:4/305: write de/d17/d36/f5b [47398,115981] 0 2024-09-17T01:56:26.814 INFO:tasks.workunit.client.0.smithi063.stdout:6/303: chown dc/d14/d19/d20/d32/d52/d5a/f40 202631 1 2024-09-17T01:56:26.815 INFO:tasks.workunit.client.0.smithi063.stdout:6/304: fdatasync dc/f13 0 2024-09-17T01:56:26.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/305: dread d6/d37/d19/f26 [0,4194304] 0 2024-09-17T01:56:26.816 INFO:tasks.workunit.client.0.smithi063.stdout:0/215: dwrite d1/f7 [4194304,4194304] 0 2024-09-17T01:56:26.817 INFO:tasks.workunit.client.0.smithi063.stdout:1/387: dwrite d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:26.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/306: truncate d6/d23/d29/d2b/d31/f33 633674 0 2024-09-17T01:56:26.819 INFO:tasks.workunit.client.0.smithi063.stdout:6/305: creat dc/d14/d18/f63 x:0 0 0 2024-09-17T01:56:26.819 INFO:tasks.workunit.client.0.smithi063.stdout:4/306: dread de/d18/f37 [0,4194304] 0 2024-09-17T01:56:26.820 INFO:tasks.workunit.client.0.smithi063.stdout:5/307: symlink d6/d23/d29/d2b/l5c 0 2024-09-17T01:56:26.820 INFO:tasks.workunit.client.0.smithi063.stdout:1/388: getdents d0/d1c 0 2024-09-17T01:56:26.821 INFO:tasks.workunit.client.0.smithi063.stdout:9/203: dread d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:26.822 INFO:tasks.workunit.client.0.smithi063.stdout:4/307: creat de/d2d/f64 x:0 0 0 2024-09-17T01:56:26.822 INFO:tasks.workunit.client.0.smithi063.stdout:4/308: chown de/d17/f23 221430254 1 2024-09-17T01:56:26.823 INFO:tasks.workunit.client.0.smithi063.stdout:5/308: creat d6/d9/d13/f5d x:0 0 0 2024-09-17T01:56:26.823 INFO:tasks.workunit.client.0.smithi063.stdout:9/204: symlink d9/d27/l49 0 2024-09-17T01:56:26.823 INFO:tasks.workunit.client.0.smithi063.stdout:0/216: link d1/d3/d1b/c40 d1/d3/d10/c4c 0 2024-09-17T01:56:26.824 INFO:tasks.workunit.client.0.smithi063.stdout:4/309: rename f7 to de/d18/d28/f65 0 2024-09-17T01:56:26.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/205: dread - d9/de/d20/f24 zero size 2024-09-17T01:56:26.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/206: fdatasync d9/de/f2f 0 2024-09-17T01:56:26.824 INFO:tasks.workunit.client.0.smithi063.stdout:6/306: dread dc/d14/d19/d20/d32/d52/d5a/d43/f50 [0,4194304] 0 2024-09-17T01:56:26.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/217: read - d1/d3/db/d18/d33/f36 zero size 2024-09-17T01:56:26.825 INFO:tasks.workunit.client.0.smithi063.stdout:4/310: write de/f2e [930116,127494] 0 2024-09-17T01:56:26.825 INFO:tasks.workunit.client.0.smithi063.stdout:4/311: read de/d17/d1b/f1c [1921055,79278] 0 2024-09-17T01:56:26.826 INFO:tasks.workunit.client.0.smithi063.stdout:9/207: rename d9/cd to d9/c4a 0 2024-09-17T01:56:26.826 INFO:tasks.workunit.client.0.smithi063.stdout:6/307: fsync dc/d14/d19/f1a 0 2024-09-17T01:56:26.826 INFO:tasks.workunit.client.0.smithi063.stdout:4/312: fsync de/f14 0 2024-09-17T01:56:26.827 INFO:tasks.workunit.client.0.smithi063.stdout:4/313: fsync de/d2d/d52/f5f 0 2024-09-17T01:56:26.827 INFO:tasks.workunit.client.0.smithi063.stdout:9/208: rename d9/de/d20/d37/d42/l48 to d9/de/d33/l4b 0 2024-09-17T01:56:26.827 INFO:tasks.workunit.client.0.smithi063.stdout:6/308: link dc/d14/d19/f53 dc/d14/d18/f64 0 2024-09-17T01:56:26.828 INFO:tasks.workunit.client.0.smithi063.stdout:2/214: dread d3/d7/df/d30/f3a [0,4194304] 0 2024-09-17T01:56:26.828 INFO:tasks.workunit.client.0.smithi063.stdout:4/314: dread - de/d18/d28/f65 zero size 2024-09-17T01:56:26.829 INFO:tasks.workunit.client.0.smithi063.stdout:9/209: chown d9/de/d33/f38 1557704 1 2024-09-17T01:56:26.830 INFO:tasks.workunit.client.0.smithi063.stdout:6/309: mkdir dc/d14/d65 0 2024-09-17T01:56:26.830 INFO:tasks.workunit.client.0.smithi063.stdout:1/389: dwrite d0/f1b [0,4194304] 0 2024-09-17T01:56:26.830 INFO:tasks.workunit.client.0.smithi063.stdout:4/315: symlink de/l66 0 2024-09-17T01:56:26.831 INFO:tasks.workunit.client.0.smithi063.stdout:4/316: stat de/l3d 0 2024-09-17T01:56:26.832 INFO:tasks.workunit.client.0.smithi063.stdout:4/317: chown de/f38 37 1 2024-09-17T01:56:26.832 INFO:tasks.workunit.client.0.smithi063.stdout:2/215: rename d3/d2a/d2b to d3/d7/df/d43 0 2024-09-17T01:56:26.832 INFO:tasks.workunit.client.0.smithi063.stdout:0/218: dwrite d1/d3/db/f39 [0,4194304] 0 2024-09-17T01:56:26.833 INFO:tasks.workunit.client.0.smithi063.stdout:6/310: fsync dc/d14/d19/d20/d32/d52/f60 0 2024-09-17T01:56:26.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/390: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a x:0 0 0 2024-09-17T01:56:26.833 INFO:tasks.workunit.client.0.smithi063.stdout:4/318: write de/d18/d28/d30/f61 [125425,103340] 0 2024-09-17T01:56:26.834 INFO:tasks.workunit.client.0.smithi063.stdout:6/311: readlink dc/l4a 0 2024-09-17T01:56:26.834 INFO:tasks.workunit.client.0.smithi063.stdout:2/216: unlink d3/d7/f1c 0 2024-09-17T01:56:26.834 INFO:tasks.workunit.client.0.smithi063.stdout:9/210: rename d9/de/d20/d1e/d2a/d36/d47 to d9/de/d20/d37/d42/d4c 0 2024-09-17T01:56:26.835 INFO:tasks.workunit.client.0.smithi063.stdout:1/391: mkdir d0/d2d/d35/d3f/d81/d50/d8b 0 2024-09-17T01:56:26.835 INFO:tasks.workunit.client.0.smithi063.stdout:2/217: truncate d3/d7/df/f19 4264241 0 2024-09-17T01:56:26.835 INFO:tasks.workunit.client.0.smithi063.stdout:6/312: mkdir dc/d14/d19/d20/d66 0 2024-09-17T01:56:26.835 INFO:tasks.workunit.client.0.smithi063.stdout:9/211: mknod d9/de/d20/d1e/d2a/d36/c4d 0 2024-09-17T01:56:26.836 INFO:tasks.workunit.client.0.smithi063.stdout:2/218: read d3/d7/df/d30/f3a [771251,93885] 0 2024-09-17T01:56:26.837 INFO:tasks.workunit.client.0.smithi063.stdout:2/219: stat d3/d7/fa 0 2024-09-17T01:56:26.837 INFO:tasks.workunit.client.0.smithi063.stdout:2/220: rmdir d3/d2a 39 2024-09-17T01:56:26.840 INFO:tasks.workunit.client.0.smithi063.stdout:2/221: creat d3/f44 x:0 0 0 2024-09-17T01:56:26.841 INFO:tasks.workunit.client.0.smithi063.stdout:4/319: rename de/d18 to de/d17/d1b/d67 0 2024-09-17T01:56:26.841 INFO:tasks.workunit.client.0.smithi063.stdout:5/309: dread d6/d37/fe [0,4194304] 0 2024-09-17T01:56:26.844 INFO:tasks.workunit.client.0.smithi063.stdout:2/222: write d3/d7/fa [1148145,108518] 0 2024-09-17T01:56:26.844 INFO:tasks.workunit.client.0.smithi063.stdout:0/219: dwrite d1/d1d/f3b [0,4194304] 0 2024-09-17T01:56:26.848 INFO:tasks.workunit.client.0.smithi063.stdout:1/392: dwrite d0/d2d/d35/d3f/d81/d50/f70 [0,4194304] 0 2024-09-17T01:56:26.848 INFO:tasks.workunit.client.0.smithi063.stdout:4/320: stat de/d17/d1b/d67/d28/d30/l45 0 2024-09-17T01:56:26.848 INFO:tasks.workunit.client.0.smithi063.stdout:6/313: dwrite dc/d14/d19/f1c [0,4194304] 0 2024-09-17T01:56:26.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/212: dwrite d9/de/d20/d1b/f2d [0,4194304] 0 2024-09-17T01:56:26.849 INFO:tasks.workunit.client.0.smithi063.stdout:8/207: dread d1/df/f1b [0,4194304] 0 2024-09-17T01:56:26.850 INFO:tasks.workunit.client.0.smithi063.stdout:2/223: rename d3/d7/df/d30/f3a to d3/d7/d38/f45 0 2024-09-17T01:56:26.851 INFO:tasks.workunit.client.0.smithi063.stdout:6/314: link dc/ld dc/d14/d19/d20/d32/l67 0 2024-09-17T01:56:26.851 INFO:tasks.workunit.client.0.smithi063.stdout:4/321: write de/f4c [1699745,124354] 0 2024-09-17T01:56:26.852 INFO:tasks.workunit.client.0.smithi063.stdout:2/224: chown d3/d7/df/c31 1 1 2024-09-17T01:56:26.853 INFO:tasks.workunit.client.0.smithi063.stdout:3/313: sync 2024-09-17T01:56:26.853 INFO:tasks.workunit.client.0.smithi063.stdout:3/314: write fc [3996792,81332] 0 2024-09-17T01:56:26.853 INFO:tasks.workunit.client.0.smithi063.stdout:9/213: link d9/de/d20/f24 d9/de/d20/d1b/d25/f4e 0 2024-09-17T01:56:26.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/220: truncate d1/d1d/f2d 345545 0 2024-09-17T01:56:26.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/225: write d3/d7/df/f25 [2509919,62931] 0 2024-09-17T01:56:26.856 INFO:tasks.workunit.client.0.smithi063.stdout:3/315: read - df/d12/d43/f69 zero size 2024-09-17T01:56:26.857 INFO:tasks.workunit.client.0.smithi063.stdout:5/310: dwrite d6/d9/d13/f1e [0,4194304] 0 2024-09-17T01:56:26.857 INFO:tasks.workunit.client.0.smithi063.stdout:2/226: write d3/d7/df/f29 [402164,43437] 0 2024-09-17T01:56:26.857 INFO:tasks.workunit.client.0.smithi063.stdout:3/316: fdatasync df/d12/d2d/f4a 0 2024-09-17T01:56:26.858 INFO:tasks.workunit.client.0.smithi063.stdout:9/214: mkdir d9/de/d20/d1e/d2a/d40/d4f 0 2024-09-17T01:56:26.859 INFO:tasks.workunit.client.0.smithi063.stdout:2/227: unlink d3/c12 0 2024-09-17T01:56:26.860 INFO:tasks.workunit.client.0.smithi063.stdout:3/317: read - df/d12/d3a/f44 zero size 2024-09-17T01:56:26.862 INFO:tasks.workunit.client.0.smithi063.stdout:6/315: truncate f3 5579410 0 2024-09-17T01:56:26.862 INFO:tasks.workunit.client.0.smithi063.stdout:8/208: dwrite d1/d7/d1d/f1e [0,4194304] 0 2024-09-17T01:56:26.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/393: dwrite d0/d2d/d35/d3f/d81/f3e [0,4194304] 0 2024-09-17T01:56:26.863 INFO:tasks.workunit.client.0.smithi063.stdout:8/209: chown d1/d7/d1d/f20 0 1 2024-09-17T01:56:26.863 INFO:tasks.workunit.client.0.smithi063.stdout:4/322: dwrite f8 [0,4194304] 0 2024-09-17T01:56:26.864 INFO:tasks.workunit.client.0.smithi063.stdout:5/311: creat d6/d23/d29/d36/f5e x:0 0 0 2024-09-17T01:56:26.865 INFO:tasks.workunit.client.0.smithi063.stdout:2/228: rename d3/d7/fa to d3/d2c/f46 0 2024-09-17T01:56:26.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/318: symlink df/d12/d43/l71 0 2024-09-17T01:56:26.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/394: readlink d0/d2d/d35/d3f/d81/l67 0 2024-09-17T01:56:26.865 INFO:tasks.workunit.client.0.smithi063.stdout:5/312: chown d6/d37/d19/l4b 37673534 1 2024-09-17T01:56:26.865 INFO:tasks.workunit.client.0.smithi063.stdout:8/210: creat d1/d7/d1d/f3e x:0 0 0 2024-09-17T01:56:26.865 INFO:tasks.workunit.client.0.smithi063.stdout:4/323: fdatasync de/d17/d1b/f1e 0 2024-09-17T01:56:26.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/229: creat d3/d2a/f47 x:0 0 0 2024-09-17T01:56:26.866 INFO:tasks.workunit.client.0.smithi063.stdout:9/215: write d9/de/d20/f24 [754992,87704] 0 2024-09-17T01:56:26.867 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:26.869+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:26.867 INFO:tasks.workunit.client.0.smithi063.stdout:1/395: dread - d0/d2d/d35/d3f/f7b zero size 2024-09-17T01:56:26.867 INFO:tasks.workunit.client.0.smithi063.stdout:5/313: chown d6/d23/d29/d2b/d31/f33 10 1 2024-09-17T01:56:26.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/230: unlink d3/c2d 0 2024-09-17T01:56:26.868 INFO:tasks.workunit.client.0.smithi063.stdout:8/211: rename d1/d7/d1d/l34 to d1/d7/d28/d2a/l3f 0 2024-09-17T01:56:26.868 INFO:tasks.workunit.client.0.smithi063.stdout:5/314: symlink d6/d35/l5f 0 2024-09-17T01:56:26.869 INFO:tasks.workunit.client.0.smithi063.stdout:2/231: unlink d3/d2a/f3c 0 2024-09-17T01:56:26.869 INFO:tasks.workunit.client.0.smithi063.stdout:9/216: getdents d9 0 2024-09-17T01:56:26.870 INFO:tasks.workunit.client.0.smithi063.stdout:2/232: write d3/d7/df/f2f [398947,103699] 0 2024-09-17T01:56:26.873 INFO:tasks.workunit.client.0.smithi063.stdout:5/315: rename d6/d23/d29/d2b/l42 to d6/d23/d29/d36/l60 0 2024-09-17T01:56:26.873 INFO:tasks.workunit.client.0.smithi063.stdout:6/316: dwrite dc/d14/d19/d20/d32/d52/d5a/d43/f50 [0,4194304] 0 2024-09-17T01:56:26.874 INFO:tasks.workunit.client.0.smithi063.stdout:5/316: fdatasync d6/d23/f2a 0 2024-09-17T01:56:26.875 INFO:tasks.workunit.client.0.smithi063.stdout:1/396: dwrite d0/d2d/d35/d3f/d4e/d66/f69 [0,4194304] 0 2024-09-17T01:56:26.875 INFO:tasks.workunit.client.0.smithi063.stdout:9/217: truncate d9/de/d20/d1e/f34 1186916 0 2024-09-17T01:56:26.875 INFO:tasks.workunit.client.0.smithi063.stdout:6/317: read - dc/d14/d18/f64 zero size 2024-09-17T01:56:26.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/397: mkdir d0/d2d/d35/d8c 0 2024-09-17T01:56:26.876 INFO:tasks.workunit.client.0.smithi063.stdout:9/218: creat d9/de/d20/d37/f50 x:0 0 0 2024-09-17T01:56:26.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/398: unlink d0/c40 0 2024-09-17T01:56:26.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/317: read d6/d9/f28 [2167595,99592] 0 2024-09-17T01:56:26.878 INFO:tasks.workunit.client.0.smithi063.stdout:1/399: symlink d0/d2d/l8d 0 2024-09-17T01:56:26.879 INFO:tasks.workunit.client.0.smithi063.stdout:5/318: symlink d6/d37/l61 0 2024-09-17T01:56:26.879 INFO:tasks.workunit.client.0.smithi063.stdout:2/233: dwrite d3/d7/df/f1a [4194304,4194304] 0 2024-09-17T01:56:26.879 INFO:tasks.workunit.client.0.smithi063.stdout:5/319: creat d6/f62 x:0 0 0 2024-09-17T01:56:26.880 INFO:tasks.workunit.client.0.smithi063.stdout:2/234: chown d3/d28/l33 302309059 1 2024-09-17T01:56:26.880 INFO:tasks.workunit.client.0.smithi063.stdout:5/320: symlink d6/d35/l63 0 2024-09-17T01:56:26.880 INFO:tasks.workunit.client.0.smithi063.stdout:1/400: creat d0/d2d/d35/d3f/d81/d50/d8b/f8e x:0 0 0 2024-09-17T01:56:26.881 INFO:tasks.workunit.client.0.smithi063.stdout:6/318: dread dc/d1b/f29 [4194304,4194304] 0 2024-09-17T01:56:26.881 INFO:tasks.workunit.client.0.smithi063.stdout:5/321: mknod d6/d35/c64 0 2024-09-17T01:56:26.881 INFO:tasks.workunit.client.0.smithi063.stdout:3/319: dread df/d28/f2a [0,4194304] 0 2024-09-17T01:56:26.882 INFO:tasks.workunit.client.0.smithi063.stdout:2/235: mknod d3/c48 0 2024-09-17T01:56:26.882 INFO:tasks.workunit.client.0.smithi063.stdout:1/401: write d0/d2d/d35/d3f/d4e/f5f [4447223,61327] 0 2024-09-17T01:56:26.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/322: mknod d6/d9/d13/c65 0 2024-09-17T01:56:26.883 INFO:tasks.workunit.client.0.smithi063.stdout:2/236: stat d3/d7/df/c31 0 2024-09-17T01:56:26.885 INFO:tasks.workunit.client.0.smithi063.stdout:1/402: link d0/d2d/d35/d3f/d81/d50/c52 d0/d2d/c8f 0 2024-09-17T01:56:26.886 INFO:tasks.workunit.client.0.smithi063.stdout:9/219: dwrite d9/d27/f3a [0,4194304] 0 2024-09-17T01:56:26.887 INFO:tasks.workunit.client.0.smithi063.stdout:3/320: write f3 [4213438,43956] 0 2024-09-17T01:56:26.887 INFO:tasks.workunit.client.0.smithi063.stdout:2/237: getdents d3 0 2024-09-17T01:56:26.890 INFO:tasks.workunit.client.0.smithi063.stdout:6/319: dwrite dc/d1b/f29 [0,4194304] 0 2024-09-17T01:56:26.890 INFO:tasks.workunit.client.0.smithi063.stdout:2/238: getdents d3 0 2024-09-17T01:56:26.890 INFO:tasks.workunit.client.0.smithi063.stdout:9/220: write d9/de/d20/d1e/d2a/f3f [4448015,9162] 0 2024-09-17T01:56:26.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/320: mkdir dc/d14/d19/d20/d32/d68 0 2024-09-17T01:56:26.892 INFO:tasks.workunit.client.0.smithi063.stdout:2/239: symlink d3/d7/df/d30/l49 0 2024-09-17T01:56:26.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/323: dwrite d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:26.894 INFO:tasks.workunit.client.0.smithi063.stdout:5/324: dread - d6/d23/d3a/f4c zero size 2024-09-17T01:56:26.895 INFO:tasks.workunit.client.0.smithi063.stdout:1/403: truncate d0/d2d/d35/d3f/f68 415941 0 2024-09-17T01:56:26.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/240: mknod d3/d7/c4a 0 2024-09-17T01:56:26.896 INFO:tasks.workunit.client.0.smithi063.stdout:6/321: symlink dc/d14/d19/d20/d66/l69 0 2024-09-17T01:56:26.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/241: write d3/f10 [8667952,96208] 0 2024-09-17T01:56:26.896 INFO:tasks.workunit.client.0.smithi063.stdout:5/325: unlink d6/d35/f4a 0 2024-09-17T01:56:26.898 INFO:tasks.workunit.client.0.smithi063.stdout:1/404: mkdir d0/d2d/d35/d3f/d81/d50/d6c/d90 0 2024-09-17T01:56:26.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/221: dread d9/d27/f3a [0,4194304] 0 2024-09-17T01:56:26.898 INFO:tasks.workunit.client.0.smithi063.stdout:3/321: dwrite df/d12/d2d/f4a [0,4194304] 0 2024-09-17T01:56:26.898 INFO:tasks.workunit.client.0.smithi063.stdout:2/242: write d3/d7/f34 [254781,54485] 0 2024-09-17T01:56:26.899 INFO:tasks.workunit.client.0.smithi063.stdout:1/405: fdatasync d0/d1c/f4c 0 2024-09-17T01:56:26.899 INFO:tasks.workunit.client.0.smithi063.stdout:2/243: chown d3/d7/f34 214 1 2024-09-17T01:56:26.900 INFO:tasks.workunit.client.0.smithi063.stdout:1/406: mknod d0/d2d/d35/d3f/d81/c91 0 2024-09-17T01:56:26.900 INFO:tasks.workunit.client.0.smithi063.stdout:9/222: chown d9/d27/c3d 916564 1 2024-09-17T01:56:26.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/244: write d3/d7/df/d43/f41 [174874,100815] 0 2024-09-17T01:56:26.901 INFO:tasks.workunit.client.0.smithi063.stdout:1/407: chown d0/d2d/d35/d3f/f7b 1155 1 2024-09-17T01:56:26.901 INFO:tasks.workunit.client.0.smithi063.stdout:9/223: mknod d9/de/d20/d37/d42/d4c/c51 0 2024-09-17T01:56:26.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/322: dread dc/f4e [0,4194304] 0 2024-09-17T01:56:26.902 INFO:tasks.workunit.client.0.smithi063.stdout:2/245: rename d3/c13 to d3/d2a/c4b 0 2024-09-17T01:56:26.903 INFO:tasks.workunit.client.0.smithi063.stdout:9/224: rmdir d9/de/d20/d37/d42/d45 0 2024-09-17T01:56:26.903 INFO:tasks.workunit.client.0.smithi063.stdout:7/229: sync 2024-09-17T01:56:26.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/225: truncate d9/de/d20/d1e/f34 48341 0 2024-09-17T01:56:26.905 INFO:tasks.workunit.client.0.smithi063.stdout:3/322: dwrite df/f20 [0,4194304] 0 2024-09-17T01:56:26.906 INFO:tasks.workunit.client.0.smithi063.stdout:3/323: truncate df/d12/d3a/f44 109997 0 2024-09-17T01:56:26.907 INFO:tasks.workunit.client.0.smithi063.stdout:9/226: rename d9/de/l16 to d9/l52 0 2024-09-17T01:56:26.908 INFO:tasks.workunit.client.0.smithi063.stdout:3/324: rename df/d12/d1e/l37 to df/l72 0 2024-09-17T01:56:26.909 INFO:tasks.workunit.client.0.smithi063.stdout:9/227: dread - d9/de/d33/f38 zero size 2024-09-17T01:56:26.910 INFO:tasks.workunit.client.0.smithi063.stdout:6/323: read dc/d1b/f41 [204881,6506] 0 2024-09-17T01:56:26.910 INFO:tasks.workunit.client.0.smithi063.stdout:6/324: chown dc/d14/d18/l37 5062 1 2024-09-17T01:56:26.912 INFO:tasks.workunit.client.0.smithi063.stdout:9/228: readlink d9/l52 0 2024-09-17T01:56:26.913 INFO:tasks.workunit.client.0.smithi063.stdout:5/326: dwrite d6/d37/fe [0,4194304] 0 2024-09-17T01:56:26.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/327: dread - d6/d9/d13/f5d zero size 2024-09-17T01:56:26.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/221: dread d1/f6 [0,4194304] 0 2024-09-17T01:56:26.916 INFO:tasks.workunit.client.0.smithi063.stdout:2/246: creat d3/d2a/f4c x:0 0 0 2024-09-17T01:56:26.916 INFO:tasks.workunit.client.0.smithi063.stdout:5/328: creat d6/d23/d29/d36/f66 x:0 0 0 2024-09-17T01:56:26.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/325: dwrite dc/d14/d19/d20/d32/f61 [0,4194304] 0 2024-09-17T01:56:26.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/230: dread d2/d3/f1e [0,4194304] 0 2024-09-17T01:56:26.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/329: write d6/d23/d3a/f4c [11357,66378] 0 2024-09-17T01:56:26.919 INFO:tasks.workunit.client.0.smithi063.stdout:9/229: dread d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:26.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/330: fsync d6/d9/d13/d1d/f56 0 2024-09-17T01:56:26.920 INFO:tasks.workunit.client.0.smithi063.stdout:0/222: rename d1/f7 to d1/f4d 0 2024-09-17T01:56:26.920 INFO:tasks.workunit.client.0.smithi063.stdout:9/230: write d9/de/ff [4273107,73860] 0 2024-09-17T01:56:26.920 INFO:tasks.workunit.client.0.smithi063.stdout:0/223: chown d1/d3/db/d18/d33 0 1 2024-09-17T01:56:26.921 INFO:tasks.workunit.client.0.smithi063.stdout:5/331: mknod d6/d23/d3f/c67 0 2024-09-17T01:56:26.922 INFO:tasks.workunit.client.0.smithi063.stdout:0/224: creat d1/d3/d10/f4e x:0 0 0 2024-09-17T01:56:26.923 INFO:tasks.workunit.client.0.smithi063.stdout:6/326: link dc/c28 dc/d14/c6a 0 2024-09-17T01:56:26.924 INFO:tasks.workunit.client.0.smithi063.stdout:6/327: mknod dc/c6b 0 2024-09-17T01:56:26.924 INFO:tasks.workunit.client.0.smithi063.stdout:7/231: dwrite d2/fd [0,4194304] 0 2024-09-17T01:56:26.925 INFO:tasks.workunit.client.0.smithi063.stdout:6/328: dread - dc/d14/d18/f64 zero size 2024-09-17T01:56:26.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/247: dwrite d3/d2c/f46 [0,4194304] 0 2024-09-17T01:56:26.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/232: symlink d2/d3/d27/d33/l4f 0 2024-09-17T01:56:26.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/248: truncate d3/d7/f34 993885 0 2024-09-17T01:56:26.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/332: dwrite d6/d23/d29/d2b/d31/f33 [0,4194304] 0 2024-09-17T01:56:26.931 INFO:tasks.workunit.client.0.smithi063.stdout:0/225: dwrite d1/f1e [0,4194304] 0 2024-09-17T01:56:26.931 INFO:tasks.workunit.client.0.smithi063.stdout:5/333: write d6/d23/d29/d36/f66 [627109,120083] 0 2024-09-17T01:56:26.931 INFO:tasks.workunit.client.0.smithi063.stdout:5/334: chown d6/d35/l5f 1237 1 2024-09-17T01:56:26.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/249: truncate d3/f8 304665 0 2024-09-17T01:56:26.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/335: mkdir d6/d37/d19/d68 0 2024-09-17T01:56:26.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/329: write f3 [6583030,92974] 0 2024-09-17T01:56:26.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/226: creat d1/d3/d1b/f4f x:0 0 0 2024-09-17T01:56:26.934 INFO:tasks.workunit.client.0.smithi063.stdout:2/250: stat d3/f10 0 2024-09-17T01:56:26.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/336: mkdir d6/d23/d69 0 2024-09-17T01:56:26.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/337: chown d6 2832 1 2024-09-17T01:56:26.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/227: dread - d1/d3/d1b/f29 zero size 2024-09-17T01:56:26.935 INFO:tasks.workunit.client.0.smithi063.stdout:2/251: mkdir d3/d7/d38/d4d 0 2024-09-17T01:56:26.935 INFO:tasks.workunit.client.0.smithi063.stdout:2/252: unlink d3/d28/l33 0 2024-09-17T01:56:26.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/330: chown dc/d14/d19/d20/d32/d52/d5a/c46 36 1 2024-09-17T01:56:26.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/228: chown d1/d3/db/d18/f30 795 1 2024-09-17T01:56:26.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/253: dread - d3/f44 zero size 2024-09-17T01:56:26.937 INFO:tasks.workunit.client.0.smithi063.stdout:5/338: truncate d6/d23/d29/d36/f5e 97554 0 2024-09-17T01:56:26.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/254: chown d3/d7/df/l17 8 1 2024-09-17T01:56:26.937 INFO:tasks.workunit.client.0.smithi063.stdout:5/339: mknod d6/d9/d32/c6a 0 2024-09-17T01:56:26.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/255: symlink d3/d2a/l4e 0 2024-09-17T01:56:26.938 INFO:tasks.workunit.client.0.smithi063.stdout:6/331: chown dc/f38 14582 1 2024-09-17T01:56:26.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/332: creat dc/d14/d19/d20/d32/d68/f6c x:0 0 0 2024-09-17T01:56:26.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/231: dread d9/de/d20/d1e/f34 [0,4194304] 0 2024-09-17T01:56:26.943 INFO:tasks.workunit.client.0.smithi063.stdout:5/340: dwrite d6/f62 [0,4194304] 0 2024-09-17T01:56:26.944 INFO:tasks.workunit.client.0.smithi063.stdout:5/341: symlink d6/d23/d29/d2b/d4f/l6b 0 2024-09-17T01:56:26.945 INFO:tasks.workunit.client.0.smithi063.stdout:4/324: sync 2024-09-17T01:56:26.946 INFO:tasks.workunit.client.0.smithi063.stdout:3/325: sync 2024-09-17T01:56:26.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/212: sync 2024-09-17T01:56:26.946 INFO:tasks.workunit.client.0.smithi063.stdout:6/333: dread f3 [4194304,4194304] 0 2024-09-17T01:56:26.946 INFO:tasks.workunit.client.0.smithi063.stdout:1/408: sync 2024-09-17T01:56:26.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/342: rename d6/d23/d29/d36/f66 to d6/d35/f6c 0 2024-09-17T01:56:26.946 INFO:tasks.workunit.client.0.smithi063.stdout:3/326: creat df/d12/d3a/f73 x:0 0 0 2024-09-17T01:56:26.947 INFO:tasks.workunit.client.0.smithi063.stdout:8/213: creat d1/d7/d1d/f40 x:0 0 0 2024-09-17T01:56:26.947 INFO:tasks.workunit.client.0.smithi063.stdout:4/325: write de/d17/d1b/d67/f55 [1039678,18840] 0 2024-09-17T01:56:26.949 INFO:tasks.workunit.client.0.smithi063.stdout:2/256: dwrite d3/d7/df/f14 [4194304,4194304] 0 2024-09-17T01:56:26.949 INFO:tasks.workunit.client.0.smithi063.stdout:6/334: fdatasync dc/d1b/f41 0 2024-09-17T01:56:26.949 INFO:tasks.workunit.client.0.smithi063.stdout:1/409: link d0/d2d/d35/d3f/d81/l64 d0/d1c/l92 0 2024-09-17T01:56:26.949 INFO:tasks.workunit.client.0.smithi063.stdout:5/343: write d6/d9/d13/d1d/f56 [495347,82920] 0 2024-09-17T01:56:26.950 INFO:tasks.workunit.client.0.smithi063.stdout:8/214: mkdir d1/d7/d28/d2f/d41 0 2024-09-17T01:56:26.952 INFO:tasks.workunit.client.0.smithi063.stdout:5/344: write d6/d23/d29/d36/f5e [724351,33804] 0 2024-09-17T01:56:26.952 INFO:tasks.workunit.client.0.smithi063.stdout:8/215: creat d1/d7/d28/f42 x:0 0 0 2024-09-17T01:56:26.953 INFO:tasks.workunit.client.0.smithi063.stdout:1/410: truncate d0/f14 1331162 0 2024-09-17T01:56:26.953 INFO:tasks.workunit.client.0.smithi063.stdout:9/232: write d9/de/d20/d1b/f1f [4023651,68247] 0 2024-09-17T01:56:26.954 INFO:tasks.workunit.client.0.smithi063.stdout:1/411: mkdir d0/d93 0 2024-09-17T01:56:26.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/216: write d1/f2e [456694,20096] 0 2024-09-17T01:56:26.956 INFO:tasks.workunit.client.0.smithi063.stdout:3/327: dwrite fc [0,4194304] 0 2024-09-17T01:56:26.956 INFO:tasks.workunit.client.0.smithi063.stdout:1/412: fsync d0/d1c/f5c 0 2024-09-17T01:56:26.956 INFO:tasks.workunit.client.0.smithi063.stdout:2/257: dread d3/d7/df/f25 [0,4194304] 0 2024-09-17T01:56:26.956 INFO:tasks.workunit.client.0.smithi063.stdout:9/233: fdatasync d9/de/d20/d1e/f34 0 2024-09-17T01:56:26.958 INFO:tasks.workunit.client.0.smithi063.stdout:3/328: write df/f26 [823491,127233] 0 2024-09-17T01:56:26.958 INFO:tasks.workunit.client.0.smithi063.stdout:4/326: dwrite de/f26 [0,4194304] 0 2024-09-17T01:56:26.960 INFO:tasks.workunit.client.0.smithi063.stdout:4/327: creat de/d17/f68 x:0 0 0 2024-09-17T01:56:26.962 INFO:tasks.workunit.client.0.smithi063.stdout:9/234: creat d9/de/d20/d1e/d2a/f53 x:0 0 0 2024-09-17T01:56:26.963 INFO:tasks.workunit.client.0.smithi063.stdout:4/328: stat de/d2d/d52/l56 0 2024-09-17T01:56:26.963 INFO:tasks.workunit.client.0.smithi063.stdout:5/345: dwrite d6/d23/d3f/f46 [0,4194304] 0 2024-09-17T01:56:26.964 INFO:tasks.workunit.client.0.smithi063.stdout:9/235: readlink d9/de/d20/d1b/d25/l3e 0 2024-09-17T01:56:26.965 INFO:tasks.workunit.client.0.smithi063.stdout:5/346: chown d6/d37/d19/l4b 14601532 1 2024-09-17T01:56:26.965 INFO:tasks.workunit.client.0.smithi063.stdout:9/236: read d9/de/d20/d1e/f34 [38594,56418] 0 2024-09-17T01:56:26.965 INFO:tasks.workunit.client.0.smithi063.stdout:8/217: dwrite d1/d7/d1d/f1f [0,4194304] 0 2024-09-17T01:56:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/329: write fe [2084066,108711] 0 2024-09-17T01:56:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:5/347: dread - d6/d9/d13/d1d/f55 zero size 2024-09-17T01:56:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:8/218: mkdir d1/d7/d28/d2a/d43 0 2024-09-17T01:56:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/330: symlink df/d12/d1e/l74 0 2024-09-17T01:56:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:2/258: dwrite d3/d7/df/f29 [0,4194304] 0 2024-09-17T01:56:26.969 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:26.969 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:26.969 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:26.969+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:26.969 INFO:tasks.workunit.client.0.smithi063.stdout:4/329: creat de/d17/d1b/f69 x:0 0 0 2024-09-17T01:56:26.971 INFO:tasks.workunit.client.0.smithi063.stdout:8/219: write d1/df/f2d [3501389,116860] 0 2024-09-17T01:56:26.972 INFO:tasks.workunit.client.0.smithi063.stdout:5/348: getdents d6/d9/d13/d1d 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:5/349: write d6/d23/d29/d36/f5e [1365569,2728] 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/259: mkdir d3/d7/d38/d4d/d4f 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:8/220: getdents d1/d7/d28/d2a/d43 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:3/331: dwrite df/f63 [0,4194304] 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/233: dread d2/fb [0,4194304] 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/234: stat d2/d15/d2f 0 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/235: chown d2/d3/d27/d39/f3c 100078769 1 2024-09-17T01:56:26.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/236: truncate d2/d3/d27/d39/f4b 793122 0 2024-09-17T01:56:26.978 INFO:tasks.workunit.client.0.smithi063.stdout:2/260: rmdir d3/d7/df/d43 39 2024-09-17T01:56:26.978 INFO:tasks.workunit.client.0.smithi063.stdout:4/330: getdents de 0 2024-09-17T01:56:26.978 INFO:tasks.workunit.client.0.smithi063.stdout:2/261: mkdir d3/d2a/d50 0 2024-09-17T01:56:26.978 INFO:tasks.workunit.client.0.smithi063.stdout:5/350: truncate d6/d37/d19/f2c 2949054 0 2024-09-17T01:56:26.979 INFO:tasks.workunit.client.0.smithi063.stdout:2/262: write d3/d7/df/f19 [2947221,115760] 0 2024-09-17T01:56:26.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/229: sync 2024-09-17T01:56:26.980 INFO:tasks.workunit.client.0.smithi063.stdout:2/263: creat d3/d2c/f51 x:0 0 0 2024-09-17T01:56:26.980 INFO:tasks.workunit.client.0.smithi063.stdout:0/230: write d1/d3/db/d18/f30 [1934488,61216] 0 2024-09-17T01:56:26.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/264: rmdir d3/d2a/d50 0 2024-09-17T01:56:26.982 INFO:tasks.workunit.client.0.smithi063.stdout:4/331: dread f8 [0,4194304] 0 2024-09-17T01:56:26.982 INFO:tasks.workunit.client.0.smithi063.stdout:0/231: write d1/d3/db/f39 [5001327,996] 0 2024-09-17T01:56:26.983 INFO:tasks.workunit.client.0.smithi063.stdout:2/265: symlink d3/d7/d38/l52 0 2024-09-17T01:56:26.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/232: mkdir d1/d3/d1b/d50 0 2024-09-17T01:56:26.984 INFO:tasks.workunit.client.0.smithi063.stdout:2/266: rmdir d3/d7/df/d30 39 2024-09-17T01:56:26.985 INFO:tasks.workunit.client.0.smithi063.stdout:0/233: chown d1/f6 38 1 2024-09-17T01:56:26.985 INFO:tasks.workunit.client.0.smithi063.stdout:2/267: creat d3/d2c/f53 x:0 0 0 2024-09-17T01:56:26.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/268: readlink d3/l1b 0 2024-09-17T01:56:26.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/234: creat d1/d3/d32/f51 x:0 0 0 2024-09-17T01:56:26.987 INFO:tasks.workunit.client.0.smithi063.stdout:5/351: dwrite d6/f44 [0,4194304] 0 2024-09-17T01:56:26.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/269: rmdir d3/d2a 39 2024-09-17T01:56:26.988 INFO:tasks.workunit.client.0.smithi063.stdout:0/235: dread - d1/d3/d1b/f29 zero size 2024-09-17T01:56:26.990 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:26.993 INFO:tasks.workunit.client.0.smithi063.stdout:6/335: dread dc/d14/d19/d20/d32/d52/d5a/d43/f49 [0,4194304] 0 2024-09-17T01:56:26.993 INFO:tasks.workunit.client.0.smithi063.stdout:2/270: write d3/d7/df/f29 [2205177,99439] 0 2024-09-17T01:56:26.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/237: dread d2/f4 [4194304,4194304] 0 2024-09-17T01:56:26.994 INFO:tasks.workunit.client.0.smithi063.stdout:8/221: fsync d1/d7/d1d/f1f 0 2024-09-17T01:56:26.994 INFO:tasks.workunit.client.0.smithi063.stdout:1/413: dread d0/f14 [0,4194304] 0 2024-09-17T01:56:26.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/336: creat dc/d14/d19/d20/d32/d52/d5a/d43/f6d x:0 0 0 2024-09-17T01:56:26.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/414: truncate d0/d1c/f5c 1238535 0 2024-09-17T01:56:26.996 INFO:tasks.workunit.client.0.smithi063.stdout:5/352: truncate d6/d9/f28 2728362 0 2024-09-17T01:56:26.997 INFO:tasks.workunit.client.0.smithi063.stdout:8/222: rmdir d1/d7/d28/d2a/d37 39 2024-09-17T01:56:26.997 INFO:tasks.workunit.client.0.smithi063.stdout:6/337: fdatasync dc/d14/d18/f64 0 2024-09-17T01:56:26.997 INFO:tasks.workunit.client.0.smithi063.stdout:7/238: creat d2/d3/d27/d39/d40/f50 x:0 0 0 2024-09-17T01:56:27.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/415: write d0/d2d/d35/d3f/d81/f42 [2098431,32645] 0 2024-09-17T01:56:27.000 INFO:tasks.workunit.client.0.smithi063.stdout:8/223: write d1/d7/f39 [32831,39950] 0 2024-09-17T01:56:27.000 INFO:tasks.workunit.client.0.smithi063.stdout:8/224: readlink d1/l3 0 2024-09-17T01:56:27.001 INFO:tasks.workunit.client.0.smithi063.stdout:1/416: mkdir d0/d2d/d35/d3f/d94 0 2024-09-17T01:56:27.001 INFO:tasks.workunit.client.0.smithi063.stdout:6/338: dread - dc/d14/d19/d20/d32/d52/d5a/d43/f6d zero size 2024-09-17T01:56:27.001 INFO:tasks.workunit.client.0.smithi063.stdout:5/353: link d6/d37/l61 d6/d9/l6d 0 2024-09-17T01:56:27.001 INFO:tasks.workunit.client.0.smithi063.stdout:0/236: dwrite d1/d3/d1b/f49 [0,4194304] 0 2024-09-17T01:56:27.001 INFO:tasks.workunit.client.0.smithi063.stdout:4/332: dread de/f2f [0,4194304] 0 2024-09-17T01:56:27.002 INFO:tasks.workunit.client.0.smithi063.stdout:9/237: dread d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:27.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/225: mkdir d1/d7/d28/d2a/d44 0 2024-09-17T01:56:27.003 INFO:tasks.workunit.client.0.smithi063.stdout:1/417: read - d0/d2d/d35/d3f/d4e/f84 zero size 2024-09-17T01:56:27.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/237: chown d1/d3/db/l16 3 1 2024-09-17T01:56:27.004 INFO:tasks.workunit.client.0.smithi063.stdout:3/332: dread df/d12/f16 [0,4194304] 0 2024-09-17T01:56:27.004 INFO:tasks.workunit.client.0.smithi063.stdout:0/238: chown d1/d3 35 1 2024-09-17T01:56:27.005 INFO:tasks.workunit.client.0.smithi063.stdout:3/333: unlink df/f60 0 2024-09-17T01:56:27.005 INFO:tasks.workunit.client.0.smithi063.stdout:8/226: write d1/df/f33 [253788,37030] 0 2024-09-17T01:56:27.005 INFO:tasks.workunit.client.0.smithi063.stdout:0/239: symlink d1/d3/db/d18/d33/l52 0 2024-09-17T01:56:27.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/333: truncate de/f2f 517396 0 2024-09-17T01:56:27.006 INFO:tasks.workunit.client.0.smithi063.stdout:8/227: creat d1/d7/d28/f45 x:0 0 0 2024-09-17T01:56:27.007 INFO:tasks.workunit.client.0.smithi063.stdout:8/228: dread - d1/d7/d28/f42 zero size 2024-09-17T01:56:27.007 INFO:tasks.workunit.client.0.smithi063.stdout:8/229: chown d1/f38 0 1 2024-09-17T01:56:27.008 INFO:tasks.workunit.client.0.smithi063.stdout:2/271: dwrite d3/d2c/f51 [0,4194304] 0 2024-09-17T01:56:27.008 INFO:tasks.workunit.client.0.smithi063.stdout:3/334: rename df/f11 to df/d12/d43/d50/d58/f75 0 2024-09-17T01:56:27.008 INFO:tasks.workunit.client.0.smithi063.stdout:0/240: rmdir d1/d1f 39 2024-09-17T01:56:27.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/418: read d0/f8 [4601222,85248] 0 2024-09-17T01:56:27.008 INFO:tasks.workunit.client.0.smithi063.stdout:9/238: dread d9/de/f19 [0,4194304] 0 2024-09-17T01:56:27.009 INFO:tasks.workunit.client.0.smithi063.stdout:3/335: unlink df/f33 0 2024-09-17T01:56:27.010 INFO:tasks.workunit.client.0.smithi063.stdout:8/230: mknod d1/d7/d28/d2f/d41/c46 0 2024-09-17T01:56:27.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/272: creat d3/d2a/f54 x:0 0 0 2024-09-17T01:56:27.011 INFO:tasks.workunit.client.0.smithi063.stdout:6/339: dread dc/d14/d19/d20/d32/d52/d5a/f48 [0,4194304] 0 2024-09-17T01:56:27.011 INFO:tasks.workunit.client.0.smithi063.stdout:0/241: mkdir d1/d44/d53 0 2024-09-17T01:56:27.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/419: getdents d0/d2d 0 2024-09-17T01:56:27.012 INFO:tasks.workunit.client.0.smithi063.stdout:3/336: rename df/f20 to df/d12/d1e/d5e/f76 0 2024-09-17T01:56:27.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/231: truncate d1/d7/d28/f42 247550 0 2024-09-17T01:56:27.013 INFO:tasks.workunit.client.0.smithi063.stdout:5/354: dwrite d6/d9/d13/d1d/f24 [0,4194304] 0 2024-09-17T01:56:27.014 INFO:tasks.workunit.client.0.smithi063.stdout:5/355: mknod d6/d23/d29/c6e 0 2024-09-17T01:56:27.014 INFO:tasks.workunit.client.0.smithi063.stdout:1/420: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 x:0 0 0 2024-09-17T01:56:27.015 INFO:tasks.workunit.client.0.smithi063.stdout:1/421: stat d0/d1c/c27 0 2024-09-17T01:56:27.015 INFO:tasks.workunit.client.0.smithi063.stdout:5/356: creat d6/d37/f6f x:0 0 0 2024-09-17T01:56:27.016 INFO:tasks.workunit.client.0.smithi063.stdout:0/242: write d1/f6 [586585,47109] 0 2024-09-17T01:56:27.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/422: dread - d0/d2d/d35/d3f/f7b zero size 2024-09-17T01:56:27.017 INFO:tasks.workunit.client.0.smithi063.stdout:5/357: chown d6/d9/d13/d1d/l30 0 1 2024-09-17T01:56:27.018 INFO:tasks.workunit.client.0.smithi063.stdout:1/423: creat d0/d1c/f96 x:0 0 0 2024-09-17T01:56:27.018 INFO:tasks.workunit.client.0.smithi063.stdout:5/358: symlink d6/d23/d3a/l70 0 2024-09-17T01:56:27.018 INFO:tasks.workunit.client.0.smithi063.stdout:0/243: creat d1/d3/d1b/f54 x:0 0 0 2024-09-17T01:56:27.019 INFO:tasks.workunit.client.0.smithi063.stdout:5/359: write d6/f62 [5077259,94537] 0 2024-09-17T01:56:27.020 INFO:tasks.workunit.client.0.smithi063.stdout:3/337: dwrite df/d12/d43/f4d [0,4194304] 0 2024-09-17T01:56:27.020 INFO:tasks.workunit.client.0.smithi063.stdout:1/424: mkdir d0/d2d/d35/d8c/d97 0 2024-09-17T01:56:27.021 INFO:tasks.workunit.client.0.smithi063.stdout:5/360: chown d6/d9/d32/l59 1742888555 1 2024-09-17T01:56:27.021 INFO:tasks.workunit.client.0.smithi063.stdout:6/340: dwrite dc/d14/d19/d20/d32/d52/d5a/f26 [0,4194304] 0 2024-09-17T01:56:27.021 INFO:tasks.workunit.client.0.smithi063.stdout:3/338: symlink df/l77 0 2024-09-17T01:56:27.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/361: chown d6/d23/d29/d2b/d31/l53 105 1 2024-09-17T01:56:27.024 INFO:tasks.workunit.client.0.smithi063.stdout:1/425: rename d0/d2d/d35/d3f/d81/l4d to d0/d2d/d35/d8c/l98 0 2024-09-17T01:56:27.025 INFO:tasks.workunit.client.0.smithi063.stdout:5/362: creat d6/d9/d32/f71 x:0 0 0 2024-09-17T01:56:27.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/341: chown dc/d14/d19/d20/d32/d52/d5a/d43/f6d 2 1 2024-09-17T01:56:27.025 INFO:tasks.workunit.client.0.smithi063.stdout:1/426: dread - d0/d2d/d35/d3f/d4e/f84 zero size 2024-09-17T01:56:27.027 INFO:tasks.workunit.client.0.smithi063.stdout:7/239: sync 2024-09-17T01:56:27.027 INFO:tasks.workunit.client.0.smithi063.stdout:6/342: chown dc/f1e 3 1 2024-09-17T01:56:27.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/343: chown dc/d1b/d5e 2200415 1 2024-09-17T01:56:27.028 INFO:tasks.workunit.client.0.smithi063.stdout:3/339: dread df/d12/d1e/f4f [0,4194304] 0 2024-09-17T01:56:27.028 INFO:tasks.workunit.client.0.smithi063.stdout:7/240: symlink d2/d15/d2f/l51 0 2024-09-17T01:56:27.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/241: stat d2/d3/d27/d33 0 2024-09-17T01:56:27.029 INFO:tasks.workunit.client.0.smithi063.stdout:3/340: stat df/d12/d43/d50/d58/f75 0 2024-09-17T01:56:27.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/242: chown d2/df/f10 19425344 1 2024-09-17T01:56:27.030 INFO:tasks.workunit.client.0.smithi063.stdout:7/243: chown d2/df/f10 683926561 1 2024-09-17T01:56:27.030 INFO:tasks.workunit.client.0.smithi063.stdout:3/341: symlink df/d12/d1e/d53/l78 0 2024-09-17T01:56:27.031 INFO:tasks.workunit.client.0.smithi063.stdout:7/244: write d2/d3/d27/d39/f3c [1030706,22748] 0 2024-09-17T01:56:27.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/245: write d2/df/f10 [5375632,106910] 0 2024-09-17T01:56:27.032 INFO:tasks.workunit.client.0.smithi063.stdout:9/239: dread d9/de/d20/d1e/d2a/f35 [0,4194304] 0 2024-09-17T01:56:27.033 INFO:tasks.workunit.client.0.smithi063.stdout:9/240: chown d9/de/d20/d1e/d2a/d36 56313596 1 2024-09-17T01:56:27.034 INFO:tasks.workunit.client.0.smithi063.stdout:9/241: write d9/de/d20/f24 [7514,50854] 0 2024-09-17T01:56:27.034 INFO:tasks.workunit.client.0.smithi063.stdout:1/427: dwrite d0/d1c/f28 [0,4194304] 0 2024-09-17T01:56:27.036 INFO:tasks.workunit.client.0.smithi063.stdout:9/242: write d9/de/d20/d1e/f46 [923781,14226] 0 2024-09-17T01:56:27.036 INFO:tasks.workunit.client.0.smithi063.stdout:1/428: chown d0/d1c/c5b 31594938 1 2024-09-17T01:56:27.036 INFO:tasks.workunit.client.0.smithi063.stdout:1/429: stat d0/d2d/d35/l3b 0 2024-09-17T01:56:27.036 INFO:tasks.workunit.client.0.smithi063.stdout:9/243: mknod d9/d27/c54 0 2024-09-17T01:56:27.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/430: symlink d0/d93/l99 0 2024-09-17T01:56:27.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/334: sync 2024-09-17T01:56:27.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/232: sync 2024-09-17T01:56:27.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/233: write d1/df/f2d [4569109,63664] 0 2024-09-17T01:56:27.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/244: dwrite d9/de/d20/d1b/d25/f4e [0,4194304] 0 2024-09-17T01:56:27.047 INFO:tasks.workunit.client.0.smithi063.stdout:2/273: dread d3/f10 [4194304,4194304] 0 2024-09-17T01:56:27.047 INFO:tasks.workunit.client.0.smithi063.stdout:0/244: dread d1/d3/db/d4b/f22 [0,4194304] 0 2024-09-17T01:56:27.048 INFO:tasks.workunit.client.0.smithi063.stdout:2/274: chown d3/d2a/f54 853016 1 2024-09-17T01:56:27.048 INFO:tasks.workunit.client.0.smithi063.stdout:2/275: fdatasync f2 0 2024-09-17T01:56:27.049 INFO:tasks.workunit.client.0.smithi063.stdout:0/245: chown d1/d3/db/d18/d33/l52 845 1 2024-09-17T01:56:27.050 INFO:tasks.workunit.client.0.smithi063.stdout:2/276: write d3/d7/df/f2f [373825,31723] 0 2024-09-17T01:56:27.050 INFO:tasks.workunit.client.0.smithi063.stdout:2/277: read - d3/d2a/f54 zero size 2024-09-17T01:56:27.054 INFO:tasks.workunit.client.0.smithi063.stdout:4/335: dread de/f2e [0,4194304] 0 2024-09-17T01:56:27.054 INFO:tasks.workunit.client.0.smithi063.stdout:2/278: creat d3/d7/df/d43/f55 x:0 0 0 2024-09-17T01:56:27.055 INFO:tasks.workunit.client.0.smithi063.stdout:8/234: getdents d1/d7/d1d 0 2024-09-17T01:56:27.055 INFO:tasks.workunit.client.0.smithi063.stdout:9/245: link d9/de/d20/d1e/d2a/d36/c39 d9/d27/c55 0 2024-09-17T01:56:27.056 INFO:tasks.workunit.client.0.smithi063.stdout:7/246: dread d2/d3/d27/d39/f46 [0,4194304] 0 2024-09-17T01:56:27.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/336: creat de/d17/d1b/f6a x:0 0 0 2024-09-17T01:56:27.057 INFO:tasks.workunit.client.0.smithi063.stdout:7/247: mkdir d2/d15/d2f/d52 0 2024-09-17T01:56:27.058 INFO:tasks.workunit.client.0.smithi063.stdout:1/431: dread d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:27.060 INFO:tasks.workunit.client.0.smithi063.stdout:7/248: creat d2/df/f53 x:0 0 0 2024-09-17T01:56:27.060 INFO:tasks.workunit.client.0.smithi063.stdout:2/279: truncate d3/d7/df/d30/f3e 378234 0 2024-09-17T01:56:27.063 INFO:tasks.workunit.client.0.smithi063.stdout:2/280: write d3/d7/df/f2f [1076247,58784] 0 2024-09-17T01:56:27.063 INFO:tasks.workunit.client.0.smithi063.stdout:8/235: dwrite d1/d7/d1d/f3e [0,4194304] 0 2024-09-17T01:56:27.064 INFO:tasks.workunit.client.0.smithi063.stdout:9/246: dwrite d9/de/d20/d1e/d2a/f53 [0,4194304] 0 2024-09-17T01:56:27.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/337: dwrite de/d17/d1b/d67/f1d [0,4194304] 0 2024-09-17T01:56:27.066 INFO:tasks.workunit.client.0.smithi063.stdout:1/432: dwrite d0/f1b [0,4194304] 0 2024-09-17T01:56:27.068 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:27.073+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:27.073 INFO:tasks.workunit.client.0.smithi063.stdout:2/281: dread d3/d7/df/f14 [4194304,4194304] 0 2024-09-17T01:56:27.073 INFO:tasks.workunit.client.0.smithi063.stdout:5/363: sync 2024-09-17T01:56:27.075 INFO:tasks.workunit.client.0.smithi063.stdout:9/247: creat d9/f56 x:0 0 0 2024-09-17T01:56:27.076 INFO:tasks.workunit.client.0.smithi063.stdout:5/364: rename d6/d23/d29/d2b/l39 to d6/l72 0 2024-09-17T01:56:27.076 INFO:tasks.workunit.client.0.smithi063.stdout:8/236: unlink d1/d7/f32 0 2024-09-17T01:56:27.077 INFO:tasks.workunit.client.0.smithi063.stdout:5/365: write d6/f44 [898720,84323] 0 2024-09-17T01:56:27.078 INFO:tasks.workunit.client.0.smithi063.stdout:4/338: dwrite de/f4c [0,4194304] 0 2024-09-17T01:56:27.085 INFO:tasks.workunit.client.0.smithi063.stdout:5/366: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:56:27.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/248: dwrite d9/d27/f3a [0,4194304] 0 2024-09-17T01:56:27.086 INFO:tasks.workunit.client.0.smithi063.stdout:7/249: dread d2/d3/d27/f41 [0,4194304] 0 2024-09-17T01:56:27.086 INFO:tasks.workunit.client.0.smithi063.stdout:5/367: chown d6/d23/d29/d2b/c3d 5526 1 2024-09-17T01:56:27.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/339: dwrite de/d2d/d3c/f4b [4194304,4194304] 0 2024-09-17T01:56:27.087 INFO:tasks.workunit.client.0.smithi063.stdout:7/250: chown d2/d15/d2f/d47 6432240 1 2024-09-17T01:56:27.087 INFO:tasks.workunit.client.0.smithi063.stdout:5/368: chown d6/d9/f40 15803693 1 2024-09-17T01:56:27.090 INFO:tasks.workunit.client.0.smithi063.stdout:7/251: write d2/d3/d27/f2d [1518555,130097] 0 2024-09-17T01:56:27.090 INFO:tasks.workunit.client.0.smithi063.stdout:9/249: getdents d9/de/d20/d1e/d2a 0 2024-09-17T01:56:27.091 INFO:tasks.workunit.client.0.smithi063.stdout:9/250: stat d9/de/d20/c1a 0 2024-09-17T01:56:27.091 INFO:tasks.workunit.client.0.smithi063.stdout:9/251: mknod d9/de/c57 0 2024-09-17T01:56:27.092 INFO:tasks.workunit.client.0.smithi063.stdout:9/252: creat d9/de/d20/d37/f58 x:0 0 0 2024-09-17T01:56:27.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/253: write d9/de/d20/d37/f58 [444622,105538] 0 2024-09-17T01:56:27.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/254: mknod d9/de/d20/d37/c59 0 2024-09-17T01:56:27.095 INFO:tasks.workunit.client.0.smithi063.stdout:2/282: dread d3/f21 [0,4194304] 0 2024-09-17T01:56:27.095 INFO:tasks.workunit.client.0.smithi063.stdout:2/283: fsync d3/d2c/f53 0 2024-09-17T01:56:27.096 INFO:tasks.workunit.client.0.smithi063.stdout:2/284: creat d3/d7/d38/f56 x:0 0 0 2024-09-17T01:56:27.097 INFO:tasks.workunit.client.0.smithi063.stdout:7/252: dwrite d2/d3/d27/d39/f46 [0,4194304] 0 2024-09-17T01:56:27.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/255: truncate d9/de/d20/d1b/d25/f2b 4150066 0 2024-09-17T01:56:27.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/285: dread d3/d7/df/f29 [0,4194304] 0 2024-09-17T01:56:27.101 INFO:tasks.workunit.client.0.smithi063.stdout:9/256: chown d9/de/d20/d1e/d2a/f53 243063 1 2024-09-17T01:56:27.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/286: readlink d3/d7/df/l2e 0 2024-09-17T01:56:27.102 INFO:tasks.workunit.client.0.smithi063.stdout:2/287: readlink d3/d28/l3f 0 2024-09-17T01:56:27.102 INFO:tasks.workunit.client.0.smithi063.stdout:2/288: readlink d3/d7/df/d30/l37 0 2024-09-17T01:56:27.103 INFO:tasks.workunit.client.0.smithi063.stdout:4/340: dread de/d17/d1b/d67/f37 [0,4194304] 0 2024-09-17T01:56:27.103 INFO:tasks.workunit.client.0.smithi063.stdout:0/246: sync 2024-09-17T01:56:27.103 INFO:tasks.workunit.client.0.smithi063.stdout:3/342: sync 2024-09-17T01:56:27.104 INFO:tasks.workunit.client.0.smithi063.stdout:1/433: sync 2024-09-17T01:56:27.104 INFO:tasks.workunit.client.0.smithi063.stdout:6/344: sync 2024-09-17T01:56:27.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/289: rmdir d3/d7/d38/d4d/d4f 0 2024-09-17T01:56:27.104 INFO:tasks.workunit.client.0.smithi063.stdout:4/341: dread - de/d17/d1b/d67/f60 zero size 2024-09-17T01:56:27.105 INFO:tasks.workunit.client.0.smithi063.stdout:3/343: write df/d12/d2d/f4a [293142,25624] 0 2024-09-17T01:56:27.105 INFO:tasks.workunit.client.0.smithi063.stdout:0/247: write d1/d3/db/f3e [428911,64118] 0 2024-09-17T01:56:27.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/342: write de/d17/d1b/f6a [104485,24981] 0 2024-09-17T01:56:27.107 INFO:tasks.workunit.client.0.smithi063.stdout:6/345: symlink dc/d14/d19/d20/d32/d52/d5a/l6e 0 2024-09-17T01:56:27.108 INFO:tasks.workunit.client.0.smithi063.stdout:0/248: mknod d1/d3/db/d18/d33/c55 0 2024-09-17T01:56:27.110 INFO:tasks.workunit.client.0.smithi063.stdout:6/346: creat dc/d14/d19/f6f x:0 0 0 2024-09-17T01:56:27.111 INFO:tasks.workunit.client.0.smithi063.stdout:6/347: creat dc/d14/f70 x:0 0 0 2024-09-17T01:56:27.112 INFO:tasks.workunit.client.0.smithi063.stdout:1/434: dwrite d0/d1c/f28 [4194304,4194304] 0 2024-09-17T01:56:27.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/348: creat dc/d14/d19/d20/f71 x:0 0 0 2024-09-17T01:56:27.114 INFO:tasks.workunit.client.0.smithi063.stdout:6/349: write dc/d14/d19/f1a [4203504,20835] 0 2024-09-17T01:56:27.116 INFO:tasks.workunit.client.0.smithi063.stdout:8/237: dread d1/d7/d1d/f1e [0,4194304] 0 2024-09-17T01:56:27.118 INFO:tasks.workunit.client.0.smithi063.stdout:8/238: symlink d1/d7/d28/d2f/d41/l47 0 2024-09-17T01:56:27.120 INFO:tasks.workunit.client.0.smithi063.stdout:1/435: dwrite d0/d1c/f41 [0,4194304] 0 2024-09-17T01:56:27.120 INFO:tasks.workunit.client.0.smithi063.stdout:5/369: dread d6/d9/f45 [0,4194304] 0 2024-09-17T01:56:27.121 INFO:tasks.workunit.client.0.smithi063.stdout:8/239: mknod d1/d7/d28/c48 0 2024-09-17T01:56:27.123 INFO:tasks.workunit.client.0.smithi063.stdout:5/370: link d6/d23/d3f/f46 d6/d23/d29/d2b/d4f/f73 0 2024-09-17T01:56:27.124 INFO:tasks.workunit.client.0.smithi063.stdout:1/436: getdents d0/d2d/d35/d3f/d81/d50/d6c/d74 0 2024-09-17T01:56:27.124 INFO:tasks.workunit.client.0.smithi063.stdout:9/257: dread d9/de/d20/d1b/f2d [0,4194304] 0 2024-09-17T01:56:27.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/240: read d1/d7/d28/d2f/f30 [2011098,77952] 0 2024-09-17T01:56:27.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/371: write d6/f18 [2063161,44486] 0 2024-09-17T01:56:27.124 INFO:tasks.workunit.client.0.smithi063.stdout:1/437: mkdir d0/d93/d9a 0 2024-09-17T01:56:27.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/372: write d6/d37/f15 [2177356,126013] 0 2024-09-17T01:56:27.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/241: rename d1/df to d1/d7/d28/d2f/d41/d49 0 2024-09-17T01:56:27.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/290: dread d3/f6 [0,4194304] 0 2024-09-17T01:56:27.126 INFO:tasks.workunit.client.0.smithi063.stdout:1/438: symlink d0/d2d/d35/d3f/d81/d50/d6c/d74/l9b 0 2024-09-17T01:56:27.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/291: fsync d3/d2c/f53 0 2024-09-17T01:56:27.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/242: creat d1/d7/d28/d2f/d41/d49/f4a x:0 0 0 2024-09-17T01:56:27.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/439: creat d0/d2d/d35/d3f/d81/d50/f9c x:0 0 0 2024-09-17T01:56:27.127 INFO:tasks.workunit.client.0.smithi063.stdout:2/292: symlink d3/l57 0 2024-09-17T01:56:27.128 INFO:tasks.workunit.client.0.smithi063.stdout:1/440: mkdir d0/d2d/d35/d9d 0 2024-09-17T01:56:27.128 INFO:tasks.workunit.client.0.smithi063.stdout:2/293: creat d3/d7/df/d30/f58 x:0 0 0 2024-09-17T01:56:27.129 INFO:tasks.workunit.client.0.smithi063.stdout:9/258: dread d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:27.129 INFO:tasks.workunit.client.0.smithi063.stdout:2/294: creat d3/d2c/f59 x:0 0 0 2024-09-17T01:56:27.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/259: symlink d9/de/d20/d1e/d2a/d40/l5a 0 2024-09-17T01:56:27.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/260: readlink l3 0 2024-09-17T01:56:27.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/261: fdatasync d9/de/ff 0 2024-09-17T01:56:27.133 INFO:tasks.workunit.client.0.smithi063.stdout:5/373: dwrite d6/d23/d29/d2b/d4f/f73 [0,4194304] 0 2024-09-17T01:56:27.133 INFO:tasks.workunit.client.0.smithi063.stdout:3/344: dread fd [0,4194304] 0 2024-09-17T01:56:27.133 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:27.134 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:27.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/345: chown df/d28/c59 7 1 2024-09-17T01:56:27.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/243: dwrite d1/d7/d28/d2f/f30 [0,4194304] 0 2024-09-17T01:56:27.135 INFO:tasks.workunit.client.0.smithi063.stdout:3/346: write df/d12/d3a/f51 [643608,107985] 0 2024-09-17T01:56:27.136 INFO:tasks.workunit.client.0.smithi063.stdout:5/374: creat d6/f74 x:0 0 0 2024-09-17T01:56:27.136 INFO:tasks.workunit.client.0.smithi063.stdout:8/244: creat d1/d27/f4b x:0 0 0 2024-09-17T01:56:27.137 INFO:tasks.workunit.client.0.smithi063.stdout:8/245: chown d1/c2b 43 1 2024-09-17T01:56:27.137 INFO:tasks.workunit.client.0.smithi063.stdout:3/347: creat df/d12/f79 x:0 0 0 2024-09-17T01:56:27.138 INFO:tasks.workunit.client.0.smithi063.stdout:8/246: truncate d1/f38 8284549 0 2024-09-17T01:56:27.140 INFO:tasks.workunit.client.0.smithi063.stdout:8/247: link d1/d7/d28/d2f/d41/d49/f2d d1/d7/f4c 0 2024-09-17T01:56:27.143 INFO:tasks.workunit.client.0.smithi063.stdout:8/248: getdents d1/d7/d28/d2f/d41 0 2024-09-17T01:56:27.143 INFO:tasks.workunit.client.0.smithi063.stdout:5/375: dwrite d6/d23/d3a/f4c [0,4194304] 0 2024-09-17T01:56:27.144 INFO:tasks.workunit.client.0.smithi063.stdout:5/376: read d6/d23/d3a/f4c [3515740,36605] 0 2024-09-17T01:56:27.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/249: unlink d1/d7/d1d/f1e 0 2024-09-17T01:56:27.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/250: rename d1/d7/d28/d2a/d43 to d1/d7/d28/d2a/d4d 0 2024-09-17T01:56:27.146 INFO:tasks.workunit.client.0.smithi063.stdout:8/251: rmdir d1/d27 39 2024-09-17T01:56:27.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/252: write d1/d7/d1d/f20 [2394356,4713] 0 2024-09-17T01:56:27.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/377: dread d6/d23/f2a [0,4194304] 0 2024-09-17T01:56:27.148 INFO:tasks.workunit.client.0.smithi063.stdout:5/378: stat d6/d23/d29/d2b/d4f/f52 0 2024-09-17T01:56:27.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/379: creat d6/d37/d19/f75 x:0 0 0 2024-09-17T01:56:27.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/253: creat d1/d7/f4e x:0 0 0 2024-09-17T01:56:27.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/380: read - d6/d37/d19/f75 zero size 2024-09-17T01:56:27.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/381: rmdir d6/d9/d13 39 2024-09-17T01:56:27.150 INFO:tasks.workunit.client.0.smithi063.stdout:5/382: mkdir d6/d37/d19/d76 0 2024-09-17T01:56:27.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/254: link d1/d7/d1d/c2c d1/d7/d28/d2a/d37/c4f 0 2024-09-17T01:56:27.151 INFO:tasks.workunit.client.0.smithi063.stdout:5/383: write d6/f74 [81537,69637] 0 2024-09-17T01:56:27.153 INFO:tasks.workunit.client.0.smithi063.stdout:0/249: dread d1/d3/d1b/f2a [0,4194304] 0 2024-09-17T01:56:27.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/250: rmdir d1/d3/db/d18 39 2024-09-17T01:56:27.154 INFO:tasks.workunit.client.0.smithi063.stdout:8/255: dread d1/d7/d1d/f20 [0,4194304] 0 2024-09-17T01:56:27.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/256: chown d1/d7/f4e 19244 1 2024-09-17T01:56:27.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:27.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/295: dread d3/d7/df/d43/f3b [0,4194304] 0 2024-09-17T01:56:27.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/296: chown d3/c27 0 1 2024-09-17T01:56:27.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/297: mkdir d3/d7/df/d5a 0 2024-09-17T01:56:27.161 INFO:tasks.workunit.client.0.smithi063.stdout:2/298: stat d3/d7/f26 0 2024-09-17T01:56:27.162 INFO:tasks.workunit.client.0.smithi063.stdout:0/251: dread d1/d3/db/f13 [0,4194304] 0 2024-09-17T01:56:27.163 INFO:tasks.workunit.client.0.smithi063.stdout:9/262: dread f7 [0,4194304] 0 2024-09-17T01:56:27.163 INFO:tasks.workunit.client.0.smithi063.stdout:3/348: dread df/d12/d1e/d5e/f76 [0,4194304] 0 2024-09-17T01:56:27.164 INFO:tasks.workunit.client.0.smithi063.stdout:3/349: chown df/d12/d43/d50/f6a 17127 1 2024-09-17T01:56:27.165 INFO:tasks.workunit.client.0.smithi063.stdout:3/350: write df/d12/d43/d50/f5d [3177224,10110] 0 2024-09-17T01:56:27.165 INFO:tasks.workunit.client.0.smithi063.stdout:7/253: sync 2024-09-17T01:56:27.166 INFO:tasks.workunit.client.0.smithi063.stdout:1/441: sync 2024-09-17T01:56:27.166 INFO:tasks.workunit.client.0.smithi063.stdout:6/350: sync 2024-09-17T01:56:27.166 INFO:tasks.workunit.client.0.smithi063.stdout:4/343: sync 2024-09-17T01:56:27.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/351: chown df/d12/d2d/f3c 12 1 2024-09-17T01:56:27.166 INFO:tasks.workunit.client.0.smithi063.stdout:7/254: fdatasync d2/df/f11 0 2024-09-17T01:56:27.167 INFO:tasks.workunit.client.0.smithi063.stdout:3/352: mkdir df/d12/d3a/d7a 0 2024-09-17T01:56:27.168 INFO:tasks.workunit.client.0.smithi063.stdout:7/255: stat d2/d3/d27/d39/c4a 0 2024-09-17T01:56:27.168 INFO:tasks.workunit.client.0.smithi063.stdout:6/351: rename dc/d14/d19/d20/d32/d52/d5a/f48 to dc/d14/d19/d20/d32/f72 0 2024-09-17T01:56:27.169 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:27.169+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:27.169 INFO:tasks.workunit.client.0.smithi063.stdout:3/353: chown df/d12/d1e/d5e/l6f 14621289 1 2024-09-17T01:56:27.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/263: dwrite d9/de/ff [4194304,4194304] 0 2024-09-17T01:56:27.170 INFO:tasks.workunit.client.0.smithi063.stdout:6/352: truncate dc/d14/d2f/f51 473200 0 2024-09-17T01:56:27.170 INFO:tasks.workunit.client.0.smithi063.stdout:3/354: creat df/d12/d1e/d39/f7b x:0 0 0 2024-09-17T01:56:27.170 INFO:tasks.workunit.client.0.smithi063.stdout:4/344: dread f8 [0,4194304] 0 2024-09-17T01:56:27.172 INFO:tasks.workunit.client.0.smithi063.stdout:9/264: creat d9/f5b x:0 0 0 2024-09-17T01:56:27.174 INFO:tasks.workunit.client.0.smithi063.stdout:3/355: rename df/d12/d2d/d2f/l5f to df/l7c 0 2024-09-17T01:56:27.174 INFO:tasks.workunit.client.0.smithi063.stdout:6/353: link dc/d14/d19/d20/d32/d52/d5a/c3e dc/d14/d19/d20/d66/c73 0 2024-09-17T01:56:27.174 INFO:tasks.workunit.client.0.smithi063.stdout:4/345: creat de/d17/d1b/f6b x:0 0 0 2024-09-17T01:56:27.174 INFO:tasks.workunit.client.0.smithi063.stdout:6/354: fsync dc/f1e 0 2024-09-17T01:56:27.174 INFO:tasks.workunit.client.0.smithi063.stdout:7/256: dwrite d2/df/f11 [4194304,4194304] 0 2024-09-17T01:56:27.175 INFO:tasks.workunit.client.0.smithi063.stdout:7/257: chown d2/d3/d17 0 1 2024-09-17T01:56:27.175 INFO:tasks.workunit.client.0.smithi063.stdout:4/346: symlink de/d2d/d52/l6c 0 2024-09-17T01:56:27.176 INFO:tasks.workunit.client.0.smithi063.stdout:3/356: link df/d12/d43/f4d df/d12/d2d/f7d 0 2024-09-17T01:56:27.176 INFO:tasks.workunit.client.0.smithi063.stdout:4/347: chown de/d17/d1b/l3a 953 1 2024-09-17T01:56:27.176 INFO:tasks.workunit.client.0.smithi063.stdout:6/355: truncate dc/d14/d19/d20/d32/f54 1302503 0 2024-09-17T01:56:27.176 INFO:tasks.workunit.client.0.smithi063.stdout:6/356: readlink dc/d14/d18/l37 0 2024-09-17T01:56:27.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/357: mknod df/d12/d3a/d7a/c7e 0 2024-09-17T01:56:27.177 INFO:tasks.workunit.client.0.smithi063.stdout:4/348: fdatasync de/d17/d1b/d67/d28/f65 0 2024-09-17T01:56:27.177 INFO:tasks.workunit.client.0.smithi063.stdout:6/357: mkdir dc/d14/d18/d74 0 2024-09-17T01:56:27.178 INFO:tasks.workunit.client.0.smithi063.stdout:3/358: creat df/d12/d1e/d53/f7f x:0 0 0 2024-09-17T01:56:27.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/349: write de/d17/d1b/f6b [851508,96018] 0 2024-09-17T01:56:27.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/358: stat dc/d14/d19/d20/d32/d52/d5a/f26 0 2024-09-17T01:56:27.179 INFO:tasks.workunit.client.0.smithi063.stdout:3/359: write df/d12/d30/f32 [4307020,32666] 0 2024-09-17T01:56:27.179 INFO:tasks.workunit.client.0.smithi063.stdout:6/359: mknod dc/d14/d18/d74/c75 0 2024-09-17T01:56:27.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/360: fsync dc/d14/d2f/f51 0 2024-09-17T01:56:27.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/360: creat df/d12/f80 x:0 0 0 2024-09-17T01:56:27.181 INFO:tasks.workunit.client.0.smithi063.stdout:6/361: write dc/d14/d19/f1c [4046188,63348] 0 2024-09-17T01:56:27.181 INFO:tasks.workunit.client.0.smithi063.stdout:3/361: readlink df/l77 0 2024-09-17T01:56:27.182 INFO:tasks.workunit.client.0.smithi063.stdout:6/362: truncate dc/d1b/f41 6335 0 2024-09-17T01:56:27.184 INFO:tasks.workunit.client.0.smithi063.stdout:3/362: read fc [3075533,57868] 0 2024-09-17T01:56:27.185 INFO:tasks.workunit.client.0.smithi063.stdout:3/363: dread - df/d12/d43/d50/d58/f6b zero size 2024-09-17T01:56:27.186 INFO:tasks.workunit.client.0.smithi063.stdout:1/442: dread d0/d2d/d35/f7f [0,4194304] 0 2024-09-17T01:56:27.186 INFO:tasks.workunit.client.0.smithi063.stdout:3/364: truncate df/d12/d43/d50/f6a 345697 0 2024-09-17T01:56:27.187 INFO:tasks.workunit.client.0.smithi063.stdout:8/257: write d1/f16 [3458062,39964] 0 2024-09-17T01:56:27.188 INFO:tasks.workunit.client.0.smithi063.stdout:6/363: dwrite dc/d14/d19/d20/f71 [0,4194304] 0 2024-09-17T01:56:27.189 INFO:tasks.workunit.client.0.smithi063.stdout:6/364: fdatasync dc/d14/d19/d20/d32/d52/d5a/f40 0 2024-09-17T01:56:27.191 INFO:tasks.workunit.client.0.smithi063.stdout:1/443: truncate d0/d2d/d35/d3f/d81/d50/f54 3858511 0 2024-09-17T01:56:27.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/258: creat d1/d7/d28/f50 x:0 0 0 2024-09-17T01:56:27.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/259: fdatasync d1/d27/f4b 0 2024-09-17T01:56:27.193 INFO:tasks.workunit.client.0.smithi063.stdout:1/444: truncate d0/d1c/f1d 5168466 0 2024-09-17T01:56:27.193 INFO:tasks.workunit.client.0.smithi063.stdout:2/299: dwrite d3/d7/df/f14 [0,4194304] 0 2024-09-17T01:56:27.194 INFO:tasks.workunit.client.0.smithi063.stdout:2/300: readlink d3/d28/l3f 0 2024-09-17T01:56:27.195 INFO:tasks.workunit.client.0.smithi063.stdout:2/301: fsync d3/d7/f34 0 2024-09-17T01:56:27.195 INFO:tasks.workunit.client.0.smithi063.stdout:9/265: truncate d9/de/ff 4882218 0 2024-09-17T01:56:27.195 INFO:tasks.workunit.client.0.smithi063.stdout:0/252: dwrite d1/f19 [4194304,4194304] 0 2024-09-17T01:56:27.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/266: chown d9/de/d20/d37/d42 24687 1 2024-09-17T01:56:27.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/267: chown d9 221 1 2024-09-17T01:56:27.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/253: mkdir d1/d3/db/d4b/d2f/d56 0 2024-09-17T01:56:27.199 INFO:tasks.workunit.client.0.smithi063.stdout:0/254: creat d1/d3/db/d4b/d2f/d56/f57 x:0 0 0 2024-09-17T01:56:27.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/365: truncate df/f26 503656 0 2024-09-17T01:56:27.201 INFO:tasks.workunit.client.0.smithi063.stdout:6/365: truncate dc/d14/d19/d20/f23 6128401 0 2024-09-17T01:56:27.201 INFO:tasks.workunit.client.0.smithi063.stdout:0/255: chown d1/d3/db/d18/l46 195297 1 2024-09-17T01:56:27.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/384: sync 2024-09-17T01:56:27.203 INFO:tasks.workunit.client.0.smithi063.stdout:4/350: sync 2024-09-17T01:56:27.203 INFO:tasks.workunit.client.0.smithi063.stdout:2/302: dwrite d3/d7/f34 [0,4194304] 0 2024-09-17T01:56:27.205 INFO:tasks.workunit.client.0.smithi063.stdout:8/260: dwrite d1/d7/d28/d2f/d41/d49/f4a [0,4194304] 0 2024-09-17T01:56:27.205 INFO:tasks.workunit.client.0.smithi063.stdout:3/366: write df/d12/d1e/f27 [3794166,56356] 0 2024-09-17T01:56:27.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/268: dwrite d9/d27/f3b [0,4194304] 0 2024-09-17T01:56:27.207 INFO:tasks.workunit.client.0.smithi063.stdout:2/303: write d3/d2c/f35 [1033908,42161] 0 2024-09-17T01:56:27.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/366: read dc/d14/d19/d20/d32/f72 [617923,12234] 0 2024-09-17T01:56:27.208 INFO:tasks.workunit.client.0.smithi063.stdout:3/367: readlink df/d12/l18 0 2024-09-17T01:56:27.210 INFO:tasks.workunit.client.0.smithi063.stdout:6/367: truncate dc/f44 356121 0 2024-09-17T01:56:27.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/368: dread - df/d12/d2d/f3c zero size 2024-09-17T01:56:27.210 INFO:tasks.workunit.client.0.smithi063.stdout:9/269: creat d9/de/d20/d1e/d2a/d40/f5c x:0 0 0 2024-09-17T01:56:27.211 INFO:tasks.workunit.client.0.smithi063.stdout:5/385: creat d6/d23/f77 x:0 0 0 2024-09-17T01:56:27.211 INFO:tasks.workunit.client.0.smithi063.stdout:0/256: dwrite d1/d3/db/f13 [0,4194304] 0 2024-09-17T01:56:27.211 INFO:tasks.workunit.client.0.smithi063.stdout:2/304: getdents d3/d7/df/d5a 0 2024-09-17T01:56:27.213 INFO:tasks.workunit.client.0.smithi063.stdout:9/270: write d9/de/d20/d1b/d25/f4e [3961337,99728] 0 2024-09-17T01:56:27.215 INFO:tasks.workunit.client.0.smithi063.stdout:6/368: rename dc/d14/d18/d74/c75 to dc/d14/d19/d20/c76 0 2024-09-17T01:56:27.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/351: dwrite de/d2d/f33 [0,4194304] 0 2024-09-17T01:56:27.216 INFO:tasks.workunit.client.0.smithi063.stdout:4/352: readlink de/l66 0 2024-09-17T01:56:27.216 INFO:tasks.workunit.client.0.smithi063.stdout:8/261: dwrite d1/d27/f4b [0,4194304] 0 2024-09-17T01:56:27.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/386: rename d6/d9/d13/f5d to d6/d37/d19/d68/f78 0 2024-09-17T01:56:27.218 INFO:tasks.workunit.client.0.smithi063.stdout:4/353: rename de/d2d/d52 to de/d2d/d52/d6d 22 2024-09-17T01:56:27.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/387: chown d6/d9/d13/d1d 0 1 2024-09-17T01:56:27.219 INFO:tasks.workunit.client.0.smithi063.stdout:6/369: creat dc/d14/d19/d20/d32/d52/d5a/f77 x:0 0 0 2024-09-17T01:56:27.219 INFO:tasks.workunit.client.0.smithi063.stdout:7/258: dread d2/df/f10 [0,4194304] 0 2024-09-17T01:56:27.220 INFO:tasks.workunit.client.0.smithi063.stdout:5/388: readlink d6/d35/l5f 0 2024-09-17T01:56:27.223 INFO:tasks.workunit.client.0.smithi063.stdout:2/305: truncate d3/f4 70966 0 2024-09-17T01:56:27.223 INFO:tasks.workunit.client.0.smithi063.stdout:5/389: mkdir d6/d37/d79 0 2024-09-17T01:56:27.231 INFO:tasks.workunit.client.0.smithi063.stdout:2/306: creat d3/d7/f5b x:0 0 0 2024-09-17T01:56:27.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/271: dwrite d9/de/d20/f24 [0,4194304] 0 2024-09-17T01:56:27.235 INFO:tasks.workunit.client.0.smithi063.stdout:8/262: dwrite d1/d7/d28/f50 [0,4194304] 0 2024-09-17T01:56:27.235 INFO:tasks.workunit.client.0.smithi063.stdout:3/369: dwrite df/d12/f16 [0,4194304] 0 2024-09-17T01:56:27.235 INFO:tasks.workunit.client.0.smithi063.stdout:0/257: dwrite d1/d3/d1b/f49 [0,4194304] 0 2024-09-17T01:56:27.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/354: dwrite de/f14 [0,4194304] 0 2024-09-17T01:56:27.236 INFO:tasks.workunit.client.0.smithi063.stdout:2/307: write d3/f10 [6039637,85475] 0 2024-09-17T01:56:27.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/370: dwrite dc/f1e [0,4194304] 0 2024-09-17T01:56:27.238 INFO:tasks.workunit.client.0.smithi063.stdout:9/272: stat d9/de/d20/l15 0 2024-09-17T01:56:27.239 INFO:tasks.workunit.client.0.smithi063.stdout:4/355: rmdir de/d2d/d52 39 2024-09-17T01:56:27.240 INFO:tasks.workunit.client.0.smithi063.stdout:7/259: dwrite d2/d3/d27/d39/f42 [4194304,4194304] 0 2024-09-17T01:56:27.240 INFO:tasks.workunit.client.0.smithi063.stdout:2/308: creat d3/d28/f5c x:0 0 0 2024-09-17T01:56:27.240 INFO:tasks.workunit.client.0.smithi063.stdout:0/258: stat d1/d3/db/d4b/f26 0 2024-09-17T01:56:27.241 INFO:tasks.workunit.client.0.smithi063.stdout:7/260: chown d2/df/f53 40 1 2024-09-17T01:56:27.243 INFO:tasks.workunit.client.0.smithi063.stdout:6/371: creat dc/d14/d19/d20/d32/d68/f78 x:0 0 0 2024-09-17T01:56:27.244 INFO:tasks.workunit.client.0.smithi063.stdout:9/273: truncate d9/de/d20/d1b/d25/f2b 3727112 0 2024-09-17T01:56:27.244 INFO:tasks.workunit.client.0.smithi063.stdout:7/261: rename d2/d15 to d2/d15/d2f/d54 22 2024-09-17T01:56:27.244 INFO:tasks.workunit.client.0.smithi063.stdout:7/262: chown d2/d3/d17/c21 1271 1 2024-09-17T01:56:27.248 INFO:tasks.workunit.client.0.smithi063.stdout:7/263: symlink d2/d15/d2f/l55 0 2024-09-17T01:56:27.248 INFO:tasks.workunit.client.0.smithi063.stdout:3/370: dwrite df/d12/f80 [0,4194304] 0 2024-09-17T01:56:27.248 INFO:tasks.workunit.client.0.smithi063.stdout:6/372: rename dc/d14/d19/d20/d32/f72 to dc/d1b/d5e/f79 0 2024-09-17T01:56:27.249 INFO:tasks.workunit.client.0.smithi063.stdout:0/259: truncate d1/f4d 432474 0 2024-09-17T01:56:27.249 INFO:tasks.workunit.client.0.smithi063.stdout:1/445: dread d0/d2d/d35/d3f/d4e/d66/f69 [0,4194304] 0 2024-09-17T01:56:27.250 INFO:tasks.workunit.client.0.smithi063.stdout:2/309: truncate d3/f6 5768771 0 2024-09-17T01:56:27.250 INFO:tasks.workunit.client.0.smithi063.stdout:0/260: fdatasync f0 0 2024-09-17T01:56:27.251 INFO:tasks.workunit.client.0.smithi063.stdout:7/264: mkdir d2/d3/d22/d56 0 2024-09-17T01:56:27.251 INFO:tasks.workunit.client.0.smithi063.stdout:3/371: dread - df/d12/d1e/f57 zero size 2024-09-17T01:56:27.252 INFO:tasks.workunit.client.0.smithi063.stdout:1/446: mkdir d0/d93/d9e 0 2024-09-17T01:56:27.252 INFO:tasks.workunit.client.0.smithi063.stdout:8/263: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:27.252 INFO:tasks.workunit.client.0.smithi063.stdout:7/265: dread - d2/d3/d27/d39/f4e zero size 2024-09-17T01:56:27.252 INFO:tasks.workunit.client.0.smithi063.stdout:2/310: readlink d3/l1b 0 2024-09-17T01:56:27.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/274: mknod d9/de/d20/d1e/d2a/d40/d4f/c5d 0 2024-09-17T01:56:27.253 INFO:tasks.workunit.client.0.smithi063.stdout:2/311: symlink d3/d2c/l5d 0 2024-09-17T01:56:27.253 INFO:tasks.workunit.client.0.smithi063.stdout:8/264: creat d1/d7/d28/f51 x:0 0 0 2024-09-17T01:56:27.254 INFO:tasks.workunit.client.0.smithi063.stdout:2/312: rmdir d3 39 2024-09-17T01:56:27.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/275: fdatasync d9/de/d20/d1b/f2d 0 2024-09-17T01:56:27.255 INFO:tasks.workunit.client.0.smithi063.stdout:2/313: mknod d3/d7/d38/c5e 0 2024-09-17T01:56:27.256 INFO:tasks.workunit.client.0.smithi063.stdout:8/265: chown d1/d7/d28/d2f/d41/d49/f23 4 1 2024-09-17T01:56:27.256 INFO:tasks.workunit.client.0.smithi063.stdout:9/276: unlink d9/de/d20/d1e/d2a/d40/d4f/c5d 0 2024-09-17T01:56:27.259 INFO:tasks.workunit.client.0.smithi063.stdout:9/277: creat d9/de/d20/d1e/d2a/d36/f5e x:0 0 0 2024-09-17T01:56:27.261 INFO:tasks.workunit.client.0.smithi063.stdout:7/266: dwrite d2/d3/d27/d39/f46 [0,4194304] 0 2024-09-17T01:56:27.262 INFO:tasks.workunit.client.0.smithi063.stdout:7/267: write d2/f23 [4249996,104711] 0 2024-09-17T01:56:27.262 INFO:tasks.workunit.client.0.smithi063.stdout:7/268: read d2/fb [7407200,35490] 0 2024-09-17T01:56:27.264 INFO:tasks.workunit.client.0.smithi063.stdout:2/314: dwrite d3/f21 [0,4194304] 0 2024-09-17T01:56:27.264 INFO:tasks.workunit.client.0.smithi063.stdout:2/315: dread - d3/d2c/f59 zero size 2024-09-17T01:56:27.265 INFO:tasks.workunit.client.0.smithi063.stdout:9/278: rename d9/cb to d9/de/d20/d1e/d2a/d40/d4f/c5f 0 2024-09-17T01:56:27.270 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:27.273+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:27.273 INFO:tasks.workunit.client.0.smithi063.stdout:8/266: read d1/d7/d1d/f1f [14087,15994] 0 2024-09-17T01:56:27.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/316: write d3/d7/f34 [4670271,108278] 0 2024-09-17T01:56:27.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/356: dread de/f2f [0,4194304] 0 2024-09-17T01:56:27.274 INFO:tasks.workunit.client.0.smithi063.stdout:5/390: dread d6/d23/f58 [0,4194304] 0 2024-09-17T01:56:27.276 INFO:tasks.workunit.client.0.smithi063.stdout:5/391: fdatasync d6/d23/d3a/f4c 0 2024-09-17T01:56:27.277 INFO:tasks.workunit.client.0.smithi063.stdout:5/392: creat d6/d23/d69/f7a x:0 0 0 2024-09-17T01:56:27.277 INFO:tasks.workunit.client.0.smithi063.stdout:9/279: dwrite d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:27.277 INFO:tasks.workunit.client.0.smithi063.stdout:6/373: sync 2024-09-17T01:56:27.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/447: sync 2024-09-17T01:56:27.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/448: fdatasync d0/d1c/f5c 0 2024-09-17T01:56:27.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/374: dread - dc/d14/d19/f3d zero size 2024-09-17T01:56:27.279 INFO:tasks.workunit.client.0.smithi063.stdout:5/393: chown d6/d23/d29/d2b/l5c 1139673 1 2024-09-17T01:56:27.280 INFO:tasks.workunit.client.0.smithi063.stdout:4/357: truncate de/f4c 4449410 0 2024-09-17T01:56:27.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/394: symlink d6/d23/d3f/l7b 0 2024-09-17T01:56:27.280 INFO:tasks.workunit.client.0.smithi063.stdout:6/375: creat dc/d14/d19/d20/d32/d68/f7a x:0 0 0 2024-09-17T01:56:27.281 INFO:tasks.workunit.client.0.smithi063.stdout:4/358: chown de/f38 19 1 2024-09-17T01:56:27.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/449: getdents d0/d2d/d35/d3f/d81 0 2024-09-17T01:56:27.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/317: dwrite d3/d7/df/f14 [0,4194304] 0 2024-09-17T01:56:27.282 INFO:tasks.workunit.client.0.smithi063.stdout:3/372: sync 2024-09-17T01:56:27.283 INFO:tasks.workunit.client.0.smithi063.stdout:6/376: creat dc/d14/d19/f7b x:0 0 0 2024-09-17T01:56:27.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/280: dread d9/de/f19 [0,4194304] 0 2024-09-17T01:56:27.284 INFO:tasks.workunit.client.0.smithi063.stdout:6/377: chown dc/d14/d19/d20/d66 754 1 2024-09-17T01:56:27.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/281: fdatasync d9/f56 0 2024-09-17T01:56:27.285 INFO:tasks.workunit.client.0.smithi063.stdout:8/267: dwrite d1/d7/d28/d2f/d41/d49/f3b [0,4194304] 0 2024-09-17T01:56:27.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/268: stat d1/d7/d28/d2f/d41/d49 0 2024-09-17T01:56:27.286 INFO:tasks.workunit.client.0.smithi063.stdout:3/373: creat df/d12/d43/d50/d58/f81 x:0 0 0 2024-09-17T01:56:27.287 INFO:tasks.workunit.client.0.smithi063.stdout:6/378: mknod dc/d14/d65/c7c 0 2024-09-17T01:56:27.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/282: creat d9/de/d20/d37/d42/f60 x:0 0 0 2024-09-17T01:56:27.287 INFO:tasks.workunit.client.0.smithi063.stdout:6/379: readlink l2 0 2024-09-17T01:56:27.287 INFO:tasks.workunit.client.0.smithi063.stdout:5/395: dread d6/d23/d3f/f46 [0,4194304] 0 2024-09-17T01:56:27.288 INFO:tasks.workunit.client.0.smithi063.stdout:9/283: creat d9/de/d20/d37/f61 x:0 0 0 2024-09-17T01:56:27.288 INFO:tasks.workunit.client.0.smithi063.stdout:3/374: symlink df/d12/d3a/d7a/l82 0 2024-09-17T01:56:27.289 INFO:tasks.workunit.client.0.smithi063.stdout:6/380: fdatasync dc/d14/d19/f53 0 2024-09-17T01:56:27.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/359: dread de/d17/d1b/f6b [0,4194304] 0 2024-09-17T01:56:27.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/375: dread df/d12/d1e/f24 [0,4194304] 0 2024-09-17T01:56:27.292 INFO:tasks.workunit.client.0.smithi063.stdout:9/284: chown d9/de/d20/d1e/d2a/d40/d4f/c5f 7449604 1 2024-09-17T01:56:27.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/360: fdatasync de/d17/d36/f5b 0 2024-09-17T01:56:27.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/381: write dc/f4e [1052955,23460] 0 2024-09-17T01:56:27.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/376: mkdir df/d83 0 2024-09-17T01:56:27.293 INFO:tasks.workunit.client.0.smithi063.stdout:1/450: dwrite d0/d2d/d35/f7f [0,4194304] 0 2024-09-17T01:56:27.296 INFO:tasks.workunit.client.0.smithi063.stdout:4/361: fsync de/d2d/d52/f5f 0 2024-09-17T01:56:27.297 INFO:tasks.workunit.client.0.smithi063.stdout:1/451: rmdir d0/d2d/d35/d3f/d81/d50/d8b 39 2024-09-17T01:56:27.297 INFO:tasks.workunit.client.0.smithi063.stdout:8/269: dwrite d1/d7/d1d/f1f [0,4194304] 0 2024-09-17T01:56:27.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/382: truncate dc/d14/d19/d20/d32/d68/f78 550403 0 2024-09-17T01:56:27.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/396: dwrite d6/d9/d32/f71 [0,4194304] 0 2024-09-17T01:56:27.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/362: write de/f14 [5362525,63195] 0 2024-09-17T01:56:27.302 INFO:tasks.workunit.client.0.smithi063.stdout:9/285: dread d9/de/d20/d1e/d2a/f53 [0,4194304] 0 2024-09-17T01:56:27.303 INFO:tasks.workunit.client.0.smithi063.stdout:8/270: creat d1/d7/d28/d2f/d41/f52 x:0 0 0 2024-09-17T01:56:27.303 INFO:tasks.workunit.client.0.smithi063.stdout:6/383: chown dc/d14/d19/d20/d32/d52/c58 46830750 1 2024-09-17T01:56:27.303 INFO:tasks.workunit.client.0.smithi063.stdout:0/261: dread d1/d3/d1b/f38 [0,4194304] 0 2024-09-17T01:56:27.306 INFO:tasks.workunit.client.0.smithi063.stdout:4/363: rename de/d17/d36/c59 to de/d17/c6e 0 2024-09-17T01:56:27.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/397: rename d6/d23/d3f/f46 to d6/d37/d79/f7c 0 2024-09-17T01:56:27.308 INFO:tasks.workunit.client.0.smithi063.stdout:6/384: creat dc/d14/d65/f7d x:0 0 0 2024-09-17T01:56:27.309 INFO:tasks.workunit.client.0.smithi063.stdout:8/271: mkdir d1/d7/d28/d2a/d53 0 2024-09-17T01:56:27.309 INFO:tasks.workunit.client.0.smithi063.stdout:4/364: write de/d2d/f4a [768130,102688] 0 2024-09-17T01:56:27.310 INFO:tasks.workunit.client.0.smithi063.stdout:5/398: unlink d6/d37/f15 0 2024-09-17T01:56:27.310 INFO:tasks.workunit.client.0.smithi063.stdout:0/262: link d1/d3/d1b/f54 d1/d1f/f58 0 2024-09-17T01:56:27.311 INFO:tasks.workunit.client.0.smithi063.stdout:3/377: dwrite df/d12/d2d/f3c [0,4194304] 0 2024-09-17T01:56:27.311 INFO:tasks.workunit.client.0.smithi063.stdout:9/286: rename d9/l52 to d9/de/d20/d37/d42/d4c/l62 0 2024-09-17T01:56:27.311 INFO:tasks.workunit.client.0.smithi063.stdout:8/272: mknod d1/d27/c54 0 2024-09-17T01:56:27.312 INFO:tasks.workunit.client.0.smithi063.stdout:1/452: dwrite d0/d1c/f96 [0,4194304] 0 2024-09-17T01:56:27.312 INFO:tasks.workunit.client.0.smithi063.stdout:8/273: dread - d1/d7/f4e zero size 2024-09-17T01:56:27.312 INFO:tasks.workunit.client.0.smithi063.stdout:4/365: symlink de/d2d/d3c/l6f 0 2024-09-17T01:56:27.312 INFO:tasks.workunit.client.0.smithi063.stdout:0/263: mknod d1/d1d/c59 0 2024-09-17T01:56:27.312 INFO:tasks.workunit.client.0.smithi063.stdout:6/385: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e 0 2024-09-17T01:56:27.313 INFO:tasks.workunit.client.0.smithi063.stdout:3/378: mknod df/d12/d30/c84 0 2024-09-17T01:56:27.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/453: chown d0/d2d/d35/d3f/d81/l67 2110797964 1 2024-09-17T01:56:27.317 INFO:tasks.workunit.client.0.smithi063.stdout:4/366: getdents de/d17/d1b/d67/d28/d30 0 2024-09-17T01:56:27.317 INFO:tasks.workunit.client.0.smithi063.stdout:8/274: creat d1/d7/d28/d2a/d53/f55 x:0 0 0 2024-09-17T01:56:27.317 INFO:tasks.workunit.client.0.smithi063.stdout:7/269: dread d2/fd [0,4194304] 0 2024-09-17T01:56:27.317 INFO:tasks.workunit.client.0.smithi063.stdout:6/386: rename dc/d14/d19/d20/d66/c73 to dc/d14/d19/d20/d32/d52/d5a/c7f 0 2024-09-17T01:56:27.318 INFO:tasks.workunit.client.0.smithi063.stdout:4/367: mkdir de/d17/d36/d70 0 2024-09-17T01:56:27.318 INFO:tasks.workunit.client.0.smithi063.stdout:0/264: getdents d1/d3/db 0 2024-09-17T01:56:27.320 INFO:tasks.workunit.client.0.smithi063.stdout:9/287: dwrite d9/de/d20/d1e/f46 [0,4194304] 0 2024-09-17T01:56:27.321 INFO:tasks.workunit.client.0.smithi063.stdout:8/275: getdents d1/d7/d28/d2f/d41/d49 0 2024-09-17T01:56:27.321 INFO:tasks.workunit.client.0.smithi063.stdout:4/368: symlink de/d2d/l71 0 2024-09-17T01:56:27.323 INFO:tasks.workunit.client.0.smithi063.stdout:4/369: stat de/d2d/f4a 0 2024-09-17T01:56:27.323 INFO:tasks.workunit.client.0.smithi063.stdout:6/387: creat dc/d14/d19/d20/d32/d52/f80 x:0 0 0 2024-09-17T01:56:27.323 INFO:tasks.workunit.client.0.smithi063.stdout:7/270: link d2/d3/d22/l2e d2/d3/d27/d39/l57 0 2024-09-17T01:56:27.324 INFO:tasks.workunit.client.0.smithi063.stdout:3/379: dwrite df/d12/d43/f69 [0,4194304] 0 2024-09-17T01:56:27.324 INFO:tasks.workunit.client.0.smithi063.stdout:8/276: getdents d1/d7/d28/d2f/d41/d49 0 2024-09-17T01:56:27.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/370: chown de/d17/l54 0 1 2024-09-17T01:56:27.325 INFO:tasks.workunit.client.0.smithi063.stdout:3/380: chown df/c13 15 1 2024-09-17T01:56:27.326 INFO:tasks.workunit.client.0.smithi063.stdout:1/454: dwrite d0/d2d/d35/d3f/d81/d50/d8b/f8e [0,4194304] 0 2024-09-17T01:56:27.326 INFO:tasks.workunit.client.0.smithi063.stdout:0/265: dread d1/d3/d1b/f2a [0,4194304] 0 2024-09-17T01:56:27.327 INFO:tasks.workunit.client.0.smithi063.stdout:3/381: dread - df/d12/d1e/f6e zero size 2024-09-17T01:56:27.329 INFO:tasks.workunit.client.0.smithi063.stdout:5/399: dread d6/d9/d13/d1d/f56 [0,4194304] 0 2024-09-17T01:56:27.330 INFO:tasks.workunit.client.0.smithi063.stdout:7/271: readlink d2/d3/d27/l43 0 2024-09-17T01:56:27.331 INFO:tasks.workunit.client.0.smithi063.stdout:1/455: symlink d0/d93/l9f 0 2024-09-17T01:56:27.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/266: creat d1/d3/d10/f5a x:0 0 0 2024-09-17T01:56:27.333 INFO:tasks.workunit.client.0.smithi063.stdout:1/456: fsync d0/d2d/d35/d3f/d81/d50/f9c 0 2024-09-17T01:56:27.335 INFO:tasks.workunit.client.0.smithi063.stdout:9/288: dwrite d9/de/d20/d1e/d2a/d36/f5e [0,4194304] 0 2024-09-17T01:56:27.335 INFO:tasks.workunit.client.0.smithi063.stdout:5/400: chown d6/d23/d29/d2b/c3c 24827190 1 2024-09-17T01:56:27.335 INFO:tasks.workunit.client.0.smithi063.stdout:8/277: dwrite d1/f16 [4194304,4194304] 0 2024-09-17T01:56:27.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/388: dwrite dc/f44 [0,4194304] 0 2024-09-17T01:56:27.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/389: chown dc/d14 496800462 1 2024-09-17T01:56:27.337 INFO:tasks.workunit.client.0.smithi063.stdout:1/457: unlink d0/d1c/f1d 0 2024-09-17T01:56:27.338 INFO:tasks.workunit.client.0.smithi063.stdout:9/289: fdatasync d9/de/d20/d1b/d25/f4e 0 2024-09-17T01:56:27.339 INFO:tasks.workunit.client.0.smithi063.stdout:2/318: dread d3/d7/df/f1a [4194304,4194304] 0 2024-09-17T01:56:27.339 INFO:tasks.workunit.client.0.smithi063.stdout:5/401: read - d6/d23/d29/d36/f5b zero size 2024-09-17T01:56:27.342 INFO:tasks.workunit.client.0.smithi063.stdout:2/319: mknod d3/d2c/c5f 0 2024-09-17T01:56:27.342 INFO:tasks.workunit.client.0.smithi063.stdout:3/382: dwrite df/d12/d30/f47 [0,4194304] 0 2024-09-17T01:56:27.343 INFO:tasks.workunit.client.0.smithi063.stdout:4/371: dwrite de/f16 [0,4194304] 0 2024-09-17T01:56:27.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/272: truncate d2/d3/d27/f28 4569136 0 2024-09-17T01:56:27.346 INFO:tasks.workunit.client.0.smithi063.stdout:7/273: readlink d2/d15/d2f/d45/d48/l4d 0 2024-09-17T01:56:27.347 INFO:tasks.workunit.client.0.smithi063.stdout:9/290: dwrite d9/de/f2f [4194304,4194304] 0 2024-09-17T01:56:27.348 INFO:tasks.workunit.client.0.smithi063.stdout:3/383: chown df/d12/d2d/f4b 47 1 2024-09-17T01:56:27.349 INFO:tasks.workunit.client.0.smithi063.stdout:1/458: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [0,4194304] 0 2024-09-17T01:56:27.349 INFO:tasks.workunit.client.0.smithi063.stdout:7/274: symlink d2/d3/d27/l58 0 2024-09-17T01:56:27.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/372: creat de/d17/d36/d70/f72 x:0 0 0 2024-09-17T01:56:27.352 INFO:tasks.workunit.client.0.smithi063.stdout:7/275: chown d2/d15/l3b 969239 1 2024-09-17T01:56:27.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/384: write df/d12/d3a/f44 [667505,129661] 0 2024-09-17T01:56:27.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/390: dwrite dc/d14/d19/d20/d32/f54 [0,4194304] 0 2024-09-17T01:56:27.356 INFO:tasks.workunit.client.0.smithi063.stdout:6/391: chown dc/f38 18 1 2024-09-17T01:56:27.357 INFO:tasks.workunit.client.0.smithi063.stdout:8/278: dwrite d1/d7/d28/d2f/d41/d49/f2d [4194304,4194304] 0 2024-09-17T01:56:27.358 INFO:tasks.workunit.client.0.smithi063.stdout:3/385: creat df/d12/d3a/d7a/f85 x:0 0 0 2024-09-17T01:56:27.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/276: link d2/d15/d2f/f3d d2/d15/f59 0 2024-09-17T01:56:27.360 INFO:tasks.workunit.client.0.smithi063.stdout:8/279: read - d1/d7/f4e zero size 2024-09-17T01:56:27.361 INFO:tasks.workunit.client.0.smithi063.stdout:7/277: symlink d2/d15/d2f/d45/d48/l5a 0 2024-09-17T01:56:27.362 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:56:27.362 INFO:tasks.workunit.client.0.smithi063.stdout:9/291: dwrite d9/de/d20/d1b/d25/f4e [0,4194304] 0 2024-09-17T01:56:27.364 INFO:tasks.workunit.client.0.smithi063.stdout:8/280: fdatasync d1/d7/d28/d2a/d37/d3a/f3c 0 2024-09-17T01:56:27.364 INFO:tasks.workunit.client.0.smithi063.stdout:2/320: dwrite d3/f44 [0,4194304] 0 2024-09-17T01:56:27.364 INFO:tasks.workunit.client.0.smithi063.stdout:3/386: rename df/d12/d3a/d7a/f85 to df/d12/d43/d50/f86 0 2024-09-17T01:56:27.365 INFO:tasks.workunit.client.0.smithi063.stdout:1/459: dwrite d0/f20 [0,4194304] 0 2024-09-17T01:56:27.366 INFO:tasks.workunit.client.0.smithi063.stdout:6/392: write dc/d1b/f41 [178019,54323] 0 2024-09-17T01:56:27.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/292: mknod d9/de/d20/d1b/c63 0 2024-09-17T01:56:27.367 INFO:tasks.workunit.client.0.smithi063.stdout:4/373: dwrite de/f2f [0,4194304] 0 2024-09-17T01:56:27.369 INFO:tasks.workunit.client.0.smithi063.stdout:2/321: symlink d3/d7/df/d5a/l60 0 2024-09-17T01:56:27.370 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:27.373+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:27.373 INFO:tasks.workunit.client.0.smithi063.stdout:7/278: creat d2/d3/d27/f5b x:0 0 0 2024-09-17T01:56:27.373 INFO:tasks.workunit.client.0.smithi063.stdout:6/393: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d81 0 2024-09-17T01:56:27.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/374: getdents de/d17/d1b/d67/d28/d30 0 2024-09-17T01:56:27.375 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:27.375 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:27.375 INFO:tasks.workunit.client.0.smithi063.stdout:3/387: dwrite df/d12/d2d/f4a [0,4194304] 0 2024-09-17T01:56:27.376 INFO:tasks.workunit.client.0.smithi063.stdout:8/281: link d1/d7/d1d/c2c d1/d7/d28/d2a/d44/c56 0 2024-09-17T01:56:27.376 INFO:tasks.workunit.client.0.smithi063.stdout:4/375: rmdir de/d2d/d3c 39 2024-09-17T01:56:27.377 INFO:tasks.workunit.client.0.smithi063.stdout:7/279: unlink d2/c9 0 2024-09-17T01:56:27.377 INFO:tasks.workunit.client.0.smithi063.stdout:3/388: rmdir df/d12 39 2024-09-17T01:56:27.378 INFO:tasks.workunit.client.0.smithi063.stdout:1/460: dwrite d0/f8 [4194304,4194304] 0 2024-09-17T01:56:27.379 INFO:tasks.workunit.client.0.smithi063.stdout:6/394: creat dc/d14/d19/f82 x:0 0 0 2024-09-17T01:56:27.380 INFO:tasks.workunit.client.0.smithi063.stdout:1/461: creat d0/d2d/d35/d3f/d94/fa0 x:0 0 0 2024-09-17T01:56:27.382 INFO:tasks.workunit.client.0.smithi063.stdout:3/389: getdents df 0 2024-09-17T01:56:27.382 INFO:tasks.workunit.client.0.smithi063.stdout:1/462: chown d0/d2d/d35/d3f/d4e/f5f 13 1 2024-09-17T01:56:27.383 INFO:tasks.workunit.client.0.smithi063.stdout:3/390: write df/d28/f48 [966359,19694] 0 2024-09-17T01:56:27.384 INFO:tasks.workunit.client.0.smithi063.stdout:6/395: truncate dc/d1b/d5e/f79 3565421 0 2024-09-17T01:56:27.385 INFO:tasks.workunit.client.0.smithi063.stdout:1/463: write d0/d1c/f41 [1810260,93323] 0 2024-09-17T01:56:27.387 INFO:tasks.workunit.client.0.smithi063.stdout:4/376: dwrite de/f3b [0,4194304] 0 2024-09-17T01:56:27.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/396: rmdir dc/d14/d19/d20/d32/d52 39 2024-09-17T01:56:27.388 INFO:tasks.workunit.client.0.smithi063.stdout:4/377: rmdir de/d17/d1b 39 2024-09-17T01:56:27.388 INFO:tasks.workunit.client.0.smithi063.stdout:1/464: creat d0/d2d/d35/d9d/fa1 x:0 0 0 2024-09-17T01:56:27.388 INFO:tasks.workunit.client.0.smithi063.stdout:8/282: dwrite d1/d7/f14 [0,4194304] 0 2024-09-17T01:56:27.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/378: write de/d17/d1b/f1c [2179940,23726] 0 2024-09-17T01:56:27.391 INFO:tasks.workunit.client.0.smithi063.stdout:8/283: mknod d1/d7/c57 0 2024-09-17T01:56:27.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/379: symlink de/d17/d1b/d67/l73 0 2024-09-17T01:56:27.393 INFO:tasks.workunit.client.0.smithi063.stdout:8/284: fdatasync d1/d7/d1d/f40 0 2024-09-17T01:56:27.394 INFO:tasks.workunit.client.0.smithi063.stdout:3/391: dwrite df/d12/d30/f32 [4194304,4194304] 0 2024-09-17T01:56:27.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/285: fsync d1/d7/d28/d2f/d41/d49/f23 0 2024-09-17T01:56:27.398 INFO:tasks.workunit.client.0.smithi063.stdout:4/380: symlink de/d17/d1b/d67/d28/l74 0 2024-09-17T01:56:27.398 INFO:tasks.workunit.client.0.smithi063.stdout:1/465: dwrite d0/d1c/f48 [0,4194304] 0 2024-09-17T01:56:27.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/286: link d1/f16 d1/d7/d28/d2f/d41/f58 0 2024-09-17T01:56:27.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/381: symlink de/d2d/d3c/l75 0 2024-09-17T01:56:27.399 INFO:tasks.workunit.client.0.smithi063.stdout:1/466: write d0/d2d/d35/d3f/d4e/f83 [831410,92710] 0 2024-09-17T01:56:27.400 INFO:tasks.workunit.client.0.smithi063.stdout:4/382: read - de/d17/d1b/f62 zero size 2024-09-17T01:56:27.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/467: dread - d0/d2d/d35/d3f/d6b/f80 zero size 2024-09-17T01:56:27.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/280: dread d2/d3/d27/d39/f4b [0,4194304] 0 2024-09-17T01:56:27.404 INFO:tasks.workunit.client.0.smithi063.stdout:8/287: mkdir d1/d7/d28/d2a/d59 0 2024-09-17T01:56:27.404 INFO:tasks.workunit.client.0.smithi063.stdout:1/468: creat d0/d2d/d35/d3f/d94/fa2 x:0 0 0 2024-09-17T01:56:27.405 INFO:tasks.workunit.client.0.smithi063.stdout:3/392: dwrite df/d12/d1e/f4f [4194304,4194304] 0 2024-09-17T01:56:27.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/469: chown d0/d1c/c5b 33033793 1 2024-09-17T01:56:27.406 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:27.407 INFO:tasks.workunit.client.0.smithi063.stdout:3/393: mkdir df/d12/d43/d50/d87 0 2024-09-17T01:56:27.408 INFO:tasks.workunit.client.0.smithi063.stdout:0/267: dread d1/f1e [0,4194304] 0 2024-09-17T01:56:27.408 INFO:tasks.workunit.client.0.smithi063.stdout:8/288: creat d1/d7/d28/d2a/f5a x:0 0 0 2024-09-17T01:56:27.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/394: dread - df/d12/d2d/f4c zero size 2024-09-17T01:56:27.409 INFO:tasks.workunit.client.0.smithi063.stdout:7/281: link d2/d3/d27/c44 d2/d3/d27/c5c 0 2024-09-17T01:56:27.409 INFO:tasks.workunit.client.0.smithi063.stdout:0/268: creat d1/d3/db/d18/f5b x:0 0 0 2024-09-17T01:56:27.410 INFO:tasks.workunit.client.0.smithi063.stdout:0/269: write d1/d3/db/f39 [4283787,92230] 0 2024-09-17T01:56:27.410 INFO:tasks.workunit.client.0.smithi063.stdout:6/397: read dc/d14/d19/d20/d32/d52/d5a/d43/f50 [1676592,128714] 0 2024-09-17T01:56:27.411 INFO:tasks.workunit.client.0.smithi063.stdout:0/270: write d1/d3/f4 [7412505,81269] 0 2024-09-17T01:56:27.412 INFO:tasks.workunit.client.0.smithi063.stdout:0/271: fdatasync d1/d3/d1b/f49 0 2024-09-17T01:56:27.415 INFO:tasks.workunit.client.0.smithi063.stdout:9/293: dread d9/de/d20/d1b/f2d [0,4194304] 0 2024-09-17T01:56:27.415 INFO:tasks.workunit.client.0.smithi063.stdout:8/289: read d1/d7/d28/d2f/d41/d49/f4a [3331861,30540] 0 2024-09-17T01:56:27.417 INFO:tasks.workunit.client.0.smithi063.stdout:6/398: write dc/f38 [948361,99809] 0 2024-09-17T01:56:27.418 INFO:tasks.workunit.client.0.smithi063.stdout:5/402: dread d6/d37/fe [0,4194304] 0 2024-09-17T01:56:27.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/395: dwrite df/d12/d43/d50/d58/f81 [0,4194304] 0 2024-09-17T01:56:27.419 INFO:tasks.workunit.client.0.smithi063.stdout:3/396: chown fe 709198276 1 2024-09-17T01:56:27.420 INFO:tasks.workunit.client.0.smithi063.stdout:7/282: dwrite d2/fd [4194304,4194304] 0 2024-09-17T01:56:27.420 INFO:tasks.workunit.client.0.smithi063.stdout:5/403: write d6/d37/d19/f75 [757648,102601] 0 2024-09-17T01:56:27.421 INFO:tasks.workunit.client.0.smithi063.stdout:5/404: chown d6/d37 10819 1 2024-09-17T01:56:27.421 INFO:tasks.workunit.client.0.smithi063.stdout:6/399: creat dc/d14/d19/d20/f83 x:0 0 0 2024-09-17T01:56:27.422 INFO:tasks.workunit.client.0.smithi063.stdout:8/290: creat d1/d7/d28/d2a/f5b x:0 0 0 2024-09-17T01:56:27.423 INFO:tasks.workunit.client.0.smithi063.stdout:9/294: truncate d9/de/d20/d1b/f2d 2669117 0 2024-09-17T01:56:27.424 INFO:tasks.workunit.client.0.smithi063.stdout:2/322: dread d3/d7/df/f18 [0,4194304] 0 2024-09-17T01:56:27.424 INFO:tasks.workunit.client.0.smithi063.stdout:5/405: creat d6/d23/d29/d36/f7d x:0 0 0 2024-09-17T01:56:27.424 INFO:tasks.workunit.client.0.smithi063.stdout:7/283: link d2/d15/l1f d2/d3/d27/d39/l5d 0 2024-09-17T01:56:27.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/295: truncate d9/f5b 549379 0 2024-09-17T01:56:27.425 INFO:tasks.workunit.client.0.smithi063.stdout:8/291: creat d1/f5c x:0 0 0 2024-09-17T01:56:27.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/406: creat d6/d37/d79/f7e x:0 0 0 2024-09-17T01:56:27.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/407: stat d6/d9/f40 0 2024-09-17T01:56:27.427 INFO:tasks.workunit.client.0.smithi063.stdout:8/292: rename d1/d7/d28/d2a/d53 to d1/d7/d28/d2a/d53/d5d 22 2024-09-17T01:56:27.427 INFO:tasks.workunit.client.0.smithi063.stdout:7/284: truncate d2/d15/d2f/f3d 947108 0 2024-09-17T01:56:27.427 INFO:tasks.workunit.client.0.smithi063.stdout:5/408: symlink d6/d37/l7f 0 2024-09-17T01:56:27.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/400: truncate dc/d14/d19/d20/d32/d52/d5a/d43/f6d 687207 0 2024-09-17T01:56:27.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/401: chown dc/f4e 10 1 2024-09-17T01:56:27.428 INFO:tasks.workunit.client.0.smithi063.stdout:8/293: stat d1/d7/d28/d2a/d53/f55 0 2024-09-17T01:56:27.428 INFO:tasks.workunit.client.0.smithi063.stdout:0/272: dread d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:27.428 INFO:tasks.workunit.client.0.smithi063.stdout:5/409: creat d6/d23/d29/d2b/d31/f80 x:0 0 0 2024-09-17T01:56:27.429 INFO:tasks.workunit.client.0.smithi063.stdout:0/273: truncate f0 4734810 0 2024-09-17T01:56:27.429 INFO:tasks.workunit.client.0.smithi063.stdout:2/323: dread d3/f21 [0,4194304] 0 2024-09-17T01:56:27.429 INFO:tasks.workunit.client.0.smithi063.stdout:6/402: chown dc/d14/d19/d20/d32/f54 207 1 2024-09-17T01:56:27.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/294: creat d1/f5e x:0 0 0 2024-09-17T01:56:27.430 INFO:tasks.workunit.client.0.smithi063.stdout:0/274: rename d1/d3/db to d1/d3/db/d18/d5c 22 2024-09-17T01:56:27.431 INFO:tasks.workunit.client.0.smithi063.stdout:3/397: truncate df/d12/d30/f47 304432 0 2024-09-17T01:56:27.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/324: unlink d3/d7/fd 0 2024-09-17T01:56:27.431 INFO:tasks.workunit.client.0.smithi063.stdout:9/296: dread d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:27.431 INFO:tasks.workunit.client.0.smithi063.stdout:7/285: write d2/fb [907004,74734] 0 2024-09-17T01:56:27.432 INFO:tasks.workunit.client.0.smithi063.stdout:8/295: creat d1/d7/d1d/f5f x:0 0 0 2024-09-17T01:56:27.432 INFO:tasks.workunit.client.0.smithi063.stdout:2/325: write d3/d7/f5b [1044187,99849] 0 2024-09-17T01:56:27.432 INFO:tasks.workunit.client.0.smithi063.stdout:3/398: write df/d12/d2d/f4b [379302,64819] 0 2024-09-17T01:56:27.433 INFO:tasks.workunit.client.0.smithi063.stdout:5/410: link d6/d9/d13/d1d/f56 d6/d37/d19/d68/f81 0 2024-09-17T01:56:27.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/286: fdatasync d2/df/f10 0 2024-09-17T01:56:27.433 INFO:tasks.workunit.client.0.smithi063.stdout:9/297: mknod d9/de/d20/d1b/c64 0 2024-09-17T01:56:27.434 INFO:tasks.workunit.client.0.smithi063.stdout:0/275: mknod d1/d3/d1b/c5d 0 2024-09-17T01:56:27.434 INFO:tasks.workunit.client.0.smithi063.stdout:8/296: read d1/d7/f13 [2389752,26920] 0 2024-09-17T01:56:27.434 INFO:tasks.workunit.client.0.smithi063.stdout:5/411: chown d6/d23/d54 990306 1 2024-09-17T01:56:27.434 INFO:tasks.workunit.client.0.smithi063.stdout:2/326: creat d3/d7/d38/f61 x:0 0 0 2024-09-17T01:56:27.434 INFO:tasks.workunit.client.0.smithi063.stdout:4/383: dread de/d17/d1b/f1e [0,4194304] 0 2024-09-17T01:56:27.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/276: rmdir d1/d44 39 2024-09-17T01:56:27.435 INFO:tasks.workunit.client.0.smithi063.stdout:9/298: fsync d9/de/d20/d37/f50 0 2024-09-17T01:56:27.438 INFO:tasks.workunit.client.0.smithi063.stdout:5/412: rename d6/d37/f6f to d6/d23/d29/d2b/d4f/f82 0 2024-09-17T01:56:27.439 INFO:tasks.workunit.client.0.smithi063.stdout:5/413: stat d6/d23 0 2024-09-17T01:56:27.439 INFO:tasks.workunit.client.0.smithi063.stdout:6/403: dwrite dc/d1b/d5e/f79 [0,4194304] 0 2024-09-17T01:56:27.441 INFO:tasks.workunit.client.0.smithi063.stdout:3/399: dread df/d12/f80 [0,4194304] 0 2024-09-17T01:56:27.442 INFO:tasks.workunit.client.0.smithi063.stdout:2/327: dread d3/f8 [0,4194304] 0 2024-09-17T01:56:27.443 INFO:tasks.workunit.client.0.smithi063.stdout:4/384: dread de/f16 [0,4194304] 0 2024-09-17T01:56:27.444 INFO:tasks.workunit.client.0.smithi063.stdout:5/414: symlink d6/d9/d13/d1d/l83 0 2024-09-17T01:56:27.444 INFO:tasks.workunit.client.0.smithi063.stdout:7/287: dwrite d2/d3/d27/d39/f4b [0,4194304] 0 2024-09-17T01:56:27.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/328: read - d3/d7/d38/f56 zero size 2024-09-17T01:56:27.444 INFO:tasks.workunit.client.0.smithi063.stdout:3/400: mknod df/d12/c88 0 2024-09-17T01:56:27.445 INFO:tasks.workunit.client.0.smithi063.stdout:2/329: fsync d3/d7/df/f2f 0 2024-09-17T01:56:27.445 INFO:tasks.workunit.client.0.smithi063.stdout:5/415: symlink d6/d23/d29/l84 0 2024-09-17T01:56:27.447 INFO:tasks.workunit.client.0.smithi063.stdout:7/288: mknod d2/d3/d22/d56/c5e 0 2024-09-17T01:56:27.448 INFO:tasks.workunit.client.0.smithi063.stdout:5/416: rmdir d6/d23/d29/d2b/d4f 39 2024-09-17T01:56:27.448 INFO:tasks.workunit.client.0.smithi063.stdout:4/385: dread de/d17/d1b/f6b [0,4194304] 0 2024-09-17T01:56:27.448 INFO:tasks.workunit.client.0.smithi063.stdout:2/330: symlink d3/d7/d38/l62 0 2024-09-17T01:56:27.450 INFO:tasks.workunit.client.0.smithi063.stdout:0/277: dwrite d1/d3/db/d18/d33/f2e [0,4194304] 0 2024-09-17T01:56:27.450 INFO:tasks.workunit.client.0.smithi063.stdout:5/417: mkdir d6/d37/d79/d85 0 2024-09-17T01:56:27.450 INFO:tasks.workunit.client.0.smithi063.stdout:6/404: dwrite dc/d14/d18/f16 [0,4194304] 0 2024-09-17T01:56:27.450 INFO:tasks.workunit.client.0.smithi063.stdout:2/331: write d3/f9 [829928,57054] 0 2024-09-17T01:56:27.450 INFO:tasks.workunit.client.0.smithi063.stdout:4/386: chown de/d17/d1b/f62 789 1 2024-09-17T01:56:27.452 INFO:tasks.workunit.client.0.smithi063.stdout:0/278: chown d1/d3/d10/f4e 3799103 1 2024-09-17T01:56:27.453 INFO:tasks.workunit.client.0.smithi063.stdout:5/418: creat d6/d37/f86 x:0 0 0 2024-09-17T01:56:27.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/332: mknod d3/d7/df/d30/c63 0 2024-09-17T01:56:27.453 INFO:tasks.workunit.client.0.smithi063.stdout:4/387: unlink de/d2d/f4a 0 2024-09-17T01:56:27.454 INFO:tasks.workunit.client.0.smithi063.stdout:3/401: dwrite df/d28/f48 [0,4194304] 0 2024-09-17T01:56:27.455 INFO:tasks.workunit.client.0.smithi063.stdout:4/388: fsync de/d17/d1b/d67/f60 0 2024-09-17T01:56:27.455 INFO:tasks.workunit.client.0.smithi063.stdout:5/419: write d6/d37/d19/f75 [1003330,101587] 0 2024-09-17T01:56:27.461 INFO:tasks.workunit.client.0.smithi063.stdout:0/279: rename d1/d3/db/c12 to d1/d3/db/c5e 0 2024-09-17T01:56:27.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/420: unlink d6/d9/d13/l41 0 2024-09-17T01:56:27.461 INFO:tasks.workunit.client.0.smithi063.stdout:6/405: dwrite dc/d14/d19/d20/d32/d52/d5a/f26 [0,4194304] 0 2024-09-17T01:56:27.461 INFO:tasks.workunit.client.0.smithi063.stdout:3/402: rename df/d12/d2d/d2f/f68 to df/d12/d1e/d53/f89 0 2024-09-17T01:56:27.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/299: dread d9/de/ff [0,4194304] 0 2024-09-17T01:56:27.464 INFO:tasks.workunit.client.0.smithi063.stdout:7/289: dwrite d2/d15/d2f/f3d [0,4194304] 0 2024-09-17T01:56:27.465 INFO:tasks.workunit.client.0.smithi063.stdout:2/333: dwrite d3/d2c/f53 [0,4194304] 0 2024-09-17T01:56:27.466 INFO:tasks.workunit.client.0.smithi063.stdout:7/290: dread - d2/d3/d27/d39/f4e zero size 2024-09-17T01:56:27.467 INFO:tasks.workunit.client.0.smithi063.stdout:5/421: fsync d6/d9/d13/d1d/f56 0 2024-09-17T01:56:27.467 INFO:tasks.workunit.client.0.smithi063.stdout:9/300: symlink d9/de/d20/l65 0 2024-09-17T01:56:27.467 INFO:tasks.workunit.client.0.smithi063.stdout:0/280: creat d1/d3/db/d18/d43/f5f x:0 0 0 2024-09-17T01:56:27.467 INFO:tasks.workunit.client.0.smithi063.stdout:2/334: chown d3/d2c/f35 1639688 1 2024-09-17T01:56:27.468 INFO:tasks.workunit.client.0.smithi063.stdout:4/389: dwrite de/f2e [0,4194304] 0 2024-09-17T01:56:27.468 INFO:tasks.workunit.client.0.smithi063.stdout:7/291: write d2/f4 [4453129,101317] 0 2024-09-17T01:56:27.468 INFO:tasks.workunit.client.0.smithi063.stdout:2/335: chown d3/d7/df/f18 72195 1 2024-09-17T01:56:27.468 INFO:tasks.workunit.client.0.smithi063.stdout:7/292: chown d2/d3/d22/d56/c5e 18 1 2024-09-17T01:56:27.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/301: rename d9/de/l11 to d9/de/d20/d37/d42/l66 0 2024-09-17T01:56:27.469 INFO:tasks.workunit.client.0.smithi063.stdout:0/281: fdatasync d1/d3/db/d4b/f1c 0 2024-09-17T01:56:27.469 INFO:tasks.workunit.client.0.smithi063.stdout:2/336: symlink d3/d7/df/d5a/l64 0 2024-09-17T01:56:27.470 INFO:tasks.workunit.client.0.smithi063.stdout:7/293: mknod d2/d3/d17/c5f 0 2024-09-17T01:56:27.471 INFO:tasks.workunit.client.0.smithi063.stdout:0/282: unlink d1/d3/db/d18/d43/f5f 0 2024-09-17T01:56:27.471 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:27.473+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:27.472 INFO:tasks.workunit.client.0.smithi063.stdout:0/283: stat d1/lc 0 2024-09-17T01:56:27.472 INFO:tasks.workunit.client.0.smithi063.stdout:2/337: getdents d3/d7 0 2024-09-17T01:56:27.472 INFO:tasks.workunit.client.0.smithi063.stdout:7/294: write d2/d3/d27/d39/f3c [2083307,18526] 0 2024-09-17T01:56:27.473 INFO:tasks.workunit.client.0.smithi063.stdout:9/302: rename d9/de/d20/l65 to d9/de/d20/d1e/l67 0 2024-09-17T01:56:27.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/338: write d3/f44 [2747437,1375] 0 2024-09-17T01:56:27.474 INFO:tasks.workunit.client.0.smithi063.stdout:7/295: truncate d2/df/f53 168879 0 2024-09-17T01:56:27.474 INFO:tasks.workunit.client.0.smithi063.stdout:0/284: write d1/d3/db/d18/d33/f2e [4450934,48064] 0 2024-09-17T01:56:27.474 INFO:tasks.workunit.client.0.smithi063.stdout:7/296: fdatasync d2/df/f53 0 2024-09-17T01:56:27.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/303: dread - d9/de/d20/d1e/d2a/d40/f5c zero size 2024-09-17T01:56:27.475 INFO:tasks.workunit.client.0.smithi063.stdout:2/339: stat d3/f6 0 2024-09-17T01:56:27.475 INFO:tasks.workunit.client.0.smithi063.stdout:5/422: dwrite d6/d9/d13/f1e [0,4194304] 0 2024-09-17T01:56:27.475 INFO:tasks.workunit.client.0.smithi063.stdout:0/285: creat d1/d3/db/d18/d43/f60 x:0 0 0 2024-09-17T01:56:27.476 INFO:tasks.workunit.client.0.smithi063.stdout:2/340: fsync d3/d7/df/f14 0 2024-09-17T01:56:27.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/423: unlink d6/f62 0 2024-09-17T01:56:27.476 INFO:tasks.workunit.client.0.smithi063.stdout:2/341: stat d3/d7/d38/l52 0 2024-09-17T01:56:27.479 INFO:tasks.workunit.client.0.smithi063.stdout:2/342: rename d3/d7/df/f29 to d3/d7/d38/f65 0 2024-09-17T01:56:27.483 INFO:tasks.workunit.client.0.smithi063.stdout:2/343: write d3/d7/df/f18 [557517,35015] 0 2024-09-17T01:56:27.484 INFO:tasks.workunit.client.0.smithi063.stdout:2/344: chown d3/d7/df/d43 34467 1 2024-09-17T01:56:27.485 INFO:tasks.workunit.client.0.smithi063.stdout:0/286: dwrite f0 [0,4194304] 0 2024-09-17T01:56:27.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/345: readlink d3/d7/df/d5a/l64 0 2024-09-17T01:56:27.487 INFO:tasks.workunit.client.0.smithi063.stdout:0/287: fsync d1/d3/f4 0 2024-09-17T01:56:27.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/304: dwrite d9/de/d20/d1b/f2d [0,4194304] 0 2024-09-17T01:56:27.488 INFO:tasks.workunit.client.0.smithi063.stdout:2/346: rmdir d3/d7/d38/d4d 0 2024-09-17T01:56:27.489 INFO:tasks.workunit.client.0.smithi063.stdout:6/406: fsync f1 0 2024-09-17T01:56:27.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/288: symlink d1/d1d/l61 0 2024-09-17T01:56:27.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/347: chown d3/d2c/c5f 53447787 1 2024-09-17T01:56:27.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/305: write d9/de/d20/d1b/f1f [4940759,68646] 0 2024-09-17T01:56:27.491 INFO:tasks.workunit.client.0.smithi063.stdout:5/424: dwrite d6/d23/d29/d2b/d4f/f52 [0,4194304] 0 2024-09-17T01:56:27.492 INFO:tasks.workunit.client.0.smithi063.stdout:0/289: read - d1/d3/db/d4b/f37 zero size 2024-09-17T01:56:27.492 INFO:tasks.workunit.client.0.smithi063.stdout:9/306: chown d9/de/d20/d1e/d2a 105257 1 2024-09-17T01:56:27.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/348: fsync d3/d2c/f59 0 2024-09-17T01:56:27.492 INFO:tasks.workunit.client.0.smithi063.stdout:0/290: dread - d1/d3/db/d18/f5b zero size 2024-09-17T01:56:27.494 INFO:tasks.workunit.client.0.smithi063.stdout:6/407: dread dc/d1b/f41 [0,4194304] 0 2024-09-17T01:56:27.494 INFO:tasks.workunit.client.0.smithi063.stdout:2/349: mknod d3/d7/df/d5a/c66 0 2024-09-17T01:56:27.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/291: rmdir d1/d3/d10 39 2024-09-17T01:56:27.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/292: fdatasync d1/d3/db/f39 0 2024-09-17T01:56:27.495 INFO:tasks.workunit.client.0.smithi063.stdout:2/350: write d3/f44 [657701,29603] 0 2024-09-17T01:56:27.495 INFO:tasks.workunit.client.0.smithi063.stdout:7/297: dread d2/df/f10 [0,4194304] 0 2024-09-17T01:56:27.496 INFO:tasks.workunit.client.0.smithi063.stdout:4/390: read de/d2d/f33 [3399980,81192] 0 2024-09-17T01:56:27.496 INFO:tasks.workunit.client.0.smithi063.stdout:6/408: creat dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d81/f84 x:0 0 0 2024-09-17T01:56:27.498 INFO:tasks.workunit.client.0.smithi063.stdout:0/293: mkdir d1/d44/d53/d62 0 2024-09-17T01:56:27.498 INFO:tasks.workunit.client.0.smithi063.stdout:4/391: mknod de/d17/d1b/d67/c76 0 2024-09-17T01:56:27.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/409: creat dc/d14/d19/d20/d66/f85 x:0 0 0 2024-09-17T01:56:27.498 INFO:tasks.workunit.client.0.smithi063.stdout:0/294: mkdir d1/d3/d32/d63 0 2024-09-17T01:56:27.498 INFO:tasks.workunit.client.0.smithi063.stdout:4/392: dread - de/d17/d1b/d67/d28/f65 zero size 2024-09-17T01:56:27.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/295: creat d1/d1f/f64 x:0 0 0 2024-09-17T01:56:27.499 INFO:tasks.workunit.client.0.smithi063.stdout:2/351: write d3/d7/df/d30/f3e [967131,105458] 0 2024-09-17T01:56:27.501 INFO:tasks.workunit.client.0.smithi063.stdout:4/393: mkdir de/d17/d36/d70/d77 0 2024-09-17T01:56:27.501 INFO:tasks.workunit.client.0.smithi063.stdout:6/410: creat dc/d14/d19/d20/d32/d52/d5a/d43/f86 x:0 0 0 2024-09-17T01:56:27.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/394: link de/l3d de/d17/d1b/l78 0 2024-09-17T01:56:27.504 INFO:tasks.workunit.client.0.smithi063.stdout:0/296: dread d1/f1e [0,4194304] 0 2024-09-17T01:56:27.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/411: dread dc/d14/d19/d20/d32/d52/d5a/d43/f6d [0,4194304] 0 2024-09-17T01:56:27.504 INFO:tasks.workunit.client.0.smithi063.stdout:4/395: fsync de/d17/f23 0 2024-09-17T01:56:27.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/298: dwrite d2/df/f10 [0,4194304] 0 2024-09-17T01:56:27.505 INFO:tasks.workunit.client.0.smithi063.stdout:0/297: chown d1/d3/db/c17 15 1 2024-09-17T01:56:27.506 INFO:tasks.workunit.client.0.smithi063.stdout:4/396: write de/d17/d1b/d67/f60 [521308,42649] 0 2024-09-17T01:56:27.507 INFO:tasks.workunit.client.0.smithi063.stdout:6/412: write dc/d14/d18/f31 [3010566,73369] 0 2024-09-17T01:56:27.507 INFO:tasks.workunit.client.0.smithi063.stdout:7/299: rename d2/d3/d22/l30 to d2/d15/d2f/d45/l60 0 2024-09-17T01:56:27.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/397: stat de/d17/d1b/d67/d28/d30/c46 0 2024-09-17T01:56:27.509 INFO:tasks.workunit.client.0.smithi063.stdout:4/398: chown de/d17/d1b/d67/d28/d30 14 1 2024-09-17T01:56:27.509 INFO:tasks.workunit.client.0.smithi063.stdout:2/352: dwrite d3/d7/df/d30/f3e [0,4194304] 0 2024-09-17T01:56:27.509 INFO:tasks.workunit.client.0.smithi063.stdout:2/353: stat d3/d7/df/l17 0 2024-09-17T01:56:27.511 INFO:tasks.workunit.client.0.smithi063.stdout:4/399: truncate de/d17/d1b/f1e 291090 0 2024-09-17T01:56:27.511 INFO:tasks.workunit.client.0.smithi063.stdout:2/354: rename d3/d7/df/f14 to d3/d7/df/d30/f67 0 2024-09-17T01:56:27.512 INFO:tasks.workunit.client.0.smithi063.stdout:4/400: write de/f38 [469615,31992] 0 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/425: read d6/d9/d13/d1d/f21 [492508,116045] 0 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/470: sync 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:8/297: sync 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:4/401: chown de/d2d/d3c/l75 232 1 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/426: symlink d6/d23/d3f/l87 0 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:2/355: rename d3/d2c to d3/d7/df/d68 0 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/471: fsync d0/d2d/d35/d3f/d4e/f6a 0 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/427: mknod d6/d37/d19/d76/c88 0 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/472: chown d0/l19 183054 1 2024-09-17T01:56:27.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/428: dread - d6/d23/f77 zero size 2024-09-17T01:56:27.516 INFO:tasks.workunit.client.0.smithi063.stdout:4/402: chown de/d17/d1b/d67/d28 324 1 2024-09-17T01:56:27.516 INFO:tasks.workunit.client.0.smithi063.stdout:1/473: getdents d0/d93/d9a 0 2024-09-17T01:56:27.517 INFO:tasks.workunit.client.0.smithi063.stdout:2/356: rename d3/d7/df/d43/f41 to d3/d7/df/d43/f69 0 2024-09-17T01:56:27.517 INFO:tasks.workunit.client.0.smithi063.stdout:4/403: creat de/d17/d1b/f79 x:0 0 0 2024-09-17T01:56:27.517 INFO:tasks.workunit.client.0.smithi063.stdout:6/413: read dc/d14/d19/f1a [2218423,70780] 0 2024-09-17T01:56:27.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/298: truncate d1/f1e 250207 0 2024-09-17T01:56:27.518 INFO:tasks.workunit.client.0.smithi063.stdout:8/298: truncate d1/d7/d1d/f20 3144476 0 2024-09-17T01:56:27.519 INFO:tasks.workunit.client.0.smithi063.stdout:7/300: read d2/d3/d27/f28 [3448000,39611] 0 2024-09-17T01:56:27.520 INFO:tasks.workunit.client.0.smithi063.stdout:3/403: dread df/d28/f2a [0,4194304] 0 2024-09-17T01:56:27.520 INFO:tasks.workunit.client.0.smithi063.stdout:7/301: stat d2/d3/d17 0 2024-09-17T01:56:27.521 INFO:tasks.workunit.client.0.smithi063.stdout:3/404: mkdir df/d12/d30/d8a 0 2024-09-17T01:56:27.521 INFO:tasks.workunit.client.0.smithi063.stdout:0/299: rename d1/d1f/f58 to d1/d3/d1b/f65 0 2024-09-17T01:56:27.521 INFO:tasks.workunit.client.0.smithi063.stdout:2/357: write d3/f6 [6261341,41975] 0 2024-09-17T01:56:27.522 INFO:tasks.workunit.client.0.smithi063.stdout:8/299: getdents d1/d7/d28 0 2024-09-17T01:56:27.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/414: rename dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d81/f84 to dc/d14/d19/d20/d32/f87 0 2024-09-17T01:56:27.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/358: dread - d3/d7/df/d43/f55 zero size 2024-09-17T01:56:27.523 INFO:tasks.workunit.client.0.smithi063.stdout:0/300: creat d1/d3/db/d4b/f66 x:0 0 0 2024-09-17T01:56:27.524 INFO:tasks.workunit.client.0.smithi063.stdout:8/300: chown d1/d7/d28/d2f 0 1 2024-09-17T01:56:27.524 INFO:tasks.workunit.client.0.smithi063.stdout:7/302: write d2/d3/d27/f28 [5569699,26671] 0 2024-09-17T01:56:27.525 INFO:tasks.workunit.client.0.smithi063.stdout:1/474: dwrite d0/d2d/d35/d3f/d4e/d66/f69 [0,4194304] 0 2024-09-17T01:56:27.525 INFO:tasks.workunit.client.0.smithi063.stdout:8/301: readlink d1/d7/d28/d2f/d41/l47 0 2024-09-17T01:56:27.525 INFO:tasks.workunit.client.0.smithi063.stdout:6/415: creat dc/d14/d18/d74/f88 x:0 0 0 2024-09-17T01:56:27.526 INFO:tasks.workunit.client.0.smithi063.stdout:7/303: mknod d2/d15/d2f/d45/d48/c61 0 2024-09-17T01:56:27.526 INFO:tasks.workunit.client.0.smithi063.stdout:8/302: write d1/d7/f4c [4174976,90683] 0 2024-09-17T01:56:27.526 INFO:tasks.workunit.client.0.smithi063.stdout:6/416: readlink dc/l4a 0 2024-09-17T01:56:27.526 INFO:tasks.workunit.client.0.smithi063.stdout:1/475: unlink d0/d2d/f3d 0 2024-09-17T01:56:27.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/404: read de/d17/d1b/d67/d28/d30/f61 [198467,113263] 0 2024-09-17T01:56:27.527 INFO:tasks.workunit.client.0.smithi063.stdout:0/301: link d1/d3/db/f42 d1/d3/db/d18/d33/f67 0 2024-09-17T01:56:27.527 INFO:tasks.workunit.client.0.smithi063.stdout:8/303: dread - d1/d7/d28/f45 zero size 2024-09-17T01:56:27.527 INFO:tasks.workunit.client.0.smithi063.stdout:7/304: creat d2/d3/d22/d3a/f62 x:0 0 0 2024-09-17T01:56:27.528 INFO:tasks.workunit.client.0.smithi063.stdout:0/302: unlink d1/f6 0 2024-09-17T01:56:27.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/307: dread d9/fc [0,4194304] 0 2024-09-17T01:56:27.529 INFO:tasks.workunit.client.0.smithi063.stdout:4/405: truncate f4 1564775 0 2024-09-17T01:56:27.530 INFO:tasks.workunit.client.0.smithi063.stdout:0/303: creat d1/d3/d1b/d50/f68 x:0 0 0 2024-09-17T01:56:27.530 INFO:tasks.workunit.client.0.smithi063.stdout:5/429: dread d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:27.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/406: readlink de/d17/d1b/l58 0 2024-09-17T01:56:27.530 INFO:tasks.workunit.client.0.smithi063.stdout:0/304: fsync d1/d1d/f3b 0 2024-09-17T01:56:27.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/305: stat d1/d3/db/d18/d33 0 2024-09-17T01:56:27.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/308: fdatasync d9/de/d20/d37/f58 0 2024-09-17T01:56:27.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/476: unlink d0/d2d/d35/d3f/d81/d50/l57 0 2024-09-17T01:56:27.533 INFO:tasks.workunit.client.0.smithi063.stdout:5/430: dread d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:27.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/309: readlink d9/de/d20/d37/d42/d4c/l62 0 2024-09-17T01:56:27.534 INFO:tasks.workunit.client.0.smithi063.stdout:0/306: getdents d1/d3/db/d4b 0 2024-09-17T01:56:27.534 INFO:tasks.workunit.client.0.smithi063.stdout:1/477: symlink d0/d93/d9e/la3 0 2024-09-17T01:56:27.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/407: dread de/f38 [0,4194304] 0 2024-09-17T01:56:27.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/431: truncate d6/d23/d69/f7a 739315 0 2024-09-17T01:56:27.536 INFO:tasks.workunit.client.0.smithi063.stdout:3/405: dread df/d12/d1e/d5e/f76 [0,4194304] 0 2024-09-17T01:56:27.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/307: truncate d1/f4d 1220838 0 2024-09-17T01:56:27.537 INFO:tasks.workunit.client.0.smithi063.stdout:1/478: creat d0/d2d/d35/d3f/d81/fa4 x:0 0 0 2024-09-17T01:56:27.537 INFO:tasks.workunit.client.0.smithi063.stdout:8/304: dwrite d1/f18 [0,4194304] 0 2024-09-17T01:56:27.537 INFO:tasks.workunit.client.0.smithi063.stdout:4/408: creat de/d17/d36/f7a x:0 0 0 2024-09-17T01:56:27.538 INFO:tasks.workunit.client.0.smithi063.stdout:8/305: fdatasync d1/d7/d28/f42 0 2024-09-17T01:56:27.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/479: symlink d0/d1c/la5 0 2024-09-17T01:56:27.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/409: rename de/d17/d1b/d67/f1a to de/d17/d1b/d67/d28/d30/f7b 0 2024-09-17T01:56:27.541 INFO:tasks.workunit.client.0.smithi063.stdout:0/308: write d1/d3/d1b/f38 [4768793,22018] 0 2024-09-17T01:56:27.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/410: fdatasync de/d17/f23 0 2024-09-17T01:56:27.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/480: mkdir d0/d2d/d35/d3f/d94/da6 0 2024-09-17T01:56:27.542 INFO:tasks.workunit.client.0.smithi063.stdout:4/411: fsync de/d2d/f43 0 2024-09-17T01:56:27.542 INFO:tasks.workunit.client.0.smithi063.stdout:0/309: rename d1/d3/d1b/f49 to d1/d3/d32/f69 0 2024-09-17T01:56:27.543 INFO:tasks.workunit.client.0.smithi063.stdout:1/481: mknod d0/d2d/d35/d3f/d4e/d66/ca7 0 2024-09-17T01:56:27.543 INFO:tasks.workunit.client.0.smithi063.stdout:4/412: chown de/d17/d1b/l3a 286656 1 2024-09-17T01:56:27.544 INFO:tasks.workunit.client.0.smithi063.stdout:3/406: dwrite fe [0,4194304] 0 2024-09-17T01:56:27.544 INFO:tasks.workunit.client.0.smithi063.stdout:4/413: chown de/f10 708427 1 2024-09-17T01:56:27.547 INFO:tasks.workunit.client.0.smithi063.stdout:9/310: dread d9/de/f19 [0,4194304] 0 2024-09-17T01:56:27.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/306: write d1/f16 [796615,68343] 0 2024-09-17T01:56:27.547 INFO:tasks.workunit.client.0.smithi063.stdout:3/407: creat df/d12/d1e/f8b x:0 0 0 2024-09-17T01:56:27.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/310: write d1/d3/db/d4b/f37 [817370,4718] 0 2024-09-17T01:56:27.548 INFO:tasks.workunit.client.0.smithi063.stdout:9/311: truncate d9/de/d20/d1e/d2a/f53 4606683 0 2024-09-17T01:56:27.548 INFO:tasks.workunit.client.0.smithi063.stdout:8/307: unlink d1/d7/d28/d2f/d41/d49/c21 0 2024-09-17T01:56:27.548 INFO:tasks.workunit.client.0.smithi063.stdout:3/408: mknod df/d12/d43/c8c 0 2024-09-17T01:56:27.549 INFO:tasks.workunit.client.0.smithi063.stdout:0/311: chown d1/d1f/f41 1049406 1 2024-09-17T01:56:27.549 INFO:tasks.workunit.client.0.smithi063.stdout:3/409: fdatasync df/d12/d43/f69 0 2024-09-17T01:56:27.549 INFO:tasks.workunit.client.0.smithi063.stdout:9/312: fdatasync d9/de/d20/d37/f58 0 2024-09-17T01:56:27.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/312: mknod d1/d3/c6a 0 2024-09-17T01:56:27.551 INFO:tasks.workunit.client.0.smithi063.stdout:3/410: fdatasync df/d12/d2d/f4c 0 2024-09-17T01:56:27.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/313: truncate d9/de/d33/f38 778287 0 2024-09-17T01:56:27.552 INFO:tasks.workunit.client.0.smithi063.stdout:4/414: dwrite de/d17/d1b/f79 [0,4194304] 0 2024-09-17T01:56:27.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/313: readlink d1/d3/d1b/l2b 0 2024-09-17T01:56:27.552 INFO:tasks.workunit.client.0.smithi063.stdout:4/415: fdatasync de/f57 0 2024-09-17T01:56:27.553 INFO:tasks.workunit.client.0.smithi063.stdout:3/411: truncate df/d12/d43/f62 643454 0 2024-09-17T01:56:27.553 INFO:tasks.workunit.client.0.smithi063.stdout:1/482: dwrite d0/f20 [0,4194304] 0 2024-09-17T01:56:27.553 INFO:tasks.workunit.client.0.smithi063.stdout:9/314: fsync d9/de/f19 0 2024-09-17T01:56:27.554 INFO:tasks.workunit.client.0.smithi063.stdout:0/314: mknod d1/d3/c6b 0 2024-09-17T01:56:27.555 INFO:tasks.workunit.client.0.smithi063.stdout:9/315: read d9/de/d20/f24 [3573630,61206] 0 2024-09-17T01:56:27.555 INFO:tasks.workunit.client.0.smithi063.stdout:0/315: mkdir d1/d3/d1b/d50/d6c 0 2024-09-17T01:56:27.556 INFO:tasks.workunit.client.0.smithi063.stdout:5/432: dread d6/f18 [0,4194304] 0 2024-09-17T01:56:27.557 INFO:tasks.workunit.client.0.smithi063.stdout:9/316: link d9/ca d9/de/d20/d32/c68 0 2024-09-17T01:56:27.558 INFO:tasks.workunit.client.0.smithi063.stdout:3/412: truncate df/d12/d30/f32 6780667 0 2024-09-17T01:56:27.558 INFO:tasks.workunit.client.0.smithi063.stdout:4/416: write de/d17/d1b/f1e [1309988,11306] 0 2024-09-17T01:56:27.558 INFO:tasks.workunit.client.0.smithi063.stdout:4/417: readlink de/d17/d36/l53 0 2024-09-17T01:56:27.559 INFO:tasks.workunit.client.0.smithi063.stdout:3/413: chown df/d28 0 1 2024-09-17T01:56:27.559 INFO:tasks.workunit.client.0.smithi063.stdout:9/317: mknod d9/de/d33/c69 0 2024-09-17T01:56:27.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/418: dread - de/d17/d1b/d67/f4e zero size 2024-09-17T01:56:27.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/414: write df/d12/d1e/d39/f7b [744107,31565] 0 2024-09-17T01:56:27.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/318: link d9/de/d20/d37/f50 d9/f6a 0 2024-09-17T01:56:27.562 INFO:tasks.workunit.client.0.smithi063.stdout:4/419: write de/d2d/d52/f5d [16634,28824] 0 2024-09-17T01:56:27.562 INFO:tasks.workunit.client.0.smithi063.stdout:1/483: dwrite d0/f8 [0,4194304] 0 2024-09-17T01:56:27.563 INFO:tasks.workunit.client.0.smithi063.stdout:4/420: fsync de/f2f 0 2024-09-17T01:56:27.563 INFO:tasks.workunit.client.0.smithi063.stdout:9/319: dread - d9/de/d20/d37/d42/f60 zero size 2024-09-17T01:56:27.564 INFO:tasks.workunit.client.0.smithi063.stdout:0/316: dwrite d1/f19 [4194304,4194304] 0 2024-09-17T01:56:27.564 INFO:tasks.workunit.client.0.smithi063.stdout:0/317: chown d1/d3/d32 81 1 2024-09-17T01:56:27.565 INFO:tasks.workunit.client.0.smithi063.stdout:5/433: read d6/d23/d29/d36/f5e [918959,49588] 0 2024-09-17T01:56:27.567 INFO:tasks.workunit.client.0.smithi063.stdout:5/434: link d6/f74 d6/d23/d29/d2b/f89 0 2024-09-17T01:56:27.568 INFO:tasks.workunit.client.0.smithi063.stdout:5/435: chown d6/d9/f45 63613876 1 2024-09-17T01:56:27.569 INFO:tasks.workunit.client.0.smithi063.stdout:5/436: mkdir d6/d9/d13/d1d/d8a 0 2024-09-17T01:56:27.570 INFO:tasks.workunit.client.0.smithi063.stdout:1/484: truncate d0/d2d/d35/d3f/d4e/f5f 199378 0 2024-09-17T01:56:27.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/421: dwrite de/f2f [0,4194304] 0 2024-09-17T01:56:27.571 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:27.573+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:27.572 INFO:tasks.workunit.client.0.smithi063.stdout:9/320: dwrite d9/de/d20/d1e/d2a/f53 [0,4194304] 0 2024-09-17T01:56:27.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/485: creat d0/d2d/d35/d9d/fa8 x:0 0 0 2024-09-17T01:56:27.575 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:27.575 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:27.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/318: dwrite d1/d3/d1b/f65 [0,4194304] 0 2024-09-17T01:56:27.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/486: unlink d0/d2d/d35/d9d/fa1 0 2024-09-17T01:56:27.579 INFO:tasks.workunit.client.0.smithi063.stdout:0/319: mkdir d1/d1d/d6d 0 2024-09-17T01:56:27.579 INFO:tasks.workunit.client.0.smithi063.stdout:2/359: sync 2024-09-17T01:56:27.580 INFO:tasks.workunit.client.0.smithi063.stdout:6/417: sync 2024-09-17T01:56:27.580 INFO:tasks.workunit.client.0.smithi063.stdout:8/308: sync 2024-09-17T01:56:27.580 INFO:tasks.workunit.client.0.smithi063.stdout:3/415: dread df/d12/d43/d50/f6a [0,4194304] 0 2024-09-17T01:56:27.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/360: mknod d3/d7/d38/c6a 0 2024-09-17T01:56:27.582 INFO:tasks.workunit.client.0.smithi063.stdout:8/309: dread - d1/d7/d28/d2f/d41/f52 zero size 2024-09-17T01:56:27.582 INFO:tasks.workunit.client.0.smithi063.stdout:8/310: chown d1/d7/d1d 499252920 1 2024-09-17T01:56:27.583 INFO:tasks.workunit.client.0.smithi063.stdout:2/361: write d3/d2a/f3d [425731,54101] 0 2024-09-17T01:56:27.583 INFO:tasks.workunit.client.0.smithi063.stdout:6/418: creat dc/d14/d19/d20/d32/d52/d5a/f89 x:0 0 0 2024-09-17T01:56:27.583 INFO:tasks.workunit.client.0.smithi063.stdout:4/422: dwrite de/f16 [0,4194304] 0 2024-09-17T01:56:27.583 INFO:tasks.workunit.client.0.smithi063.stdout:6/419: stat dc/f44 0 2024-09-17T01:56:27.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/320: write d1/d3/d1b/f4f [248891,119031] 0 2024-09-17T01:56:27.585 INFO:tasks.workunit.client.0.smithi063.stdout:1/487: write d0/d2d/d35/d3f/d4e/f6a [3531115,61488] 0 2024-09-17T01:56:27.585 INFO:tasks.workunit.client.0.smithi063.stdout:0/321: write d1/d3/db/d18/f30 [4723937,75238] 0 2024-09-17T01:56:27.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/362: symlink d3/d7/df/d5a/l6b 0 2024-09-17T01:56:27.585 INFO:tasks.workunit.client.0.smithi063.stdout:3/416: getdents df/d12/d3a/d7a 0 2024-09-17T01:56:27.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/488: unlink d0/d2d/c53 0 2024-09-17T01:56:27.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/322: mkdir d1/d3/db/d6e 0 2024-09-17T01:56:27.587 INFO:tasks.workunit.client.0.smithi063.stdout:2/363: creat d3/d7/d38/f6c x:0 0 0 2024-09-17T01:56:27.587 INFO:tasks.workunit.client.0.smithi063.stdout:6/420: getdents dc 0 2024-09-17T01:56:27.587 INFO:tasks.workunit.client.0.smithi063.stdout:0/323: chown d1/d3/c6b 1 1 2024-09-17T01:56:27.587 INFO:tasks.workunit.client.0.smithi063.stdout:2/364: readlink d3/d7/df/l2e 0 2024-09-17T01:56:27.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/417: creat df/d12/d1e/d5e/f8d x:0 0 0 2024-09-17T01:56:27.588 INFO:tasks.workunit.client.0.smithi063.stdout:2/365: symlink d3/d7/df/l6d 0 2024-09-17T01:56:27.588 INFO:tasks.workunit.client.0.smithi063.stdout:3/418: chown df/d12/c46 325964879 1 2024-09-17T01:56:27.590 INFO:tasks.workunit.client.0.smithi063.stdout:2/366: rename d3/d7/df/d30/f3e to d3/f6e 0 2024-09-17T01:56:27.592 INFO:tasks.workunit.client.0.smithi063.stdout:8/311: truncate d1/d27/f4b 3613618 0 2024-09-17T01:56:27.593 INFO:tasks.workunit.client.0.smithi063.stdout:7/305: dread d2/fb [0,4194304] 0 2024-09-17T01:56:27.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/312: symlink d1/d7/d28/d2a/d37/d3a/l60 0 2024-09-17T01:56:27.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/313: stat d1/f18 0 2024-09-17T01:56:27.595 INFO:tasks.workunit.client.0.smithi063.stdout:7/306: creat d2/d15/d2f/d52/f63 x:0 0 0 2024-09-17T01:56:27.596 INFO:tasks.workunit.client.0.smithi063.stdout:8/314: write d1/d7/f39 [231043,20996] 0 2024-09-17T01:56:27.596 INFO:tasks.workunit.client.0.smithi063.stdout:3/419: dwrite df/d28/f2a [0,4194304] 0 2024-09-17T01:56:27.597 INFO:tasks.workunit.client.0.smithi063.stdout:0/324: dread d1/d3/f8 [0,4194304] 0 2024-09-17T01:56:27.597 INFO:tasks.workunit.client.0.smithi063.stdout:7/307: write d2/df/f10 [4795716,16260] 0 2024-09-17T01:56:27.599 INFO:tasks.workunit.client.0.smithi063.stdout:3/420: symlink df/d12/d30/l8e 0 2024-09-17T01:56:27.599 INFO:tasks.workunit.client.0.smithi063.stdout:7/308: creat d2/d15/d2f/f64 x:0 0 0 2024-09-17T01:56:27.599 INFO:tasks.workunit.client.0.smithi063.stdout:0/325: mknod d1/d44/d53/d62/c6f 0 2024-09-17T01:56:27.599 INFO:tasks.workunit.client.0.smithi063.stdout:3/421: getdents df/d28 0 2024-09-17T01:56:27.600 INFO:tasks.workunit.client.0.smithi063.stdout:3/422: fdatasync df/d12/d1e/d39/f6c 0 2024-09-17T01:56:27.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:27.603 INFO:tasks.workunit.client.0.smithi063.stdout:3/423: rename df/d28/f2a to df/d12/d1e/d5e/f8f 0 2024-09-17T01:56:27.604 INFO:tasks.workunit.client.0.smithi063.stdout:3/424: chown df/d12/d2d/d2f/c35 5812191 1 2024-09-17T01:56:27.605 INFO:tasks.workunit.client.0.smithi063.stdout:3/425: creat df/d28/f90 x:0 0 0 2024-09-17T01:56:27.606 INFO:tasks.workunit.client.0.smithi063.stdout:6/421: dwrite dc/d14/d18/f64 [0,4194304] 0 2024-09-17T01:56:27.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/489: dwrite d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:27.613 INFO:tasks.workunit.client.0.smithi063.stdout:3/426: creat df/d12/d1e/d39/f91 x:0 0 0 2024-09-17T01:56:27.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/422: rename dc/d14/d19/f6f to dc/d14/d19/d20/d32/d52/d5a/d62/d7e/f8a 0 2024-09-17T01:56:27.613 INFO:tasks.workunit.client.0.smithi063.stdout:1/490: rmdir d0/d2d/d35/d3f/d86 0 2024-09-17T01:56:27.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/423: chown dc/d14/d19/d20/d32/d52/d5a/f89 228959630 1 2024-09-17T01:56:27.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/424: creat dc/d14/d19/d20/f8b x:0 0 0 2024-09-17T01:56:27.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/425: write dc/d14/d18/f63 [305715,35303] 0 2024-09-17T01:56:27.615 INFO:tasks.workunit.client.0.smithi063.stdout:6/426: dread - dc/d14/d19/d20/d32/d52/f60 zero size 2024-09-17T01:56:27.618 INFO:tasks.workunit.client.0.smithi063.stdout:5/437: dread d6/d37/d19/f2c [0,4194304] 0 2024-09-17T01:56:27.620 INFO:tasks.workunit.client.0.smithi063.stdout:1/491: read d0/d2d/d35/d3f/d81/f42 [438043,73716] 0 2024-09-17T01:56:27.621 INFO:tasks.workunit.client.0.smithi063.stdout:9/321: sync 2024-09-17T01:56:27.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/326: sync 2024-09-17T01:56:27.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/423: dread de/d2d/f33 [0,4194304] 0 2024-09-17T01:56:27.622 INFO:tasks.workunit.client.0.smithi063.stdout:9/322: creat d9/de/d20/d37/d42/f6b x:0 0 0 2024-09-17T01:56:27.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/424: stat de/d17/d1b/f6b 0 2024-09-17T01:56:27.624 INFO:tasks.workunit.client.0.smithi063.stdout:4/425: mknod de/d2d/d52/c7c 0 2024-09-17T01:56:27.625 INFO:tasks.workunit.client.0.smithi063.stdout:9/323: creat d9/de/d20/d1e/d2a/d40/f6c x:0 0 0 2024-09-17T01:56:27.626 INFO:tasks.workunit.client.0.smithi063.stdout:5/438: dwrite d6/d23/d3a/f4c [0,4194304] 0 2024-09-17T01:56:27.626 INFO:tasks.workunit.client.0.smithi063.stdout:3/427: dread df/d12/d3a/f44 [0,4194304] 0 2024-09-17T01:56:27.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/315: dread d1/d7/d28/f50 [0,4194304] 0 2024-09-17T01:56:27.628 INFO:tasks.workunit.client.0.smithi063.stdout:8/316: readlink d1/d7/d28/d2f/d41/l47 0 2024-09-17T01:56:27.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/426: truncate de/f57 701756 0 2024-09-17T01:56:27.632 INFO:tasks.workunit.client.0.smithi063.stdout:3/428: rename df/d12/d1e/d53/f89 to df/d12/d3a/f92 0 2024-09-17T01:56:27.632 INFO:tasks.workunit.client.0.smithi063.stdout:3/429: rename df/d12/c46 to df/d83/c93 0 2024-09-17T01:56:27.632 INFO:tasks.workunit.client.0.smithi063.stdout:9/324: dread d9/de/d20/d1b/f2d [0,4194304] 0 2024-09-17T01:56:27.632 INFO:tasks.workunit.client.0.smithi063.stdout:3/430: fsync df/d12/d2d/f52 0 2024-09-17T01:56:27.633 INFO:tasks.workunit.client.0.smithi063.stdout:7/309: dread d2/d3/d27/d39/f42 [4194304,4194304] 0 2024-09-17T01:56:27.633 INFO:tasks.workunit.client.0.smithi063.stdout:7/310: chown d2/d3/d27 21446 1 2024-09-17T01:56:27.634 INFO:tasks.workunit.client.0.smithi063.stdout:9/325: write d9/de/d20/d37/f58 [274671,130829] 0 2024-09-17T01:56:27.634 INFO:tasks.workunit.client.0.smithi063.stdout:7/311: unlink d2/df/f11 0 2024-09-17T01:56:27.634 INFO:tasks.workunit.client.0.smithi063.stdout:9/326: unlink d9/c10 0 2024-09-17T01:56:27.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/327: dread - d9/f56 zero size 2024-09-17T01:56:27.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/439: truncate d6/f18 567887 0 2024-09-17T01:56:27.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/367: dread d3/d7/df/f1e [0,4194304] 0 2024-09-17T01:56:27.636 INFO:tasks.workunit.client.0.smithi063.stdout:9/328: symlink d9/de/d20/d1b/d25/l6d 0 2024-09-17T01:56:27.637 INFO:tasks.workunit.client.0.smithi063.stdout:7/312: rename d2/d3/d22/d56 to d2/d3/d27/d65 0 2024-09-17T01:56:27.637 INFO:tasks.workunit.client.0.smithi063.stdout:7/313: stat d2 0 2024-09-17T01:56:27.638 INFO:tasks.workunit.client.0.smithi063.stdout:2/368: mknod d3/d7/df/c6f 0 2024-09-17T01:56:27.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/440: creat d6/d9/d13/d1d/f8b x:0 0 0 2024-09-17T01:56:27.639 INFO:tasks.workunit.client.0.smithi063.stdout:9/329: fsync d9/de/d20/d1b/d25/f4e 0 2024-09-17T01:56:27.639 INFO:tasks.workunit.client.0.smithi063.stdout:2/369: dread - d3/d2a/f54 zero size 2024-09-17T01:56:27.639 INFO:tasks.workunit.client.0.smithi063.stdout:5/441: mkdir d6/d9/d32/d8c 0 2024-09-17T01:56:27.640 INFO:tasks.workunit.client.0.smithi063.stdout:7/314: unlink d2/d15/l1f 0 2024-09-17T01:56:27.641 INFO:tasks.workunit.client.0.smithi063.stdout:5/442: fdatasync d6/d35/f6c 0 2024-09-17T01:56:27.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/431: dwrite df/f26 [0,4194304] 0 2024-09-17T01:56:27.641 INFO:tasks.workunit.client.0.smithi063.stdout:5/443: chown d6/d37/d19/d68/f78 180 1 2024-09-17T01:56:27.642 INFO:tasks.workunit.client.0.smithi063.stdout:7/315: mknod d2/d3/d22/d3a/c66 0 2024-09-17T01:56:27.644 INFO:tasks.workunit.client.0.smithi063.stdout:5/444: symlink d6/d23/d29/d36/l8d 0 2024-09-17T01:56:27.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/492: dread d0/d2d/d35/d3f/d81/d50/d8b/f8e [0,4194304] 0 2024-09-17T01:56:27.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/316: rename d2/df to d2/d3/d67 0 2024-09-17T01:56:27.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/445: creat d6/d9/d32/f8e x:0 0 0 2024-09-17T01:56:27.645 INFO:tasks.workunit.client.0.smithi063.stdout:7/317: fdatasync d2/f7 0 2024-09-17T01:56:27.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/432: getdents df/d12/d3a 0 2024-09-17T01:56:27.646 INFO:tasks.workunit.client.0.smithi063.stdout:5/446: chown d6/d23/d54 28 1 2024-09-17T01:56:27.647 INFO:tasks.workunit.client.0.smithi063.stdout:3/433: mknod df/d12/d1e/d39/c94 0 2024-09-17T01:56:27.647 INFO:tasks.workunit.client.0.smithi063.stdout:1/493: creat d0/d2d/d5e/d7e/fa9 x:0 0 0 2024-09-17T01:56:27.647 INFO:tasks.workunit.client.0.smithi063.stdout:2/370: dwrite d3/f6e [0,4194304] 0 2024-09-17T01:56:27.647 INFO:tasks.workunit.client.0.smithi063.stdout:5/447: chown d6/d37/d19/d76 324 1 2024-09-17T01:56:27.647 INFO:tasks.workunit.client.0.smithi063.stdout:1/494: read - d0/d2d/d35/d9d/fa8 zero size 2024-09-17T01:56:27.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/434: chown df/d12/d1e/d39/c6d 84778 1 2024-09-17T01:56:27.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/427: dread de/d2d/d52/f5f [0,4194304] 0 2024-09-17T01:56:27.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/428: fdatasync de/f16 0 2024-09-17T01:56:27.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/448: mkdir d6/d37/d19/d76/d8f 0 2024-09-17T01:56:27.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/495: symlink d0/d2d/d35/d3f/d81/laa 0 2024-09-17T01:56:27.652 INFO:tasks.workunit.client.0.smithi063.stdout:7/318: fdatasync d2/d3/d27/d39/f46 0 2024-09-17T01:56:27.652 INFO:tasks.workunit.client.0.smithi063.stdout:4/429: chown de/d17/d1b/l78 2983190 1 2024-09-17T01:56:27.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/449: chown d6/d37/d19/d76/d8f 114404790 1 2024-09-17T01:56:27.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/450: write d6/d37/d19/f75 [1532247,30647] 0 2024-09-17T01:56:27.655 INFO:tasks.workunit.client.0.smithi063.stdout:2/371: dwrite d3/d7/d38/f56 [0,4194304] 0 2024-09-17T01:56:27.655 INFO:tasks.workunit.client.0.smithi063.stdout:7/319: fsync d2/d3/d27/d39/f46 0 2024-09-17T01:56:27.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/451: link d6/d35/l48 d6/d9/d13/d1d/l90 0 2024-09-17T01:56:27.657 INFO:tasks.workunit.client.0.smithi063.stdout:2/372: mkdir d3/d7/df/d43/d70 0 2024-09-17T01:56:27.657 INFO:tasks.workunit.client.0.smithi063.stdout:7/320: readlink d2/d3/d27/l43 0 2024-09-17T01:56:27.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/321: stat d2/d3/d27/d39/f4e 0 2024-09-17T01:56:27.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/322: dread - d2/d15/d2f/d52/f63 zero size 2024-09-17T01:56:27.661 INFO:tasks.workunit.client.0.smithi063.stdout:1/496: dwrite d0/d1c/f41 [4194304,4194304] 0 2024-09-17T01:56:27.661 INFO:tasks.workunit.client.0.smithi063.stdout:7/323: creat d2/d15/d2f/d52/f68 x:0 0 0 2024-09-17T01:56:27.662 INFO:tasks.workunit.client.0.smithi063.stdout:1/497: write d0/f20 [5044437,46025] 0 2024-09-17T01:56:27.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/430: read de/d17/d1b/d67/d28/d30/f61 [76136,125598] 0 2024-09-17T01:56:27.665 INFO:tasks.workunit.client.0.smithi063.stdout:4/431: chown de/d17/d1b/f62 14 1 2024-09-17T01:56:27.665 INFO:tasks.workunit.client.0.smithi063.stdout:6/427: sync 2024-09-17T01:56:27.665 INFO:tasks.workunit.client.0.smithi063.stdout:9/330: dread d9/d27/f3b [0,4194304] 0 2024-09-17T01:56:27.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/327: sync 2024-09-17T01:56:27.666 INFO:tasks.workunit.client.0.smithi063.stdout:8/317: sync 2024-09-17T01:56:27.666 INFO:tasks.workunit.client.0.smithi063.stdout:4/432: symlink de/d17/d1b/d67/d28/d30/l7d 0 2024-09-17T01:56:27.667 INFO:tasks.workunit.client.0.smithi063.stdout:8/318: chown d1/d7/d28/d2f/d41/d49/c35 6 1 2024-09-17T01:56:27.669 INFO:tasks.workunit.client.0.smithi063.stdout:0/328: write d1/d3/d1b/f38 [5827284,36610] 0 2024-09-17T01:56:27.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/324: dread d2/d3/d27/d39/f4b [0,4194304] 0 2024-09-17T01:56:27.671 INFO:tasks.workunit.client.0.smithi063.stdout:8/319: unlink d1/d27/c54 0 2024-09-17T01:56:27.671 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:27.673+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:27.673 INFO:tasks.workunit.client.0.smithi063.stdout:2/373: dread d3/d7/df/d68/f35 [0,4194304] 0 2024-09-17T01:56:27.674 INFO:tasks.workunit.client.0.smithi063.stdout:1/498: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [0,4194304] 0 2024-09-17T01:56:27.675 INFO:tasks.workunit.client.0.smithi063.stdout:4/433: dread de/d17/d1b/f79 [0,4194304] 0 2024-09-17T01:56:27.677 INFO:tasks.workunit.client.0.smithi063.stdout:7/325: dread d2/d15/f59 [0,4194304] 0 2024-09-17T01:56:27.677 INFO:tasks.workunit.client.0.smithi063.stdout:3/435: dread df/d12/d1e/f2b [0,4194304] 0 2024-09-17T01:56:27.678 INFO:tasks.workunit.client.0.smithi063.stdout:8/320: creat d1/d7/d28/d2f/d41/d49/f61 x:0 0 0 2024-09-17T01:56:27.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/428: dwrite dc/d14/d2f/f51 [0,4194304] 0 2024-09-17T01:56:27.680 INFO:tasks.workunit.client.0.smithi063.stdout:9/331: dwrite d9/de/d20/d37/d42/f60 [0,4194304] 0 2024-09-17T01:56:27.681 INFO:tasks.workunit.client.0.smithi063.stdout:4/434: truncate de/d17/d1b/d67/f4e 625 0 2024-09-17T01:56:27.682 INFO:tasks.workunit.client.0.smithi063.stdout:1/499: mknod d0/d2d/d35/d3f/d81/d50/d6c/d74/cab 0 2024-09-17T01:56:27.682 INFO:tasks.workunit.client.0.smithi063.stdout:3/436: chown df/d12/d1e/d5e/l70 19 1 2024-09-17T01:56:27.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/326: creat d2/d15/d2f/d45/f69 x:0 0 0 2024-09-17T01:56:27.683 INFO:tasks.workunit.client.0.smithi063.stdout:8/321: mkdir d1/d7/d28/d2f/d62 0 2024-09-17T01:56:27.684 INFO:tasks.workunit.client.0.smithi063.stdout:2/374: rename f2 to d3/d7/df/f71 0 2024-09-17T01:56:27.684 INFO:tasks.workunit.client.0.smithi063.stdout:4/435: mknod de/d17/d36/c7e 0 2024-09-17T01:56:27.685 INFO:tasks.workunit.client.0.smithi063.stdout:0/329: dwrite d1/d1d/f2d [0,4194304] 0 2024-09-17T01:56:27.685 INFO:tasks.workunit.client.0.smithi063.stdout:1/500: mknod d0/d1c/cac 0 2024-09-17T01:56:27.685 INFO:tasks.workunit.client.0.smithi063.stdout:6/429: write dc/d14/d18/f16 [4599046,20701] 0 2024-09-17T01:56:27.685 INFO:tasks.workunit.client.0.smithi063.stdout:5/452: dread d6/d9/d32/f71 [0,4194304] 0 2024-09-17T01:56:27.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/332: creat d9/de/d20/d1b/f6e x:0 0 0 2024-09-17T01:56:27.689 INFO:tasks.workunit.client.0.smithi063.stdout:2/375: mkdir d3/d28/d72 0 2024-09-17T01:56:27.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/436: rmdir de/d17/d1b/d67/d28 39 2024-09-17T01:56:27.691 INFO:tasks.workunit.client.0.smithi063.stdout:5/453: rmdir d6/d37/d79/d85 0 2024-09-17T01:56:27.691 INFO:tasks.workunit.client.0.smithi063.stdout:8/322: creat d1/d7/d28/d2f/d41/d49/f63 x:0 0 0 2024-09-17T01:56:27.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/333: creat d9/de/d20/d1e/d2a/d36/f6f x:0 0 0 2024-09-17T01:56:27.693 INFO:tasks.workunit.client.0.smithi063.stdout:8/323: creat d1/d27/f64 x:0 0 0 2024-09-17T01:56:27.695 INFO:tasks.workunit.client.0.smithi063.stdout:4/437: mknod de/d17/d1b/c7f 0 2024-09-17T01:56:27.695 INFO:tasks.workunit.client.0.smithi063.stdout:8/324: write d1/d7/d1d/f1f [4254762,113284] 0 2024-09-17T01:56:27.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/327: dwrite d2/d3/d27/d39/f3c [0,4194304] 0 2024-09-17T01:56:27.696 INFO:tasks.workunit.client.0.smithi063.stdout:9/334: mknod d9/de/d20/c70 0 2024-09-17T01:56:27.696 INFO:tasks.workunit.client.0.smithi063.stdout:8/325: fdatasync d1/f16 0 2024-09-17T01:56:27.697 INFO:tasks.workunit.client.0.smithi063.stdout:1/501: dwrite d0/d2d/d35/d3f/d4e/f5f [4194304,4194304] 0 2024-09-17T01:56:27.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/335: write d9/de/d20/f24 [1736883,12752] 0 2024-09-17T01:56:27.697 INFO:tasks.workunit.client.0.smithi063.stdout:4/438: write de/d17/d1b/f62 [424236,121712] 0 2024-09-17T01:56:27.698 INFO:tasks.workunit.client.0.smithi063.stdout:6/430: dread dc/f38 [0,4194304] 0 2024-09-17T01:56:27.700 INFO:tasks.workunit.client.0.smithi063.stdout:8/326: unlink f0 0 2024-09-17T01:56:27.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/437: truncate df/d12/d1e/f27 279841 0 2024-09-17T01:56:27.701 INFO:tasks.workunit.client.0.smithi063.stdout:6/431: mknod dc/d14/d19/d20/d32/d52/c8c 0 2024-09-17T01:56:27.701 INFO:tasks.workunit.client.0.smithi063.stdout:1/502: mknod d0/d2d/d35/d3f/cad 0 2024-09-17T01:56:27.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/336: creat d9/de/d20/d1e/d2a/d40/f71 x:0 0 0 2024-09-17T01:56:27.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/376: write d3/d7/df/f19 [232133,66574] 0 2024-09-17T01:56:27.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/438: chown df/d28/f90 2 1 2024-09-17T01:56:27.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/432: write dc/d14/d19/d20/d32/d68/f6c [110907,64452] 0 2024-09-17T01:56:27.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/337: fsync d9/de/d20/d37/d42/f6b 0 2024-09-17T01:56:27.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/328: creat d2/d3/d27/d39/d40/f6a x:0 0 0 2024-09-17T01:56:27.705 INFO:tasks.workunit.client.0.smithi063.stdout:5/454: truncate d6/d9/d13/d1d/f24 1785702 0 2024-09-17T01:56:27.705 INFO:tasks.workunit.client.0.smithi063.stdout:8/327: rename d1/d7/d28/d2f/d41/l47 to d1/d7/d28/d2a/d4d/l65 0 2024-09-17T01:56:27.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/377: creat d3/d2a/f73 x:0 0 0 2024-09-17T01:56:27.706 INFO:tasks.workunit.client.0.smithi063.stdout:3/439: truncate df/d12/d43/f62 1538015 0 2024-09-17T01:56:27.706 INFO:tasks.workunit.client.0.smithi063.stdout:6/433: mknod dc/c8d 0 2024-09-17T01:56:27.706 INFO:tasks.workunit.client.0.smithi063.stdout:0/330: dwrite d1/d3/db/f42 [0,4194304] 0 2024-09-17T01:56:27.707 INFO:tasks.workunit.client.0.smithi063.stdout:7/329: chown d2/d3/d27/d39/f4e 26576535 1 2024-09-17T01:56:27.708 INFO:tasks.workunit.client.0.smithi063.stdout:2/378: dread - d3/d7/df/d68/f59 zero size 2024-09-17T01:56:27.708 INFO:tasks.workunit.client.0.smithi063.stdout:5/455: write d6/d9/d13/f1e [1948894,48082] 0 2024-09-17T01:56:27.708 INFO:tasks.workunit.client.0.smithi063.stdout:8/328: unlink d1/f18 0 2024-09-17T01:56:27.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/331: write d1/d3/db/f13 [852927,111677] 0 2024-09-17T01:56:27.710 INFO:tasks.workunit.client.0.smithi063.stdout:7/330: write d2/d3/d27/d39/f3c [2034766,15629] 0 2024-09-17T01:56:27.710 INFO:tasks.workunit.client.0.smithi063.stdout:8/329: write d1/f2 [2006347,121531] 0 2024-09-17T01:56:27.711 INFO:tasks.workunit.client.0.smithi063.stdout:5/456: creat d6/f91 x:0 0 0 2024-09-17T01:56:27.711 INFO:tasks.workunit.client.0.smithi063.stdout:3/440: truncate df/d12/d43/f62 1552572 0 2024-09-17T01:56:27.711 INFO:tasks.workunit.client.0.smithi063.stdout:1/503: getdents d0/d2d/d35/d3f/d81/d50 0 2024-09-17T01:56:27.712 INFO:tasks.workunit.client.0.smithi063.stdout:0/332: read d1/d3/f4 [1079205,52531] 0 2024-09-17T01:56:27.713 INFO:tasks.workunit.client.0.smithi063.stdout:7/331: creat d2/d15/f6b x:0 0 0 2024-09-17T01:56:27.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/379: fdatasync d3/d7/df/d30/f67 0 2024-09-17T01:56:27.713 INFO:tasks.workunit.client.0.smithi063.stdout:4/439: dwrite de/d2d/f43 [0,4194304] 0 2024-09-17T01:56:27.713 INFO:tasks.workunit.client.0.smithi063.stdout:5/457: mkdir d6/d37/d19/d50/d92 0 2024-09-17T01:56:27.714 INFO:tasks.workunit.client.0.smithi063.stdout:1/504: fsync d0/d2d/d35/d3f/d94/fa2 0 2024-09-17T01:56:27.714 INFO:tasks.workunit.client.0.smithi063.stdout:8/330: mkdir d1/d7/d28/d2f/d62/d66 0 2024-09-17T01:56:27.714 INFO:tasks.workunit.client.0.smithi063.stdout:0/333: stat d1/d3/db/d4b/f1c 0 2024-09-17T01:56:27.714 INFO:tasks.workunit.client.0.smithi063.stdout:3/441: creat df/d12/d1e/d39/f95 x:0 0 0 2024-09-17T01:56:27.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/458: symlink d6/d23/d29/l93 0 2024-09-17T01:56:27.717 INFO:tasks.workunit.client.0.smithi063.stdout:2/380: dread - d3/d7/df/d68/f59 zero size 2024-09-17T01:56:27.717 INFO:tasks.workunit.client.0.smithi063.stdout:9/338: dwrite d9/de/d20/d1e/d2a/d40/f5c [0,4194304] 0 2024-09-17T01:56:27.719 INFO:tasks.workunit.client.0.smithi063.stdout:1/505: rmdir d0/d2d/d5e 39 2024-09-17T01:56:27.719 INFO:tasks.workunit.client.0.smithi063.stdout:8/331: creat d1/d7/d28/d2f/d41/f67 x:0 0 0 2024-09-17T01:56:27.719 INFO:tasks.workunit.client.0.smithi063.stdout:3/442: unlink df/d12/d3a/f44 0 2024-09-17T01:56:27.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/334: symlink d1/d44/d53/l70 0 2024-09-17T01:56:27.722 INFO:tasks.workunit.client.0.smithi063.stdout:4/440: symlink de/d17/d36/d70/d77/l80 0 2024-09-17T01:56:27.722 INFO:tasks.workunit.client.0.smithi063.stdout:6/434: rename dc/d14/d19/d20/d32/c36 to dc/d14/c8e 0 2024-09-17T01:56:27.722 INFO:tasks.workunit.client.0.smithi063.stdout:9/339: symlink d9/de/d20/l72 0 2024-09-17T01:56:27.722 INFO:tasks.workunit.client.0.smithi063.stdout:0/335: creat d1/d3/db/d18/d33/f71 x:0 0 0 2024-09-17T01:56:27.723 INFO:tasks.workunit.client.0.smithi063.stdout:1/506: chown d0/d2d/d35/d3f/d4e/d66/f69 179043672 1 2024-09-17T01:56:27.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/435: unlink dc/d14/c15 0 2024-09-17T01:56:27.726 INFO:tasks.workunit.client.0.smithi063.stdout:7/332: dwrite d2/d3/d27/d39/f3c [0,4194304] 0 2024-09-17T01:56:27.729 INFO:tasks.workunit.client.0.smithi063.stdout:7/333: chown d2/d3/c35 185068195 1 2024-09-17T01:56:27.731 INFO:tasks.workunit.client.0.smithi063.stdout:4/441: dread de/d17/d1b/d67/f55 [0,4194304] 0 2024-09-17T01:56:27.731 INFO:tasks.workunit.client.0.smithi063.stdout:5/459: getdents d6/d23/d29/d2b/d31 0 2024-09-17T01:56:27.732 INFO:tasks.workunit.client.0.smithi063.stdout:2/381: dwrite d3/d7/df/d68/f35 [0,4194304] 0 2024-09-17T01:56:27.732 INFO:tasks.workunit.client.0.smithi063.stdout:9/340: truncate d9/de/d20/d37/f58 250964 0 2024-09-17T01:56:27.736 INFO:tasks.workunit.client.0.smithi063.stdout:0/336: link d1/d44/d53/d62/c6f d1/d3/d1b/d50/d6c/c72 0 2024-09-17T01:56:27.737 INFO:tasks.workunit.client.0.smithi063.stdout:3/443: dwrite df/f26 [0,4194304] 0 2024-09-17T01:56:27.737 INFO:tasks.workunit.client.0.smithi063.stdout:9/341: mkdir d9/de/d20/d1b/d25/d73 0 2024-09-17T01:56:27.738 INFO:tasks.workunit.client.0.smithi063.stdout:5/460: symlink d6/d23/d29/d2b/d31/l94 0 2024-09-17T01:56:27.739 INFO:tasks.workunit.client.0.smithi063.stdout:1/507: dwrite d0/f8 [0,4194304] 0 2024-09-17T01:56:27.740 INFO:tasks.workunit.client.0.smithi063.stdout:0/337: rename d1/d1d/c47 to d1/d1f/c73 0 2024-09-17T01:56:27.742 INFO:tasks.workunit.client.0.smithi063.stdout:8/332: dwrite d1/d7/f4c [4194304,4194304] 0 2024-09-17T01:56:27.742 INFO:tasks.workunit.client.0.smithi063.stdout:5/461: write d6/d23/f58 [834356,87386] 0 2024-09-17T01:56:27.742 INFO:tasks.workunit.client.0.smithi063.stdout:6/436: dwrite dc/d14/d18/f42 [4194304,4194304] 0 2024-09-17T01:56:27.744 INFO:tasks.workunit.client.0.smithi063.stdout:7/334: dread d2/d15/f59 [0,4194304] 0 2024-09-17T01:56:27.744 INFO:tasks.workunit.client.0.smithi063.stdout:3/444: dread - df/d12/d3a/f73 zero size 2024-09-17T01:56:27.746 INFO:tasks.workunit.client.0.smithi063.stdout:6/437: read dc/d14/d2f/f51 [2125414,54411] 0 2024-09-17T01:56:27.746 INFO:tasks.workunit.client.0.smithi063.stdout:9/342: getdents d9/de/d20/d32 0 2024-09-17T01:56:27.747 INFO:tasks.workunit.client.0.smithi063.stdout:2/382: dwrite d3/d2a/f54 [0,4194304] 0 2024-09-17T01:56:27.747 INFO:tasks.workunit.client.0.smithi063.stdout:8/333: rename d1/d7/d1d/c2c to d1/d7/d1d/c68 0 2024-09-17T01:56:27.749 INFO:tasks.workunit.client.0.smithi063.stdout:9/343: creat d9/f74 x:0 0 0 2024-09-17T01:56:27.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/334: mknod d1/d7/d28/d2f/d41/c69 0 2024-09-17T01:56:27.750 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:27.750 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:27.751 INFO:tasks.workunit.client.0.smithi063.stdout:6/438: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f 0 2024-09-17T01:56:27.751 INFO:tasks.workunit.client.0.smithi063.stdout:5/462: link d6/d9/f28 d6/d35/f95 0 2024-09-17T01:56:27.751 INFO:tasks.workunit.client.0.smithi063.stdout:8/335: fsync d1/d7/f14 0 2024-09-17T01:56:27.752 INFO:tasks.workunit.client.0.smithi063.stdout:5/463: unlink d6/d37/cf 0 2024-09-17T01:56:27.752 INFO:tasks.workunit.client.0.smithi063.stdout:9/344: mkdir d9/de/d20/d1e/d75 0 2024-09-17T01:56:27.752 INFO:tasks.workunit.client.0.smithi063.stdout:6/439: chown dc/d14/f70 10385 1 2024-09-17T01:56:27.752 INFO:tasks.workunit.client.0.smithi063.stdout:2/383: dread d3/d7/df/f1e [0,4194304] 0 2024-09-17T01:56:27.752 INFO:tasks.workunit.client.0.smithi063.stdout:8/336: write d1/d7/d28/d2f/d41/f58 [7088579,56779] 0 2024-09-17T01:56:27.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/464: creat d6/d23/d29/f96 x:0 0 0 2024-09-17T01:56:27.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/335: dwrite d2/fd [4194304,4194304] 0 2024-09-17T01:56:27.753 INFO:tasks.workunit.client.0.smithi063.stdout:6/440: stat dc/d14/d19/d20/d32/c55 0 2024-09-17T01:56:27.754 INFO:tasks.workunit.client.0.smithi063.stdout:9/345: write d9/d27/f3b [279326,103301] 0 2024-09-17T01:56:27.754 INFO:tasks.workunit.client.0.smithi063.stdout:2/384: rmdir d3/d7/df/d5a 39 2024-09-17T01:56:27.756 INFO:tasks.workunit.client.0.smithi063.stdout:2/385: read - d3/d7/d38/f6c zero size 2024-09-17T01:56:27.757 INFO:tasks.workunit.client.0.smithi063.stdout:6/441: read - dc/d14/d19/f3d zero size 2024-09-17T01:56:27.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/465: creat d6/d23/d29/d36/f97 x:0 0 0 2024-09-17T01:56:27.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/466: mkdir d6/d37/d19/d50/d98 0 2024-09-17T01:56:27.757 INFO:tasks.workunit.client.0.smithi063.stdout:6/442: fdatasync dc/d14/d19/d20/d32/d52/d5a/d43/f49 0 2024-09-17T01:56:27.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/467: fdatasync d6/d23/f77 0 2024-09-17T01:56:27.758 INFO:tasks.workunit.client.0.smithi063.stdout:5/468: creat d6/d23/d3a/f99 x:0 0 0 2024-09-17T01:56:27.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/443: mknod dc/d14/d19/d20/d32/d52/d5a/d43/c90 0 2024-09-17T01:56:27.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/338: truncate d1/d3/d32/f69 1309943 0 2024-09-17T01:56:27.760 INFO:tasks.workunit.client.0.smithi063.stdout:5/469: mknod d6/d37/d79/c9a 0 2024-09-17T01:56:27.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/444: mkdir dc/d14/d18/d91 0 2024-09-17T01:56:27.760 INFO:tasks.workunit.client.0.smithi063.stdout:4/442: truncate de/d17/d1b/f6b 521232 0 2024-09-17T01:56:27.761 INFO:tasks.workunit.client.0.smithi063.stdout:6/445: write dc/d14/d19/d20/f8b [422842,47195] 0 2024-09-17T01:56:27.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/337: dread d1/d7/d28/f42 [0,4194304] 0 2024-09-17T01:56:27.761 INFO:tasks.workunit.client.0.smithi063.stdout:5/470: chown d6/d23/d29/d36/f5b 29 1 2024-09-17T01:56:27.762 INFO:tasks.workunit.client.0.smithi063.stdout:0/339: truncate d1/d3/d1b/d50/f68 566874 0 2024-09-17T01:56:27.762 INFO:tasks.workunit.client.0.smithi063.stdout:9/346: write d9/de/d20/d37/f50 [865669,2261] 0 2024-09-17T01:56:27.763 INFO:tasks.workunit.client.0.smithi063.stdout:8/338: fdatasync d1/d7/d28/d2f/d41/d49/f61 0 2024-09-17T01:56:27.764 INFO:tasks.workunit.client.0.smithi063.stdout:0/340: mkdir d1/d1d/d74 0 2024-09-17T01:56:27.764 INFO:tasks.workunit.client.0.smithi063.stdout:7/336: dwrite d2/d3/d27/f2d [0,4194304] 0 2024-09-17T01:56:27.764 INFO:tasks.workunit.client.0.smithi063.stdout:8/339: chown d1/d7/d28/d2f/d41/f58 922 1 2024-09-17T01:56:27.765 INFO:tasks.workunit.client.0.smithi063.stdout:7/337: chown d2/fd 905 1 2024-09-17T01:56:27.768 INFO:tasks.workunit.client.0.smithi063.stdout:9/347: rename d9/de/d20/d1b/d25/l6d to d9/de/d20/l76 0 2024-09-17T01:56:27.768 INFO:tasks.workunit.client.0.smithi063.stdout:0/341: mknod d1/d3/db/d4b/d2f/d56/c75 0 2024-09-17T01:56:27.768 INFO:tasks.workunit.client.0.smithi063.stdout:8/340: mknod d1/d7/d28/d2f/d41/d49/c6a 0 2024-09-17T01:56:27.768 INFO:tasks.workunit.client.0.smithi063.stdout:8/341: fsync d1/d7/d1d/f40 0 2024-09-17T01:56:27.769 INFO:tasks.workunit.client.0.smithi063.stdout:8/342: dread - d1/d7/d28/d2a/f5a zero size 2024-09-17T01:56:27.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/471: link d6/d37/d19/c25 d6/d23/d3f/c9b 0 2024-09-17T01:56:27.769 INFO:tasks.workunit.client.0.smithi063.stdout:0/342: dread d1/d3/f8 [0,4194304] 0 2024-09-17T01:56:27.769 INFO:tasks.workunit.client.0.smithi063.stdout:6/446: truncate dc/d14/d19/d20/d32/d52/d5a/d43/f49 1854820 0 2024-09-17T01:56:27.771 INFO:tasks.workunit.client.0.smithi063.stdout:4/443: truncate de/d17/d1b/f62 47322 0 2024-09-17T01:56:27.771 INFO:tasks.workunit.client.0.smithi063.stdout:0/343: truncate d1/d3/db/d18/d33/f67 4400634 0 2024-09-17T01:56:27.772 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:27.773+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:27.772 INFO:tasks.workunit.client.0.smithi063.stdout:4/444: creat de/d17/d36/f81 x:0 0 0 2024-09-17T01:56:27.773 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:27.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/508: dread d0/d2d/d35/d3f/d4e/f6a [0,4194304] 0 2024-09-17T01:56:27.774 INFO:tasks.workunit.client.0.smithi063.stdout:4/445: chown de/d17/d1b/d67/d28/d30/l48 118 1 2024-09-17T01:56:27.776 INFO:tasks.workunit.client.0.smithi063.stdout:1/509: creat d0/d2d/fae x:0 0 0 2024-09-17T01:56:27.776 INFO:tasks.workunit.client.0.smithi063.stdout:4/446: read de/d2d/f33 [4151720,99800] 0 2024-09-17T01:56:27.777 INFO:tasks.workunit.client.0.smithi063.stdout:1/510: write d0/d1c/f48 [608797,22391] 0 2024-09-17T01:56:27.777 INFO:tasks.workunit.client.0.smithi063.stdout:4/447: symlink de/d2d/d52/l82 0 2024-09-17T01:56:27.778 INFO:tasks.workunit.client.0.smithi063.stdout:5/472: dwrite d6/d37/d19/f2c [0,4194304] 0 2024-09-17T01:56:27.778 INFO:tasks.workunit.client.0.smithi063.stdout:4/448: fdatasync f4 0 2024-09-17T01:56:27.780 INFO:tasks.workunit.client.0.smithi063.stdout:1/511: mknod d0/d2d/d35/d3f/d81/caf 0 2024-09-17T01:56:27.781 INFO:tasks.workunit.client.0.smithi063.stdout:4/449: creat de/d17/d1b/f83 x:0 0 0 2024-09-17T01:56:27.782 INFO:tasks.workunit.client.0.smithi063.stdout:4/450: creat de/d2d/d52/f84 x:0 0 0 2024-09-17T01:56:27.783 INFO:tasks.workunit.client.0.smithi063.stdout:4/451: symlink de/l85 0 2024-09-17T01:56:27.783 INFO:tasks.workunit.client.0.smithi063.stdout:8/343: dread d1/d7/d28/d2f/d41/d49/f1b [0,4194304] 0 2024-09-17T01:56:27.783 INFO:tasks.workunit.client.0.smithi063.stdout:8/344: stat d1/d7/d28/d2f/d41/d49/c35 0 2024-09-17T01:56:27.784 INFO:tasks.workunit.client.0.smithi063.stdout:4/452: read de/d17/d1b/d67/f37 [127620,63684] 0 2024-09-17T01:56:27.784 INFO:tasks.workunit.client.0.smithi063.stdout:8/345: fsync d1/d7/d1d/f40 0 2024-09-17T01:56:27.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/453: write de/d2d/f33 [2418455,5553] 0 2024-09-17T01:56:27.786 INFO:tasks.workunit.client.0.smithi063.stdout:4/454: mknod de/d17/d36/c86 0 2024-09-17T01:56:27.787 INFO:tasks.workunit.client.0.smithi063.stdout:1/512: dwrite d0/d2d/fae [0,4194304] 0 2024-09-17T01:56:27.789 INFO:tasks.workunit.client.0.smithi063.stdout:1/513: write d0/d2d/d35/d3f/d4e/f83 [566698,69596] 0 2024-09-17T01:56:27.790 INFO:tasks.workunit.client.0.smithi063.stdout:0/344: dread d1/d1d/f3b [0,4194304] 0 2024-09-17T01:56:27.790 INFO:tasks.workunit.client.0.smithi063.stdout:4/455: creat de/d2d/d3c/f87 x:0 0 0 2024-09-17T01:56:27.790 INFO:tasks.workunit.client.0.smithi063.stdout:4/456: symlink de/d2d/d52/l88 0 2024-09-17T01:56:27.791 INFO:tasks.workunit.client.0.smithi063.stdout:8/346: dwrite d1/d7/d1d/f5f [0,4194304] 0 2024-09-17T01:56:27.792 INFO:tasks.workunit.client.0.smithi063.stdout:8/347: creat d1/d7/d28/d2a/d4d/f6b x:0 0 0 2024-09-17T01:56:27.793 INFO:tasks.workunit.client.0.smithi063.stdout:8/348: mkdir d1/d7/d28/d2a/d37/d6c 0 2024-09-17T01:56:27.795 INFO:tasks.workunit.client.0.smithi063.stdout:8/349: symlink d1/d7/d28/d2a/d59/l6d 0 2024-09-17T01:56:27.796 INFO:tasks.workunit.client.0.smithi063.stdout:8/350: mkdir d1/d7/d28/d2a/d44/d6e 0 2024-09-17T01:56:27.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/457: dwrite de/f38 [0,4194304] 0 2024-09-17T01:56:27.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/458: fdatasync de/d17/d36/f81 0 2024-09-17T01:56:27.799 INFO:tasks.workunit.client.0.smithi063.stdout:4/459: dread - de/d17/d1b/f69 zero size 2024-09-17T01:56:27.800 INFO:tasks.workunit.client.0.smithi063.stdout:0/345: truncate d1/d3/db/d18/f30 363459 0 2024-09-17T01:56:27.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/460: rmdir de/d17/d1b/d67/d28 39 2024-09-17T01:56:27.801 INFO:tasks.workunit.client.0.smithi063.stdout:0/346: write d1/d3/d10/f4e [929346,88459] 0 2024-09-17T01:56:27.805 INFO:tasks.workunit.client.0.smithi063.stdout:0/347: truncate d1/d3/d1b/f54 2468428 0 2024-09-17T01:56:27.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/461: dread de/d17/d1b/f4f [0,4194304] 0 2024-09-17T01:56:27.805 INFO:tasks.workunit.client.0.smithi063.stdout:5/473: dread d6/d23/d29/d2b/d4f/f52 [0,4194304] 0 2024-09-17T01:56:27.806 INFO:tasks.workunit.client.0.smithi063.stdout:0/348: symlink d1/d1d/d74/l76 0 2024-09-17T01:56:27.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/474: write d6/d23/d29/d36/f5b [464586,91669] 0 2024-09-17T01:56:27.807 INFO:tasks.workunit.client.0.smithi063.stdout:0/349: unlink d1/d3/d10/c4c 0 2024-09-17T01:56:27.807 INFO:tasks.workunit.client.0.smithi063.stdout:0/350: creat d1/d1f/f77 x:0 0 0 2024-09-17T01:56:27.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/475: chown d6/d35/l48 109024 1 2024-09-17T01:56:27.808 INFO:tasks.workunit.client.0.smithi063.stdout:5/476: dread - d6/d23/d29/d36/f97 zero size 2024-09-17T01:56:27.808 INFO:tasks.workunit.client.0.smithi063.stdout:5/477: mknod d6/d23/d3f/c9c 0 2024-09-17T01:56:27.809 INFO:tasks.workunit.client.0.smithi063.stdout:5/478: chown d6/d23/d3f/c67 406592133 1 2024-09-17T01:56:27.809 INFO:tasks.workunit.client.0.smithi063.stdout:5/479: fdatasync d6/d37/d79/f7e 0 2024-09-17T01:56:27.810 INFO:tasks.workunit.client.0.smithi063.stdout:0/351: write d1/f1e [606262,92108] 0 2024-09-17T01:56:27.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/480: write d6/d23/d29/d2b/d31/f80 [347504,33343] 0 2024-09-17T01:56:27.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/481: write d6/f44 [5181612,91805] 0 2024-09-17T01:56:27.811 INFO:tasks.workunit.client.0.smithi063.stdout:0/352: write d1/d3/db/d4b/d2f/d56/f57 [1024978,38788] 0 2024-09-17T01:56:27.812 INFO:tasks.workunit.client.0.smithi063.stdout:5/482: symlink d6/l9d 0 2024-09-17T01:56:27.814 INFO:tasks.workunit.client.0.smithi063.stdout:0/353: truncate d1/d3/db/f13 123455 0 2024-09-17T01:56:27.815 INFO:tasks.workunit.client.0.smithi063.stdout:0/354: rmdir d1/d3/d32 39 2024-09-17T01:56:27.815 INFO:tasks.workunit.client.0.smithi063.stdout:0/355: unlink d1/d3/db/d4b/f26 0 2024-09-17T01:56:27.817 INFO:tasks.workunit.client.0.smithi063.stdout:0/356: truncate d1/d3/db/f39 1774204 0 2024-09-17T01:56:27.820 INFO:tasks.workunit.client.0.smithi063.stdout:0/357: fsync d1/d3/db/d4b/f22 0 2024-09-17T01:56:27.823 INFO:tasks.workunit.client.0.smithi063.stdout:0/358: mknod d1/d1d/d6d/c78 0 2024-09-17T01:56:27.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/359: mknod d1/d3/d10/c79 0 2024-09-17T01:56:27.825 INFO:tasks.workunit.client.0.smithi063.stdout:5/483: dread d6/f12 [0,4194304] 0 2024-09-17T01:56:27.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/484: chown d6/d23/d29/d2b/d4f 7755992 1 2024-09-17T01:56:27.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/485: chown d6/l1a 5114 1 2024-09-17T01:56:27.827 INFO:tasks.workunit.client.0.smithi063.stdout:5/486: creat d6/d23/f9e x:0 0 0 2024-09-17T01:56:27.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/487: getdents d6/d23/d3f 0 2024-09-17T01:56:27.830 INFO:tasks.workunit.client.0.smithi063.stdout:5/488: truncate d6/d35/f6c 760986 0 2024-09-17T01:56:27.830 INFO:tasks.workunit.client.0.smithi063.stdout:0/360: dread d1/d3/db/d4b/d2f/d56/f57 [0,4194304] 0 2024-09-17T01:56:27.831 INFO:tasks.workunit.client.0.smithi063.stdout:0/361: dread - d1/d3/db/d18/d33/f71 zero size 2024-09-17T01:56:27.832 INFO:tasks.workunit.client.0.smithi063.stdout:0/362: mknod d1/d3/db/d4b/c7a 0 2024-09-17T01:56:27.833 INFO:tasks.workunit.client.0.smithi063.stdout:0/363: creat d1/d3/d32/f7b x:0 0 0 2024-09-17T01:56:27.833 INFO:tasks.workunit.client.0.smithi063.stdout:0/364: write d1/f19 [4691270,31758] 0 2024-09-17T01:56:27.834 INFO:tasks.workunit.client.0.smithi063.stdout:0/365: write d1/d3/db/d18/d43/f60 [387551,31467] 0 2024-09-17T01:56:27.835 INFO:tasks.workunit.client.0.smithi063.stdout:0/366: mkdir d1/d44/d7c 0 2024-09-17T01:56:27.835 INFO:tasks.workunit.client.0.smithi063.stdout:5/489: dread d6/d35/f6c [0,4194304] 0 2024-09-17T01:56:27.836 INFO:tasks.workunit.client.0.smithi063.stdout:5/490: write d6/d37/fe [4971899,33421] 0 2024-09-17T01:56:27.840 INFO:tasks.workunit.client.0.smithi063.stdout:0/367: dwrite d1/d1d/f3b [4194304,4194304] 0 2024-09-17T01:56:27.841 INFO:tasks.workunit.client.0.smithi063.stdout:0/368: mkdir d1/d3/db/d4b/d7d 0 2024-09-17T01:56:27.843 INFO:tasks.workunit.client.0.smithi063.stdout:0/369: creat d1/d3/db/d18/d43/f7e x:0 0 0 2024-09-17T01:56:27.847 INFO:tasks.workunit.client.0.smithi063.stdout:5/491: truncate d6/d23/d29/d2b/d4f/f52 767265 0 2024-09-17T01:56:27.848 INFO:tasks.workunit.client.0.smithi063.stdout:0/370: dwrite d1/d3/db/d4b/d2f/d56/f57 [0,4194304] 0 2024-09-17T01:56:27.854 INFO:tasks.workunit.client.0.smithi063.stdout:0/371: dwrite d1/d3/d1b/f38 [0,4194304] 0 2024-09-17T01:56:27.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/372: dread - d1/d3/d10/f5a zero size 2024-09-17T01:56:27.856 INFO:tasks.workunit.client.0.smithi063.stdout:0/373: getdents d1/d3/db/d4b/d7d 0 2024-09-17T01:56:27.862 INFO:tasks.workunit.client.0.smithi063.stdout:0/374: dwrite d1/d3/db/d4b/f66 [0,4194304] 0 2024-09-17T01:56:27.871 INFO:tasks.workunit.client.0.smithi063.stdout:0/375: read d1/d3/db/d4b/f1c [1479449,64795] 0 2024-09-17T01:56:27.872 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:27.877+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:27.874 INFO:tasks.workunit.client.0.smithi063.stdout:0/376: dread d1/d3/d10/f4e [0,4194304] 0 2024-09-17T01:56:27.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/377: write d1/d1f/f64 [621135,22009] 0 2024-09-17T01:56:27.877 INFO:tasks.workunit.client.0.smithi063.stdout:0/378: dread d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:27.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/379: truncate d1/d3/db/f39 558754 0 2024-09-17T01:56:27.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/380: creat d1/d1d/d74/f7f x:0 0 0 2024-09-17T01:56:27.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/381: mknod d1/d1f/c80 0 2024-09-17T01:56:27.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/382: rename d1/d3/f8 to d1/d3/d10/f81 0 2024-09-17T01:56:27.887 INFO:tasks.workunit.client.0.smithi063.stdout:0/383: dwrite d1/d3/db/d18/f30 [0,4194304] 0 2024-09-17T01:56:27.888 INFO:tasks.workunit.client.0.smithi063.stdout:0/384: read d1/d3/db/d18/d33/f67 [2332045,75702] 0 2024-09-17T01:56:27.898 INFO:tasks.workunit.client.0.smithi063.stdout:0/385: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:56:27.903 INFO:tasks.workunit.client.0.smithi063.stdout:0/386: truncate d1/d3/d1b/f4f 13973 0 2024-09-17T01:56:27.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/387: write d1/d1f/f64 [1424956,77428] 0 2024-09-17T01:56:27.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/388: chown d1/d3/d10/f4e 1582118438 1 2024-09-17T01:56:27.905 INFO:tasks.workunit.client.0.smithi063.stdout:0/389: chown d1/d3/db/d18/l46 3177251 1 2024-09-17T01:56:27.905 INFO:tasks.workunit.client.0.smithi063.stdout:0/390: write d1/d1d/f3b [161253,3746] 0 2024-09-17T01:56:27.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/391: mkdir d1/d3/db/d4b/d82 0 2024-09-17T01:56:27.907 INFO:tasks.workunit.client.0.smithi063.stdout:0/392: mkdir d1/d3/db/d18/d33/d83 0 2024-09-17T01:56:27.908 INFO:tasks.workunit.client.0.smithi063.stdout:0/393: link d1/d3/d1b/l2b d1/d44/d53/d62/l84 0 2024-09-17T01:56:27.909 INFO:tasks.workunit.client.0.smithi063.stdout:0/394: dread d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:27.909 INFO:tasks.workunit.client.0.smithi063.stdout:0/395: dread - d1/d3/db/d18/f5b zero size 2024-09-17T01:56:27.910 INFO:tasks.workunit.client.0.smithi063.stdout:0/396: mkdir d1/d3/db/d18/d85 0 2024-09-17T01:56:27.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/397: dwrite d1/d3/db/d18/d33/f71 [0,4194304] 0 2024-09-17T01:56:27.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/398: dread d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:27.918 INFO:tasks.workunit.client.0.smithi063.stdout:3/445: sync 2024-09-17T01:56:27.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/386: sync 2024-09-17T01:56:27.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/399: dread d1/d3/db/f13 [0,4194304] 0 2024-09-17T01:56:27.919 INFO:tasks.workunit.client.0.smithi063.stdout:3/446: rename df/d12/d2d/l54 to df/d12/d1e/l96 0 2024-09-17T01:56:27.920 INFO:tasks.workunit.client.0.smithi063.stdout:3/447: chown df/c22 225469701 1 2024-09-17T01:56:27.924 INFO:tasks.workunit.client.0.smithi063.stdout:0/400: dwrite d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:27.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/401: mkdir d1/d3/db/d6e/d86 0 2024-09-17T01:56:27.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/448: dread df/d12/d30/f47 [0,4194304] 0 2024-09-17T01:56:27.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/449: read df/f26 [1506351,99694] 0 2024-09-17T01:56:27.926 INFO:tasks.workunit.client.0.smithi063.stdout:0/402: symlink d1/d3/db/d4b/d82/l87 0 2024-09-17T01:56:27.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/450: mkdir df/d12/d43/d50/d58/d97 0 2024-09-17T01:56:27.927 INFO:tasks.workunit.client.0.smithi063.stdout:0/403: write d1/d3/db/d4b/d2f/d56/f57 [293602,119213] 0 2024-09-17T01:56:27.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/451: dread - df/d12/f79 zero size 2024-09-17T01:56:27.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/404: mkdir d1/d44/d7c/d88 0 2024-09-17T01:56:27.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/405: dread - d1/d3/db/d4b/f45 zero size 2024-09-17T01:56:27.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/406: read d1/d3/d1b/f4f [12210,103368] 0 2024-09-17T01:56:27.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/407: mkdir d1/d3/db/d18/d33/d89 0 2024-09-17T01:56:27.937 INFO:tasks.workunit.client.0.smithi063.stdout:0/408: symlink d1/d3/db/d18/d33/d89/l8a 0 2024-09-17T01:56:27.938 INFO:tasks.workunit.client.0.smithi063.stdout:0/409: rmdir d1/d1d/d6d 39 2024-09-17T01:56:27.938 INFO:tasks.workunit.client.0.smithi063.stdout:0/410: creat d1/d44/d53/f8b x:0 0 0 2024-09-17T01:56:27.938 INFO:tasks.workunit.client.0.smithi063.stdout:0/411: chown d1/d3/d1b/d50/d6c 2512604 1 2024-09-17T01:56:27.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/412: fdatasync d1/d3/d1b/f38 0 2024-09-17T01:56:27.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/413: chown d1 3 1 2024-09-17T01:56:27.940 INFO:tasks.workunit.client.0.smithi063.stdout:0/414: creat d1/d3/db/d18/d33/d89/f8c x:0 0 0 2024-09-17T01:56:27.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/415: mknod d1/d3/d1b/c8d 0 2024-09-17T01:56:27.942 INFO:tasks.workunit.client.0.smithi063.stdout:0/416: link d1/f4d d1/d3/db/d18/d85/f8e 0 2024-09-17T01:56:27.942 INFO:tasks.workunit.client.0.smithi063.stdout:2/387: dread d3/f6 [0,4194304] 0 2024-09-17T01:56:27.943 INFO:tasks.workunit.client.0.smithi063.stdout:0/417: symlink d1/d3/db/l8f 0 2024-09-17T01:56:27.943 INFO:tasks.workunit.client.0.smithi063.stdout:2/388: creat d3/d7/df/d68/f74 x:0 0 0 2024-09-17T01:56:27.943 INFO:tasks.workunit.client.0.smithi063.stdout:0/418: mknod d1/d3/db/d4b/d2f/c90 0 2024-09-17T01:56:27.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/419: link d1/f4d d1/d3/db/d4b/d7d/f91 0 2024-09-17T01:56:27.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/420: chown d1/d1d/c59 100282 1 2024-09-17T01:56:27.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/351: sync 2024-09-17T01:56:27.946 INFO:tasks.workunit.client.0.smithi063.stdout:7/338: sync 2024-09-17T01:56:27.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/447: sync 2024-09-17T01:56:27.947 INFO:tasks.workunit.client.0.smithi063.stdout:4/462: sync 2024-09-17T01:56:27.947 INFO:tasks.workunit.client.0.smithi063.stdout:5/492: sync 2024-09-17T01:56:27.947 INFO:tasks.workunit.client.0.smithi063.stdout:1/514: sync 2024-09-17T01:56:27.947 INFO:tasks.workunit.client.0.smithi063.stdout:9/348: sync 2024-09-17T01:56:27.948 INFO:tasks.workunit.client.0.smithi063.stdout:0/421: write d1/d3/db/d18/f5b [450885,8168] 0 2024-09-17T01:56:27.948 INFO:tasks.workunit.client.0.smithi063.stdout:1/515: chown d0/d2d/d35/d3f/d81/d50/c73 54614 1 2024-09-17T01:56:27.950 INFO:tasks.workunit.client.0.smithi063.stdout:6/448: stat dc/d14/d19/d20/d32/f61 0 2024-09-17T01:56:27.950 INFO:tasks.workunit.client.0.smithi063.stdout:4/463: truncate f4 997889 0 2024-09-17T01:56:27.950 INFO:tasks.workunit.client.0.smithi063.stdout:5/493: rmdir d6/d23/d29/d2b/d4f 39 2024-09-17T01:56:27.950 INFO:tasks.workunit.client.0.smithi063.stdout:8/352: mknod d1/d7/d28/d2f/c6f 0 2024-09-17T01:56:27.950 INFO:tasks.workunit.client.0.smithi063.stdout:7/339: symlink d2/d15/d2f/l6c 0 2024-09-17T01:56:27.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/452: dread df/d12/d43/f4d [0,4194304] 0 2024-09-17T01:56:27.950 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:27.951 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:27.951 INFO:tasks.workunit.client.0.smithi063.stdout:4/464: mknod de/c89 0 2024-09-17T01:56:27.951 INFO:tasks.workunit.client.0.smithi063.stdout:1/516: symlink d0/d2d/d5e/lb0 0 2024-09-17T01:56:27.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/389: dwrite d3/d7/df/d68/f35 [0,4194304] 0 2024-09-17T01:56:27.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/422: rename d1/d3/db/d18/d33/d89 to d1/d3/db/d18/d85/d92 0 2024-09-17T01:56:27.952 INFO:tasks.workunit.client.0.smithi063.stdout:6/449: mknod dc/d14/d19/d20/d32/d52/d5a/d62/d7e/c92 0 2024-09-17T01:56:27.953 INFO:tasks.workunit.client.0.smithi063.stdout:8/353: write d1/d7/d28/d2f/d41/d49/f23 [742027,23794] 0 2024-09-17T01:56:27.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/390: dread - d3/d7/df/d43/f55 zero size 2024-09-17T01:56:27.954 INFO:tasks.workunit.client.0.smithi063.stdout:6/450: stat dc/d14/d19/d20/d32/d68 0 2024-09-17T01:56:27.954 INFO:tasks.workunit.client.0.smithi063.stdout:7/340: creat d2/d3/d27/d65/f6d x:0 0 0 2024-09-17T01:56:27.954 INFO:tasks.workunit.client.0.smithi063.stdout:3/453: symlink df/d12/d2d/l98 0 2024-09-17T01:56:27.955 INFO:tasks.workunit.client.0.smithi063.stdout:4/465: rename de/f26 to de/d17/d36/d70/f8a 0 2024-09-17T01:56:27.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/354: unlink d1/f38 0 2024-09-17T01:56:27.956 INFO:tasks.workunit.client.0.smithi063.stdout:7/341: readlink d2/d3/d27/d39/l57 0 2024-09-17T01:56:27.956 INFO:tasks.workunit.client.0.smithi063.stdout:9/349: dwrite d9/de/d20/d37/f50 [0,4194304] 0 2024-09-17T01:56:27.957 INFO:tasks.workunit.client.0.smithi063.stdout:5/494: link d6/d23/d3f/c9b d6/d23/d3f/c9f 0 2024-09-17T01:56:27.957 INFO:tasks.workunit.client.0.smithi063.stdout:6/451: rename dc/d14/d2f/l56 to dc/d14/d19/d20/d32/d68/l93 0 2024-09-17T01:56:27.958 INFO:tasks.workunit.client.0.smithi063.stdout:2/391: dread d3/f4 [0,4194304] 0 2024-09-17T01:56:27.961 INFO:tasks.workunit.client.0.smithi063.stdout:8/355: truncate d1/d7/d28/d2a/f5b 815974 0 2024-09-17T01:56:27.962 INFO:tasks.workunit.client.0.smithi063.stdout:6/452: chown dc/d14/d19/d20/d32/d52/d5a/d62/d7e/f8a 3002704 1 2024-09-17T01:56:27.962 INFO:tasks.workunit.client.0.smithi063.stdout:5/495: truncate d6/d35/f95 3403207 0 2024-09-17T01:56:27.963 INFO:tasks.workunit.client.0.smithi063.stdout:8/356: dread - d1/d7/d28/d2f/d41/f67 zero size 2024-09-17T01:56:27.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/350: rename d9/de/d20/d37/d42/l66 to d9/de/d20/d1b/d25/d73/l77 0 2024-09-17T01:56:27.963 INFO:tasks.workunit.client.0.smithi063.stdout:5/496: stat d6/d37/d79 0 2024-09-17T01:56:27.965 INFO:tasks.workunit.client.0.smithi063.stdout:3/454: dwrite fe [0,4194304] 0 2024-09-17T01:56:27.965 INFO:tasks.workunit.client.0.smithi063.stdout:1/517: dwrite d0/d1c/f48 [0,4194304] 0 2024-09-17T01:56:27.965 INFO:tasks.workunit.client.0.smithi063.stdout:8/357: dread - d1/d7/d28/d2f/d41/d49/f63 zero size 2024-09-17T01:56:27.966 INFO:tasks.workunit.client.0.smithi063.stdout:1/518: chown d0/l25 10513086 1 2024-09-17T01:56:27.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/342: dwrite d2/d3/d27/d39/f4e [0,4194304] 0 2024-09-17T01:56:27.967 INFO:tasks.workunit.client.0.smithi063.stdout:0/423: getdents d1/d3/db/d18/d33 0 2024-09-17T01:56:27.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/351: creat d9/de/d20/d1e/d2a/d36/f78 x:0 0 0 2024-09-17T01:56:27.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/455: symlink df/d28/l99 0 2024-09-17T01:56:27.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/519: mkdir d0/d1c/db1 0 2024-09-17T01:56:27.969 INFO:tasks.workunit.client.0.smithi063.stdout:7/343: symlink d2/d3/d27/d33/l6e 0 2024-09-17T01:56:27.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/352: dread - d9/de/d20/d37/f61 zero size 2024-09-17T01:56:27.969 INFO:tasks.workunit.client.0.smithi063.stdout:0/424: creat d1/d3/d32/f93 x:0 0 0 2024-09-17T01:56:27.970 INFO:tasks.workunit.client.0.smithi063.stdout:1/520: rmdir d0/d2d/d35/d3f 39 2024-09-17T01:56:27.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/456: mkdir df/d12/d1e/d9a 0 2024-09-17T01:56:27.970 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:27.971 INFO:tasks.workunit.client.0.smithi063.stdout:9/353: chown d9/de/d20/d1e/c1c 11370 1 2024-09-17T01:56:27.971 INFO:tasks.workunit.client.0.smithi063.stdout:3/457: mknod df/c9b 0 2024-09-17T01:56:27.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/344: creat d2/d15/d2f/d45/d48/f6f x:0 0 0 2024-09-17T01:56:27.971 INFO:tasks.workunit.client.0.smithi063.stdout:0/425: getdents d1 0 2024-09-17T01:56:27.971 INFO:tasks.workunit.client.0.smithi063.stdout:3/458: readlink df/d12/d43/d50/l5a 0 2024-09-17T01:56:27.972 INFO:tasks.workunit.client.0.smithi063.stdout:9/354: dread - d9/de/d20/d1e/d2a/d36/f78 zero size 2024-09-17T01:56:27.973 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:27.977+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:27.974 INFO:tasks.workunit.client.0.smithi063.stdout:0/426: fdatasync d1/d3/d1b/f38 0 2024-09-17T01:56:27.974 INFO:tasks.workunit.client.0.smithi063.stdout:1/521: write d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [1308038,102967] 0 2024-09-17T01:56:27.974 INFO:tasks.workunit.client.0.smithi063.stdout:6/453: read dc/d14/d19/f1a [3819222,109160] 0 2024-09-17T01:56:27.974 INFO:tasks.workunit.client.0.smithi063.stdout:9/355: write d9/de/d20/d1e/d2a/d40/f6c [685774,99559] 0 2024-09-17T01:56:27.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/497: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:56:27.975 INFO:tasks.workunit.client.0.smithi063.stdout:9/356: fdatasync d9/de/d20/d1e/d2a/f3f 0 2024-09-17T01:56:27.975 INFO:tasks.workunit.client.0.smithi063.stdout:4/466: write de/f4c [3792691,34164] 0 2024-09-17T01:56:27.976 INFO:tasks.workunit.client.0.smithi063.stdout:6/454: stat dc/d1b/l30 0 2024-09-17T01:56:27.977 INFO:tasks.workunit.client.0.smithi063.stdout:1/522: chown d0/d2d/f37 2192 1 2024-09-17T01:56:27.978 INFO:tasks.workunit.client.0.smithi063.stdout:8/358: truncate d1/f16 9387981 0 2024-09-17T01:56:27.978 INFO:tasks.workunit.client.0.smithi063.stdout:3/459: getdents df/d12 0 2024-09-17T01:56:27.979 INFO:tasks.workunit.client.0.smithi063.stdout:6/455: creat dc/d14/d18/f94 x:0 0 0 2024-09-17T01:56:27.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/357: creat d9/de/d20/d1e/f79 x:0 0 0 2024-09-17T01:56:27.979 INFO:tasks.workunit.client.0.smithi063.stdout:4/467: mkdir de/d17/d1b/d67/d28/d8b 0 2024-09-17T01:56:27.980 INFO:tasks.workunit.client.0.smithi063.stdout:8/359: rmdir d1/d7/d28 39 2024-09-17T01:56:27.980 INFO:tasks.workunit.client.0.smithi063.stdout:6/456: readlink dc/l4a 0 2024-09-17T01:56:27.981 INFO:tasks.workunit.client.0.smithi063.stdout:5/498: truncate d6/d23/d29/d2b/d4f/f52 454867 0 2024-09-17T01:56:27.981 INFO:tasks.workunit.client.0.smithi063.stdout:3/460: creat df/d12/d1e/d5e/f9c x:0 0 0 2024-09-17T01:56:27.981 INFO:tasks.workunit.client.0.smithi063.stdout:9/358: mknod d9/de/d20/c7a 0 2024-09-17T01:56:27.981 INFO:tasks.workunit.client.0.smithi063.stdout:0/427: dwrite d1/d3/d1b/f29 [0,4194304] 0 2024-09-17T01:56:27.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/360: fdatasync d1/d7/d1d/f1f 0 2024-09-17T01:56:27.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/345: dwrite d2/d15/d2f/d52/f68 [0,4194304] 0 2024-09-17T01:56:27.984 INFO:tasks.workunit.client.0.smithi063.stdout:1/523: dread d0/d2d/f37 [0,4194304] 0 2024-09-17T01:56:27.984 INFO:tasks.workunit.client.0.smithi063.stdout:9/359: mknod d9/d27/c7b 0 2024-09-17T01:56:27.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/428: rmdir d1/d3/db/d4b/d7d 39 2024-09-17T01:56:27.985 INFO:tasks.workunit.client.0.smithi063.stdout:7/346: creat d2/d3/d22/d3a/f70 x:0 0 0 2024-09-17T01:56:27.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/468: link de/d17/d1b/f4f de/d17/d1b/d67/d28/d8b/f8c 0 2024-09-17T01:56:27.985 INFO:tasks.workunit.client.0.smithi063.stdout:7/347: unlink d2/d3/d27/f28 0 2024-09-17T01:56:27.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/429: dread - d1/d1d/d74/f7f zero size 2024-09-17T01:56:27.986 INFO:tasks.workunit.client.0.smithi063.stdout:9/360: creat d9/de/d20/d1b/d25/d73/f7c x:0 0 0 2024-09-17T01:56:27.986 INFO:tasks.workunit.client.0.smithi063.stdout:8/361: creat d1/f70 x:0 0 0 2024-09-17T01:56:27.987 INFO:tasks.workunit.client.0.smithi063.stdout:4/469: chown de/d17/d1b/d67/d28/d30/l34 3763 1 2024-09-17T01:56:27.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/348: mkdir d2/d3/d27/d33/d71 0 2024-09-17T01:56:27.988 INFO:tasks.workunit.client.0.smithi063.stdout:0/430: unlink d1/d3/f4 0 2024-09-17T01:56:27.989 INFO:tasks.workunit.client.0.smithi063.stdout:1/524: link d0/d2d/d35/d3f/d4e/f6a d0/d2d/d35/d9d/fb2 0 2024-09-17T01:56:27.989 INFO:tasks.workunit.client.0.smithi063.stdout:4/470: mkdir de/d17/d1b/d67/d28/d8d 0 2024-09-17T01:56:27.989 INFO:tasks.workunit.client.0.smithi063.stdout:8/362: fsync d1/d27/f4b 0 2024-09-17T01:56:27.991 INFO:tasks.workunit.client.0.smithi063.stdout:9/361: chown d9/de/d20/d1b/d25/d73/l77 3450 1 2024-09-17T01:56:27.991 INFO:tasks.workunit.client.0.smithi063.stdout:1/525: write d0/f1a [977792,46123] 0 2024-09-17T01:56:27.991 INFO:tasks.workunit.client.0.smithi063.stdout:4/471: symlink de/d17/d1b/d67/d28/d30/l8e 0 2024-09-17T01:56:27.992 INFO:tasks.workunit.client.0.smithi063.stdout:3/461: dwrite df/d12/d43/d50/d58/f5b [0,4194304] 0 2024-09-17T01:56:27.992 INFO:tasks.workunit.client.0.smithi063.stdout:6/457: dwrite dc/d14/d18/d74/f88 [0,4194304] 0 2024-09-17T01:56:27.992 INFO:tasks.workunit.client.0.smithi063.stdout:5/499: write d6/d35/f6c [184001,78021] 0 2024-09-17T01:56:27.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/362: creat d9/d27/f7d x:0 0 0 2024-09-17T01:56:27.993 INFO:tasks.workunit.client.0.smithi063.stdout:4/472: creat de/d17/d36/d70/f8f x:0 0 0 2024-09-17T01:56:27.993 INFO:tasks.workunit.client.0.smithi063.stdout:8/363: mknod d1/d7/d28/d2f/d62/d66/c71 0 2024-09-17T01:56:27.995 INFO:tasks.workunit.client.0.smithi063.stdout:8/364: fsync d1/f5e 0 2024-09-17T01:56:27.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/458: chown dc/f38 4 1 2024-09-17T01:56:27.995 INFO:tasks.workunit.client.0.smithi063.stdout:3/462: fsync df/d12/d2d/f40 0 2024-09-17T01:56:27.995 INFO:tasks.workunit.client.0.smithi063.stdout:9/363: mkdir d9/de/d20/d37/d42/d7e 0 2024-09-17T01:56:27.996 INFO:tasks.workunit.client.0.smithi063.stdout:5/500: write d6/d23/d3a/f4c [4605700,98194] 0 2024-09-17T01:56:27.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/526: mkdir d0/d2d/d35/d3f/d81/d50/d8b/db3 0 2024-09-17T01:56:27.997 INFO:tasks.workunit.client.0.smithi063.stdout:8/365: truncate d1/f5e 725856 0 2024-09-17T01:56:27.998 INFO:tasks.workunit.client.0.smithi063.stdout:4/473: write de/d2d/d3c/f87 [875847,58493] 0 2024-09-17T01:56:27.999 INFO:tasks.workunit.client.0.smithi063.stdout:9/364: mkdir d9/de/d20/d37/d42/d7f 0 2024-09-17T01:56:28.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/431: write d1/d3/db/d18/d85/f8e [903790,129871] 0 2024-09-17T01:56:28.000 INFO:tasks.workunit.client.0.smithi063.stdout:8/366: chown d1/d7/d28/d2f/d41/d49/f61 3 1 2024-09-17T01:56:28.000 INFO:tasks.workunit.client.0.smithi063.stdout:5/501: mkdir d6/d37/d19/d50/d98/da0 0 2024-09-17T01:56:28.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/527: creat d0/d2d/d35/d8c/fb4 x:0 0 0 2024-09-17T01:56:28.001 INFO:tasks.workunit.client.0.smithi063.stdout:7/349: dwrite d2/d3/d22/d3a/f62 [0,4194304] 0 2024-09-17T01:56:28.001 INFO:tasks.workunit.client.0.smithi063.stdout:3/463: mkdir df/d12/d30/d8a/d9d 0 2024-09-17T01:56:28.001 INFO:tasks.workunit.client.0.smithi063.stdout:5/502: read d6/d9/f40 [536012,11255] 0 2024-09-17T01:56:28.003 INFO:tasks.workunit.client.0.smithi063.stdout:9/365: rmdir d9 39 2024-09-17T01:56:28.003 INFO:tasks.workunit.client.0.smithi063.stdout:4/474: mkdir de/d17/d36/d70/d77/d90 0 2024-09-17T01:56:28.003 INFO:tasks.workunit.client.0.smithi063.stdout:1/528: mknod d0/d2d/d35/d3f/d81/d50/d6c/d74/cb5 0 2024-09-17T01:56:28.003 INFO:tasks.workunit.client.0.smithi063.stdout:3/464: creat df/d12/d3a/f9e x:0 0 0 2024-09-17T01:56:28.003 INFO:tasks.workunit.client.0.smithi063.stdout:7/350: rename d2/d3/d27/l58 to d2/d3/d67/l72 0 2024-09-17T01:56:28.004 INFO:tasks.workunit.client.0.smithi063.stdout:2/392: sync 2024-09-17T01:56:28.004 INFO:tasks.workunit.client.0.smithi063.stdout:0/432: getdents d1/d44/d53/d62 0 2024-09-17T01:56:28.004 INFO:tasks.workunit.client.0.smithi063.stdout:3/465: rmdir df/d12/d1e/d9a 0 2024-09-17T01:56:28.007 INFO:tasks.workunit.client.0.smithi063.stdout:7/351: write d2/d3/d17/d25/f1b [871336,98462] 0 2024-09-17T01:56:28.010 INFO:tasks.workunit.client.0.smithi063.stdout:8/367: dwrite d1/f70 [0,4194304] 0 2024-09-17T01:56:28.010 INFO:tasks.workunit.client.0.smithi063.stdout:4/475: rename de/d17/d1b/f1c to de/d17/d36/d70/d77/d90/f91 0 2024-09-17T01:56:28.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/393: getdents d3/d7 0 2024-09-17T01:56:28.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/352: mkdir d2/d15/d2f/d3e/d73 0 2024-09-17T01:56:28.013 INFO:tasks.workunit.client.0.smithi063.stdout:5/503: dwrite d6/d23/d69/f7a [0,4194304] 0 2024-09-17T01:56:28.013 INFO:tasks.workunit.client.0.smithi063.stdout:2/394: fdatasync d3/f9 0 2024-09-17T01:56:28.014 INFO:tasks.workunit.client.0.smithi063.stdout:1/529: dwrite d0/d2d/d35/d9d/fa8 [0,4194304] 0 2024-09-17T01:56:28.017 INFO:tasks.workunit.client.0.smithi063.stdout:2/395: write d3/d7/d38/f45 [451362,100992] 0 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:3/466: dread df/d12/d1e/f2b [0,4194304] 0 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:9/366: dwrite d9/f5b [0,4194304] 0 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/353: truncate d2/d3/d27/d39/d40/f6a 383673 0 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:1/530: dread - d0/d2d/d35/d3f/d81/fa4 zero size 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:2/396: write d3/d7/df/f2f [59219,11644] 0 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:8/368: getdents d1/d7 0 2024-09-17T01:56:28.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/354: symlink d2/d3/l74 0 2024-09-17T01:56:28.019 INFO:tasks.workunit.client.0.smithi063.stdout:3/467: write df/d12/d30/f45 [137129,101958] 0 2024-09-17T01:56:28.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/367: mknod d9/de/d20/d32/c80 0 2024-09-17T01:56:28.019 INFO:tasks.workunit.client.0.smithi063.stdout:1/531: fsync d0/d1c/f28 0 2024-09-17T01:56:28.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/397: unlink d3/d7/d38/c6a 0 2024-09-17T01:56:28.020 INFO:tasks.workunit.client.0.smithi063.stdout:3/468: rmdir df/d12/d30/d8a 39 2024-09-17T01:56:28.020 INFO:tasks.workunit.client.0.smithi063.stdout:7/355: unlink d2/d3/d27/c5c 0 2024-09-17T01:56:28.022 INFO:tasks.workunit.client.0.smithi063.stdout:8/369: write d1/d7/d28/f50 [276823,7404] 0 2024-09-17T01:56:28.022 INFO:tasks.workunit.client.0.smithi063.stdout:4/476: dwrite de/d2d/d52/f84 [0,4194304] 0 2024-09-17T01:56:28.023 INFO:tasks.workunit.client.0.smithi063.stdout:2/398: symlink d3/d7/df/d30/l75 0 2024-09-17T01:56:28.023 INFO:tasks.workunit.client.0.smithi063.stdout:6/459: read dc/d14/d19/d20/f23 [5466980,28442] 0 2024-09-17T01:56:28.025 INFO:tasks.workunit.client.0.smithi063.stdout:9/368: fsync d9/de/d20/d1e/f34 0 2024-09-17T01:56:28.025 INFO:tasks.workunit.client.0.smithi063.stdout:8/370: mknod d1/d27/c72 0 2024-09-17T01:56:28.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/356: link d2/d15/d2f/d45/f69 d2/d3/d67/f75 0 2024-09-17T01:56:28.028 INFO:tasks.workunit.client.0.smithi063.stdout:4/477: creat de/d17/d1b/d67/d28/d8b/f92 x:0 0 0 2024-09-17T01:56:28.028 INFO:tasks.workunit.client.0.smithi063.stdout:8/371: write d1/d7/f4c [5975561,94180] 0 2024-09-17T01:56:28.028 INFO:tasks.workunit.client.0.smithi063.stdout:3/469: truncate df/d12/d1e/f21 4741353 0 2024-09-17T01:56:28.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/532: dwrite d0/f20 [0,4194304] 0 2024-09-17T01:56:28.029 INFO:tasks.workunit.client.0.smithi063.stdout:6/460: truncate dc/d14/d19/f53 503096 0 2024-09-17T01:56:28.031 INFO:tasks.workunit.client.0.smithi063.stdout:3/470: write df/d12/d2d/f4c [592739,21753] 0 2024-09-17T01:56:28.031 INFO:tasks.workunit.client.0.smithi063.stdout:5/504: dwrite d6/f18 [0,4194304] 0 2024-09-17T01:56:28.032 INFO:tasks.workunit.client.0.smithi063.stdout:6/461: unlink dc/d14/d18/f63 0 2024-09-17T01:56:28.032 INFO:tasks.workunit.client.0.smithi063.stdout:5/505: fsync d6/f74 0 2024-09-17T01:56:28.032 INFO:tasks.workunit.client.0.smithi063.stdout:3/471: creat df/d12/d43/d50/d58/f9f x:0 0 0 2024-09-17T01:56:28.034 INFO:tasks.workunit.client.0.smithi063.stdout:4/478: mknod de/d17/c93 0 2024-09-17T01:56:28.034 INFO:tasks.workunit.client.0.smithi063.stdout:9/369: write d9/de/d20/d1b/d25/f2b [2472810,113539] 0 2024-09-17T01:56:28.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/533: symlink d0/d2d/d35/d6f/lb6 0 2024-09-17T01:56:28.035 INFO:tasks.workunit.client.0.smithi063.stdout:3/472: creat df/d12/d3a/fa0 x:0 0 0 2024-09-17T01:56:28.035 INFO:tasks.workunit.client.0.smithi063.stdout:6/462: symlink dc/d14/d19/d20/d32/d52/d5a/d62/l95 0 2024-09-17T01:56:28.036 INFO:tasks.workunit.client.0.smithi063.stdout:4/479: chown de/d17/d1b/d67/l4d 6462078 1 2024-09-17T01:56:28.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/372: dwrite d1/f2 [0,4194304] 0 2024-09-17T01:56:28.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/480: chown de/d2d/d3c/f4b 484 1 2024-09-17T01:56:28.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/373: write d1/d27/f64 [613610,6601] 0 2024-09-17T01:56:28.040 INFO:tasks.workunit.client.0.smithi063.stdout:6/463: rename dc/d14/d18/l3b to dc/d14/d19/d20/d66/l96 0 2024-09-17T01:56:28.041 INFO:tasks.workunit.client.0.smithi063.stdout:5/506: link d6/d37/d19/d76/c88 d6/d23/d29/ca1 0 2024-09-17T01:56:28.041 INFO:tasks.workunit.client.0.smithi063.stdout:3/473: creat df/d12/d2d/fa1 x:0 0 0 2024-09-17T01:56:28.041 INFO:tasks.workunit.client.0.smithi063.stdout:5/507: dread - d6/d37/d19/d68/f78 zero size 2024-09-17T01:56:28.043 INFO:tasks.workunit.client.0.smithi063.stdout:3/474: fdatasync df/d12/d2d/fa1 0 2024-09-17T01:56:28.043 INFO:tasks.workunit.client.0.smithi063.stdout:7/357: dwrite d2/d15/d2f/f3d [0,4194304] 0 2024-09-17T01:56:28.043 INFO:tasks.workunit.client.0.smithi063.stdout:4/481: unlink de/d17/d1b/f69 0 2024-09-17T01:56:28.043 INFO:tasks.workunit.client.0.smithi063.stdout:8/374: creat d1/d7/d28/d2a/d44/f73 x:0 0 0 2024-09-17T01:56:28.043 INFO:tasks.workunit.client.0.smithi063.stdout:5/508: chown d6/fd 2 1 2024-09-17T01:56:28.044 INFO:tasks.workunit.client.0.smithi063.stdout:1/534: dread d0/d2d/d35/d3f/d4e/f6a [0,4194304] 0 2024-09-17T01:56:28.044 INFO:tasks.workunit.client.0.smithi063.stdout:5/509: unlink d6/d35/c64 0 2024-09-17T01:56:28.045 INFO:tasks.workunit.client.0.smithi063.stdout:4/482: readlink de/l2c 0 2024-09-17T01:56:28.045 INFO:tasks.workunit.client.0.smithi063.stdout:1/535: write d0/f1a [786697,69309] 0 2024-09-17T01:56:28.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/375: chown d1/f16 7063 1 2024-09-17T01:56:28.045 INFO:tasks.workunit.client.0.smithi063.stdout:7/358: write d2/d3/d27/f32 [1667750,31755] 0 2024-09-17T01:56:28.046 INFO:tasks.workunit.client.0.smithi063.stdout:6/464: mkdir dc/d14/d19/d20/d32/d52/d5a/d97 0 2024-09-17T01:56:28.046 INFO:tasks.workunit.client.0.smithi063.stdout:6/465: stat dc/d14/d19/d20/f83 0 2024-09-17T01:56:28.047 INFO:tasks.workunit.client.0.smithi063.stdout:1/536: chown d0/d2d/d5e/l60 108 1 2024-09-17T01:56:28.047 INFO:tasks.workunit.client.0.smithi063.stdout:4/483: creat de/d17/d36/f94 x:0 0 0 2024-09-17T01:56:28.047 INFO:tasks.workunit.client.0.smithi063.stdout:8/376: chown d1/d7/d28/d2f/d41/f58 244 1 2024-09-17T01:56:28.048 INFO:tasks.workunit.client.0.smithi063.stdout:4/484: readlink de/l85 0 2024-09-17T01:56:28.048 INFO:tasks.workunit.client.0.smithi063.stdout:7/359: rmdir d2/d3/d27/d33/d71 0 2024-09-17T01:56:28.048 INFO:tasks.workunit.client.0.smithi063.stdout:6/466: stat dc/d14/d18/l37 0 2024-09-17T01:56:28.048 INFO:tasks.workunit.client.0.smithi063.stdout:1/537: dread - d0/d2d/d35/d3f/f7b zero size 2024-09-17T01:56:28.049 INFO:tasks.workunit.client.0.smithi063.stdout:1/538: read - d0/d2d/d35/d3f/d81/d50/f9c zero size 2024-09-17T01:56:28.049 INFO:tasks.workunit.client.0.smithi063.stdout:8/377: rename d1/d27/c72 to d1/d7/d28/d2f/d62/c74 0 2024-09-17T01:56:28.050 INFO:tasks.workunit.client.0.smithi063.stdout:4/485: read de/d17/d1b/d67/d28/d30/f7b [828132,68684] 0 2024-09-17T01:56:28.050 INFO:tasks.workunit.client.0.smithi063.stdout:3/475: dwrite df/d12/d1e/f4f [0,4194304] 0 2024-09-17T01:56:28.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/539: write d0/d2d/f37 [1135436,108071] 0 2024-09-17T01:56:28.051 INFO:tasks.workunit.client.0.smithi063.stdout:8/378: rmdir d1/d7/d28/d2a/d37/d3a 39 2024-09-17T01:56:28.051 INFO:tasks.workunit.client.0.smithi063.stdout:3/476: readlink df/d12/l42 0 2024-09-17T01:56:28.052 INFO:tasks.workunit.client.0.smithi063.stdout:1/540: mkdir d0/d2d/d35/d6f/db7 0 2024-09-17T01:56:28.053 INFO:tasks.workunit.client.0.smithi063.stdout:3/477: mknod df/d12/d1e/d53/ca2 0 2024-09-17T01:56:28.053 INFO:tasks.workunit.client.0.smithi063.stdout:1/541: write d0/d2d/d35/d3f/d4e/f83 [1541867,69928] 0 2024-09-17T01:56:28.053 INFO:tasks.workunit.client.0.smithi063.stdout:3/478: stat c6 0 2024-09-17T01:56:28.055 INFO:tasks.workunit.client.0.smithi063.stdout:3/479: rename df/d12/c14 to df/d12/d30/ca3 0 2024-09-17T01:56:28.056 INFO:tasks.workunit.client.0.smithi063.stdout:1/542: rename d0/d2d/d35/d3f/d81/caf to d0/d2d/d35/d8c/d97/cb8 0 2024-09-17T01:56:28.058 INFO:tasks.workunit.client.0.smithi063.stdout:6/467: dwrite dc/d14/d19/d20/d32/d52/f5c [4194304,4194304] 0 2024-09-17T01:56:28.061 INFO:tasks.workunit.client.0.smithi063.stdout:8/379: dwrite d1/d7/d28/d2f/d41/d49/f3b [0,4194304] 0 2024-09-17T01:56:28.063 INFO:tasks.workunit.client.0.smithi063.stdout:5/510: getdents d6/d35 0 2024-09-17T01:56:28.063 INFO:tasks.workunit.client.0.smithi063.stdout:1/543: link d0/d2d/d35/d3f/d94/fa2 d0/d93/fb9 0 2024-09-17T01:56:28.063 INFO:tasks.workunit.client.0.smithi063.stdout:6/468: symlink dc/d14/d19/d20/d32/d52/d5a/d43/l98 0 2024-09-17T01:56:28.065 INFO:tasks.workunit.client.0.smithi063.stdout:9/370: dwrite d9/de/f19 [0,4194304] 0 2024-09-17T01:56:28.066 INFO:tasks.workunit.client.0.smithi063.stdout:1/544: link d0/d1c/c2c d0/d2d/d35/d3f/d81/d50/d6c/cba 0 2024-09-17T01:56:28.067 INFO:tasks.workunit.client.0.smithi063.stdout:1/545: rmdir d0/d93/d9a 0 2024-09-17T01:56:28.068 INFO:tasks.workunit.client.0.smithi063.stdout:1/546: readlink d0/d2d/d5e/l6d 0 2024-09-17T01:56:28.069 INFO:tasks.workunit.client.0.smithi063.stdout:8/380: mkdir d1/d7/d28/d2a/d37/d3a/d75 0 2024-09-17T01:56:28.071 INFO:tasks.workunit.client.0.smithi063.stdout:0/433: dread d1/d3/db/d18/d43/f60 [0,4194304] 0 2024-09-17T01:56:28.071 INFO:tasks.workunit.client.0.smithi063.stdout:4/486: dread de/d17/d36/f5b [0,4194304] 0 2024-09-17T01:56:28.072 INFO:tasks.workunit.client.0.smithi063.stdout:0/434: fdatasync d1/d3/d1b/f38 0 2024-09-17T01:56:28.073 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:28.077+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:28.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/487: symlink de/d17/d36/d70/l95 0 2024-09-17T01:56:28.074 INFO:tasks.workunit.client.0.smithi063.stdout:6/469: dwrite dc/d14/d19/d20/d32/d52/f80 [0,4194304] 0 2024-09-17T01:56:28.075 INFO:tasks.workunit.client.0.smithi063.stdout:0/435: write d1/d3/d32/f7b [955921,51181] 0 2024-09-17T01:56:28.075 INFO:tasks.workunit.client.0.smithi063.stdout:4/488: chown de/l2c 1832 1 2024-09-17T01:56:28.076 INFO:tasks.workunit.client.0.smithi063.stdout:1/547: dwrite d0/d1c/f5c [0,4194304] 0 2024-09-17T01:56:28.077 INFO:tasks.workunit.client.0.smithi063.stdout:4/489: dread - de/d17/d36/f81 zero size 2024-09-17T01:56:28.077 INFO:tasks.workunit.client.0.smithi063.stdout:0/436: chown d1/d3/c34 108122 1 2024-09-17T01:56:28.077 INFO:tasks.workunit.client.0.smithi063.stdout:5/511: dwrite d6/d23/d29/d2b/f89 [0,4194304] 0 2024-09-17T01:56:28.079 INFO:tasks.workunit.client.0.smithi063.stdout:6/470: read dc/f13 [3444561,84352] 0 2024-09-17T01:56:28.080 INFO:tasks.workunit.client.0.smithi063.stdout:1/548: unlink d0/d2d/fae 0 2024-09-17T01:56:28.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/381: dwrite d1/d7/f13 [0,4194304] 0 2024-09-17T01:56:28.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/382: symlink d1/d7/l76 0 2024-09-17T01:56:28.081 INFO:tasks.workunit.client.0.smithi063.stdout:1/549: rename d0/f14 to d0/d2d/d35/d3f/d94/fbb 0 2024-09-17T01:56:28.084 INFO:tasks.workunit.client.0.smithi063.stdout:0/437: dread d1/d3/db/d18/d33/f67 [0,4194304] 0 2024-09-17T01:56:28.087 INFO:tasks.workunit.client.0.smithi063.stdout:4/490: dwrite de/d17/d36/f7a [0,4194304] 0 2024-09-17T01:56:28.087 INFO:tasks.workunit.client.0.smithi063.stdout:0/438: truncate d1/d3/db/d18/d43/f7e 717881 0 2024-09-17T01:56:28.088 INFO:tasks.workunit.client.0.smithi063.stdout:5/512: dwrite d6/d23/f9e [0,4194304] 0 2024-09-17T01:56:28.089 INFO:tasks.workunit.client.0.smithi063.stdout:9/371: dread d9/de/d20/d1e/d2a/d40/f6c [0,4194304] 0 2024-09-17T01:56:28.089 INFO:tasks.workunit.client.0.smithi063.stdout:4/491: creat de/d17/d1b/d67/f96 x:0 0 0 2024-09-17T01:56:28.090 INFO:tasks.workunit.client.0.smithi063.stdout:4/492: truncate de/d2d/f64 642786 0 2024-09-17T01:56:28.090 INFO:tasks.workunit.client.0.smithi063.stdout:9/372: truncate d9/de/d20/d37/d42/f6b 792503 0 2024-09-17T01:56:28.090 INFO:tasks.workunit.client.0.smithi063.stdout:4/493: fsync de/f2f 0 2024-09-17T01:56:28.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/383: link d1/d7/d1d/f1f d1/d7/d1d/f77 0 2024-09-17T01:56:28.093 INFO:tasks.workunit.client.0.smithi063.stdout:8/384: dread - d1/d7/d28/f51 zero size 2024-09-17T01:56:28.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/373: write d9/d27/f7d [293542,110035] 0 2024-09-17T01:56:28.095 INFO:tasks.workunit.client.0.smithi063.stdout:8/385: dread - d1/d7/d28/d2a/d44/f73 zero size 2024-09-17T01:56:28.095 INFO:tasks.workunit.client.0.smithi063.stdout:9/374: write d9/de/d20/d1b/d25/f4e [2242384,60967] 0 2024-09-17T01:56:28.097 INFO:tasks.workunit.client.0.smithi063.stdout:9/375: creat d9/de/d20/d1b/d25/d73/f81 x:0 0 0 2024-09-17T01:56:28.097 INFO:tasks.workunit.client.0.smithi063.stdout:0/439: dwrite d1/d3/db/d18/f30 [0,4194304] 0 2024-09-17T01:56:28.097 INFO:tasks.workunit.client.0.smithi063.stdout:4/494: dwrite de/d17/d36/f81 [0,4194304] 0 2024-09-17T01:56:28.098 INFO:tasks.workunit.client.0.smithi063.stdout:8/386: creat d1/d7/d28/d2a/d37/f78 x:0 0 0 2024-09-17T01:56:28.098 INFO:tasks.workunit.client.0.smithi063.stdout:9/376: write d9/de/d20/d37/d42/f6b [600486,124300] 0 2024-09-17T01:56:28.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/440: unlink d1/d3/d1b/c4a 0 2024-09-17T01:56:28.099 INFO:tasks.workunit.client.0.smithi063.stdout:4/495: symlink de/d17/d1b/d67/d28/l97 0 2024-09-17T01:56:28.099 INFO:tasks.workunit.client.0.smithi063.stdout:8/387: mknod d1/d7/d28/d2f/d41/d49/c79 0 2024-09-17T01:56:28.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/377: chown d9/de/d20/d37/d42/d4c/l62 588 1 2024-09-17T01:56:28.100 INFO:tasks.workunit.client.0.smithi063.stdout:0/441: readlink d1/d3/d1b/l2b 0 2024-09-17T01:56:28.100 INFO:tasks.workunit.client.0.smithi063.stdout:4/496: chown de/d17/d1b/d67/f1d 0 1 2024-09-17T01:56:28.101 INFO:tasks.workunit.client.0.smithi063.stdout:9/378: unlink d9/de/d20/c1a 0 2024-09-17T01:56:28.101 INFO:tasks.workunit.client.0.smithi063.stdout:4/497: mkdir de/d17/d1b/d67/d28/d98 0 2024-09-17T01:56:28.102 INFO:tasks.workunit.client.0.smithi063.stdout:4/498: rmdir de/d17/d1b 39 2024-09-17T01:56:28.103 INFO:tasks.workunit.client.0.smithi063.stdout:4/499: write de/d17/d36/d70/d77/d90/f91 [4324486,57206] 0 2024-09-17T01:56:28.104 INFO:tasks.workunit.client.0.smithi063.stdout:9/379: readlink d9/de/d20/d1e/d2a/l2e 0 2024-09-17T01:56:28.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/399: sync 2024-09-17T01:56:28.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/400: dread - d3/d28/f5c zero size 2024-09-17T01:56:28.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/500: creat de/d2d/d3c/f99 x:0 0 0 2024-09-17T01:56:28.106 INFO:tasks.workunit.client.0.smithi063.stdout:9/380: mknod d9/d27/c82 0 2024-09-17T01:56:28.107 INFO:tasks.workunit.client.0.smithi063.stdout:2/401: chown d3/d7/df/d68/l5d 7 1 2024-09-17T01:56:28.108 INFO:tasks.workunit.client.0.smithi063.stdout:8/388: dwrite d1/d7/d28/d2f/d41/d49/f33 [0,4194304] 0 2024-09-17T01:56:28.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/381: chown d9/de/d20/d1b/d25/l3e 884 1 2024-09-17T01:56:28.108 INFO:tasks.workunit.client.0.smithi063.stdout:0/442: dwrite d1/d3/d10/f4e [0,4194304] 0 2024-09-17T01:56:28.109 INFO:tasks.workunit.client.0.smithi063.stdout:4/501: mkdir de/d17/d36/d70/d77/d90/d9a 0 2024-09-17T01:56:28.109 INFO:tasks.workunit.client.0.smithi063.stdout:9/382: fdatasync d9/de/d20/d1e/d2a/d40/f71 0 2024-09-17T01:56:28.110 INFO:tasks.workunit.client.0.smithi063.stdout:6/471: dread dc/d14/d2f/f51 [0,4194304] 0 2024-09-17T01:56:28.110 INFO:tasks.workunit.client.0.smithi063.stdout:4/502: write de/f4c [866160,82531] 0 2024-09-17T01:56:28.111 INFO:tasks.workunit.client.0.smithi063.stdout:9/383: write d9/de/d20/d1e/f46 [2423683,121615] 0 2024-09-17T01:56:28.111 INFO:tasks.workunit.client.0.smithi063.stdout:6/472: mkdir dc/d14/d19/d99 0 2024-09-17T01:56:28.112 INFO:tasks.workunit.client.0.smithi063.stdout:6/473: rmdir dc/d14/d65 39 2024-09-17T01:56:28.112 INFO:tasks.workunit.client.0.smithi063.stdout:8/389: link d1/d7/d28/d2f/d41/d49/f1b d1/d7/d28/d2a/d37/f7a 0 2024-09-17T01:56:28.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/384: creat d9/de/d20/d37/d42/d7f/f83 x:0 0 0 2024-09-17T01:56:28.113 INFO:tasks.workunit.client.0.smithi063.stdout:2/402: dread d3/d7/df/d68/f35 [0,4194304] 0 2024-09-17T01:56:28.115 INFO:tasks.workunit.client.0.smithi063.stdout:6/474: creat dc/d14/d65/f9a x:0 0 0 2024-09-17T01:56:28.116 INFO:tasks.workunit.client.0.smithi063.stdout:2/403: write d3/f8 [2427083,69680] 0 2024-09-17T01:56:28.116 INFO:tasks.workunit.client.0.smithi063.stdout:9/385: creat d9/de/d20/d1e/d2a/d36/f84 x:0 0 0 2024-09-17T01:56:28.117 INFO:tasks.workunit.client.0.smithi063.stdout:6/475: write dc/d14/d65/f7d [274766,93470] 0 2024-09-17T01:56:28.117 INFO:tasks.workunit.client.0.smithi063.stdout:2/404: mkdir d3/d7/d76 0 2024-09-17T01:56:28.117 INFO:tasks.workunit.client.0.smithi063.stdout:9/386: write d9/de/ff [141483,62315] 0 2024-09-17T01:56:28.118 INFO:tasks.workunit.client.0.smithi063.stdout:6/476: chown dc/d14/d19/d20/d32/d52/d5a/d43 499301 1 2024-09-17T01:56:28.122 INFO:tasks.workunit.client.0.smithi063.stdout:6/477: read dc/d14/d19/f1a [3278026,56713] 0 2024-09-17T01:56:28.122 INFO:tasks.workunit.client.0.smithi063.stdout:0/443: dread d1/f1e [0,4194304] 0 2024-09-17T01:56:28.124 INFO:tasks.workunit.client.0.smithi063.stdout:3/480: dread df/d12/d3a/f51 [0,4194304] 0 2024-09-17T01:56:28.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/444: creat d1/d1d/d6d/f94 x:0 0 0 2024-09-17T01:56:28.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/390: dwrite d1/d7/d28/d2f/d41/d49/f33 [4194304,4194304] 0 2024-09-17T01:56:28.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/478: rmdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d81 0 2024-09-17T01:56:28.127 INFO:tasks.workunit.client.0.smithi063.stdout:9/387: dwrite d9/d27/f3b [4194304,4194304] 0 2024-09-17T01:56:28.127 INFO:tasks.workunit.client.0.smithi063.stdout:0/445: write d1/f1e [660336,77832] 0 2024-09-17T01:56:28.127 INFO:tasks.workunit.client.0.smithi063.stdout:6/479: chown dc/d14/l17 25 1 2024-09-17T01:56:28.128 INFO:tasks.workunit.client.0.smithi063.stdout:8/391: dread - d1/d7/d28/d2a/d44/f73 zero size 2024-09-17T01:56:28.128 INFO:tasks.workunit.client.0.smithi063.stdout:2/405: dwrite d3/d7/df/d43/f55 [0,4194304] 0 2024-09-17T01:56:28.129 INFO:tasks.workunit.client.0.smithi063.stdout:9/388: rename d9/de/d20 to d9/de/d20/d37/d85 22 2024-09-17T01:56:28.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/389: truncate d9/d27/f7d 439846 0 2024-09-17T01:56:28.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/446: rmdir d1/d3/db/d18/d85 39 2024-09-17T01:56:28.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/447: dread - d1/d3/db/d18/d85/d92/f8c zero size 2024-09-17T01:56:28.135 INFO:tasks.workunit.client.0.smithi063.stdout:1/550: dread d0/d2d/d35/d3f/d81/f3e [0,4194304] 0 2024-09-17T01:56:28.136 INFO:tasks.workunit.client.0.smithi063.stdout:2/406: dwrite d3/d7/d38/f6c [0,4194304] 0 2024-09-17T01:56:28.136 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:28.136 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:28.137 INFO:tasks.workunit.client.0.smithi063.stdout:1/551: chown d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 1815717 1 2024-09-17T01:56:28.138 INFO:tasks.workunit.client.0.smithi063.stdout:7/360: sync 2024-09-17T01:56:28.138 INFO:tasks.workunit.client.0.smithi063.stdout:5/513: sync 2024-09-17T01:56:28.140 INFO:tasks.workunit.client.0.smithi063.stdout:6/480: dwrite dc/d14/d2f/f5f [0,4194304] 0 2024-09-17T01:56:28.141 INFO:tasks.workunit.client.0.smithi063.stdout:7/361: chown d2/d15/l1a 14 1 2024-09-17T01:56:28.142 INFO:tasks.workunit.client.0.smithi063.stdout:8/392: dwrite d1/d7/f14 [4194304,4194304] 0 2024-09-17T01:56:28.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/481: rmdir dc/d14/d2f 39 2024-09-17T01:56:28.143 INFO:tasks.workunit.client.0.smithi063.stdout:8/393: creat d1/d7/d28/d2f/f7b x:0 0 0 2024-09-17T01:56:28.144 INFO:tasks.workunit.client.0.smithi063.stdout:5/514: creat d6/d23/d29/d2b/fa2 x:0 0 0 2024-09-17T01:56:28.144 INFO:tasks.workunit.client.0.smithi063.stdout:1/552: link d0/d2d/l8d d0/d2d/d35/d6f/lbc 0 2024-09-17T01:56:28.145 INFO:tasks.workunit.client.0.smithi063.stdout:1/553: chown d0/d1c/l92 15 1 2024-09-17T01:56:28.145 INFO:tasks.workunit.client.0.smithi063.stdout:5/515: mkdir d6/d23/d29/da3 0 2024-09-17T01:56:28.146 INFO:tasks.workunit.client.0.smithi063.stdout:6/482: creat dc/d14/d19/d20/d32/d52/d5a/f9b x:0 0 0 2024-09-17T01:56:28.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/483: stat dc/d14/d19/f82 0 2024-09-17T01:56:28.148 INFO:tasks.workunit.client.0.smithi063.stdout:5/516: mkdir d6/d23/d29/d2b/da4 0 2024-09-17T01:56:28.149 INFO:tasks.workunit.client.0.smithi063.stdout:7/362: dread d2/d3/d27/d39/d40/f6a [0,4194304] 0 2024-09-17T01:56:28.150 INFO:tasks.workunit.client.0.smithi063.stdout:0/448: dwrite d1/d3/d1b/f65 [0,4194304] 0 2024-09-17T01:56:28.150 INFO:tasks.workunit.client.0.smithi063.stdout:6/484: write dc/d14/d65/f7d [908561,66835] 0 2024-09-17T01:56:28.151 INFO:tasks.workunit.client.0.smithi063.stdout:7/363: rmdir d2/d15 39 2024-09-17T01:56:28.151 INFO:tasks.workunit.client.0.smithi063.stdout:0/449: read - d1/d3/db/d4b/f45 zero size 2024-09-17T01:56:28.151 INFO:tasks.workunit.client.0.smithi063.stdout:7/364: fsync d2/d3/d27/d39/f3c 0 2024-09-17T01:56:28.152 INFO:tasks.workunit.client.0.smithi063.stdout:6/485: write dc/f1e [5221151,29150] 0 2024-09-17T01:56:28.152 INFO:tasks.workunit.client.0.smithi063.stdout:0/450: stat d1/d44/d53/d62/l84 0 2024-09-17T01:56:28.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/365: write d2/d15/d2f/f3d [3134027,83437] 0 2024-09-17T01:56:28.153 INFO:tasks.workunit.client.0.smithi063.stdout:0/451: creat d1/d3/db/d18/f95 x:0 0 0 2024-09-17T01:56:28.154 INFO:tasks.workunit.client.0.smithi063.stdout:7/366: write d2/d15/d2f/f64 [354894,107672] 0 2024-09-17T01:56:28.154 INFO:tasks.workunit.client.0.smithi063.stdout:8/394: dread d1/f2e [0,4194304] 0 2024-09-17T01:56:28.155 INFO:tasks.workunit.client.0.smithi063.stdout:7/367: mkdir d2/d3/d17/d76 0 2024-09-17T01:56:28.155 INFO:tasks.workunit.client.0.smithi063.stdout:9/390: dread d9/fc [0,4194304] 0 2024-09-17T01:56:28.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/368: fdatasync d2/fb 0 2024-09-17T01:56:28.157 INFO:tasks.workunit.client.0.smithi063.stdout:9/391: fsync d9/de/d33/f38 0 2024-09-17T01:56:28.157 INFO:tasks.workunit.client.0.smithi063.stdout:4/503: dread de/f3b [0,4194304] 0 2024-09-17T01:56:28.158 INFO:tasks.workunit.client.0.smithi063.stdout:8/395: link d1/d7/d28/d2f/d41/d49/f3b d1/d7/d28/d2a/d4d/f7c 0 2024-09-17T01:56:28.158 INFO:tasks.workunit.client.0.smithi063.stdout:7/369: creat d2/d3/d22/f77 x:0 0 0 2024-09-17T01:56:28.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/504: fdatasync de/d2d/d3c/f4b 0 2024-09-17T01:56:28.159 INFO:tasks.workunit.client.0.smithi063.stdout:7/370: creat d2/d15/d2f/d45/d48/f78 x:0 0 0 2024-09-17T01:56:28.160 INFO:tasks.workunit.client.0.smithi063.stdout:3/481: dread df/d12/d30/f32 [0,4194304] 0 2024-09-17T01:56:28.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/392: unlink d9/de/d20/d1e/d2a/d40/d4f/c5f 0 2024-09-17T01:56:28.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:28.162 INFO:tasks.workunit.client.0.smithi063.stdout:0/452: dwrite d1/d3/d32/f93 [0,4194304] 0 2024-09-17T01:56:28.162 INFO:tasks.workunit.client.0.smithi063.stdout:3/482: dread - df/d12/d3a/f64 zero size 2024-09-17T01:56:28.163 INFO:tasks.workunit.client.0.smithi063.stdout:7/371: creat d2/d3/d17/f79 x:0 0 0 2024-09-17T01:56:28.163 INFO:tasks.workunit.client.0.smithi063.stdout:9/393: symlink d9/de/d20/d1e/d2a/d36/l86 0 2024-09-17T01:56:28.163 INFO:tasks.workunit.client.0.smithi063.stdout:0/453: mknod d1/d44/c96 0 2024-09-17T01:56:28.164 INFO:tasks.workunit.client.0.smithi063.stdout:9/394: write d9/d27/f3a [3610192,102521] 0 2024-09-17T01:56:28.164 INFO:tasks.workunit.client.0.smithi063.stdout:0/454: mknod d1/d44/d53/c97 0 2024-09-17T01:56:28.165 INFO:tasks.workunit.client.0.smithi063.stdout:9/395: write d9/de/f19 [5076758,82259] 0 2024-09-17T01:56:28.167 INFO:tasks.workunit.client.0.smithi063.stdout:0/455: rmdir d1/d44/d7c 39 2024-09-17T01:56:28.167 INFO:tasks.workunit.client.0.smithi063.stdout:3/483: dread df/d12/d2d/f52 [0,4194304] 0 2024-09-17T01:56:28.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/396: dwrite d1/d7/d28/f45 [0,4194304] 0 2024-09-17T01:56:28.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/397: fdatasync d1/d7/d1d/f5f 0 2024-09-17T01:56:28.171 INFO:tasks.workunit.client.0.smithi063.stdout:7/372: dwrite d2/d3/d27/d39/d40/f6a [0,4194304] 0 2024-09-17T01:56:28.173 INFO:tasks.workunit.client.0.smithi063.stdout:9/396: dwrite d9/f5b [0,4194304] 0 2024-09-17T01:56:28.175 INFO:tasks.workunit.client.0.smithi063.stdout:3/484: symlink df/d12/d30/la4 0 2024-09-17T01:56:28.175 INFO:tasks.workunit.client.0.smithi063.stdout:0/456: mkdir d1/d3/db/d4b/d98 0 2024-09-17T01:56:28.176 INFO:tasks.workunit.client.0.smithi063.stdout:0/457: truncate d1/d44/d53/f8b 241044 0 2024-09-17T01:56:28.177 INFO:tasks.workunit.client.0.smithi063.stdout:7/373: mknod d2/d3/c7a 0 2024-09-17T01:56:28.178 INFO:tasks.workunit.client.0.smithi063.stdout:3/485: rmdir df/d12/d1e/d39 39 2024-09-17T01:56:28.179 INFO:tasks.workunit.client.0.smithi063.stdout:6/486: dread dc/d14/d19/f2d [0,4194304] 0 2024-09-17T01:56:28.179 INFO:tasks.workunit.client.0.smithi063.stdout:7/374: chown d2/d3/l8 18815 1 2024-09-17T01:56:28.179 INFO:tasks.workunit.client.0.smithi063.stdout:8/398: mknod d1/d7/d28/d2a/d37/d3a/d75/c7d 0 2024-09-17T01:56:28.179 INFO:tasks.workunit.client.0.smithi063.stdout:2/407: sync 2024-09-17T01:56:28.179 INFO:tasks.workunit.client.0.smithi063.stdout:1/554: sync 2024-09-17T01:56:28.179 INFO:tasks.workunit.client.0.smithi063.stdout:5/517: dread d6/d23/d29/d2b/d31/f33 [0,4194304] 0 2024-09-17T01:56:28.183 INFO:tasks.workunit.client.0.smithi063.stdout:9/397: symlink d9/de/d20/d37/d42/d7e/l87 0 2024-09-17T01:56:28.184 INFO:tasks.workunit.client.0.smithi063.stdout:8/399: readlink d1/d7/d28/d2a/l3f 0 2024-09-17T01:56:28.184 INFO:tasks.workunit.client.0.smithi063.stdout:5/518: mkdir d6/d23/d29/da5 0 2024-09-17T01:56:28.186 INFO:tasks.workunit.client.0.smithi063.stdout:2/408: truncate d3/d7/df/d30/f67 7687922 0 2024-09-17T01:56:28.188 INFO:tasks.workunit.client.0.smithi063.stdout:0/458: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:56:28.189 INFO:tasks.workunit.client.0.smithi063.stdout:9/398: creat d9/de/d33/f88 x:0 0 0 2024-09-17T01:56:28.189 INFO:tasks.workunit.client.0.smithi063.stdout:4/505: dread de/d17/d1b/f32 [0,4194304] 0 2024-09-17T01:56:28.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/486: dwrite df/f26 [0,4194304] 0 2024-09-17T01:56:28.191 INFO:tasks.workunit.client.0.smithi063.stdout:2/409: truncate d3/d2a/f47 480111 0 2024-09-17T01:56:28.191 INFO:tasks.workunit.client.0.smithi063.stdout:7/375: dwrite d2/d15/d2f/f3d [0,4194304] 0 2024-09-17T01:56:28.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/400: rename d1/la to d1/d7/d28/d2f/d41/l7e 0 2024-09-17T01:56:28.192 INFO:tasks.workunit.client.0.smithi063.stdout:9/399: creat d9/d27/f89 x:0 0 0 2024-09-17T01:56:28.192 INFO:tasks.workunit.client.0.smithi063.stdout:4/506: mkdir de/d17/d1b/d9b 0 2024-09-17T01:56:28.192 INFO:tasks.workunit.client.0.smithi063.stdout:1/555: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [0,4194304] 0 2024-09-17T01:56:28.192 INFO:tasks.workunit.client.0.smithi063.stdout:6/487: dwrite dc/d14/d19/d20/d32/d52/d5a/d43/f86 [0,4194304] 0 2024-09-17T01:56:28.193 INFO:tasks.workunit.client.0.smithi063.stdout:6/488: sync 2024-09-17T01:56:28.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/401: readlink d1/d7/lb 0 2024-09-17T01:56:28.194 INFO:tasks.workunit.client.0.smithi063.stdout:5/519: write d6/d23/d29/d36/f5b [1155770,31964] 0 2024-09-17T01:56:28.196 INFO:tasks.workunit.client.0.smithi063.stdout:5/520: mkdir d6/d23/d3f/da6 0 2024-09-17T01:56:28.196 INFO:tasks.workunit.client.0.smithi063.stdout:4/507: unlink de/d2d/l71 0 2024-09-17T01:56:28.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/376: truncate d2/d15/d2f/d45/f69 778679 0 2024-09-17T01:56:28.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/400: rename d9/de/d20/d1b/d25/d73/l77 to d9/de/d20/d37/d42/d7e/l8a 0 2024-09-17T01:56:28.196 INFO:tasks.workunit.client.0.smithi063.stdout:4/508: mkdir de/d2d/d52/d9c 0 2024-09-17T01:56:28.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/377: chown d2/d3/d17/d25 11355 1 2024-09-17T01:56:28.197 INFO:tasks.workunit.client.0.smithi063.stdout:5/521: dread - d6/d23/d29/d36/f7d zero size 2024-09-17T01:56:28.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/378: unlink d2/d15/d2f/l55 0 2024-09-17T01:56:28.198 INFO:tasks.workunit.client.0.smithi063.stdout:5/522: readlink d6/d23/d29/d36/l8d 0 2024-09-17T01:56:28.198 INFO:tasks.workunit.client.0.smithi063.stdout:4/509: write de/d17/d1b/d67/d28/d30/f61 [396971,15488] 0 2024-09-17T01:56:28.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/379: write d2/f4 [4649185,72637] 0 2024-09-17T01:56:28.200 INFO:tasks.workunit.client.0.smithi063.stdout:5/523: read d6/d9/d32/f71 [1923412,106448] 0 2024-09-17T01:56:28.201 INFO:tasks.workunit.client.0.smithi063.stdout:7/380: mkdir d2/d3/d27/d33/d7b 0 2024-09-17T01:56:28.202 INFO:tasks.workunit.client.0.smithi063.stdout:1/556: dwrite d0/f4 [0,4194304] 0 2024-09-17T01:56:28.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/524: fdatasync d6/d9/d13/f1e 0 2024-09-17T01:56:28.202 INFO:tasks.workunit.client.0.smithi063.stdout:4/510: truncate de/d2d/d52/f5f 1865982 0 2024-09-17T01:56:28.202 INFO:tasks.workunit.client.0.smithi063.stdout:7/381: chown d2/d3/d22/c3f 121294 1 2024-09-17T01:56:28.203 INFO:tasks.workunit.client.0.smithi063.stdout:1/557: rename d0/d1c/l49 to d0/d1c/lbd 0 2024-09-17T01:56:28.203 INFO:tasks.workunit.client.0.smithi063.stdout:9/401: dwrite d9/de/d20/d1e/d2a/d36/f6f [0,4194304] 0 2024-09-17T01:56:28.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/525: rename d6/d23/d29/da5 to d6/d9/d32/d8c/da7 0 2024-09-17T01:56:28.204 INFO:tasks.workunit.client.0.smithi063.stdout:4/511: symlink de/d17/d1b/d67/l9d 0 2024-09-17T01:56:28.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/382: creat d2/d3/d67/f7c x:0 0 0 2024-09-17T01:56:28.205 INFO:tasks.workunit.client.0.smithi063.stdout:0/459: truncate f0 999384 0 2024-09-17T01:56:28.207 INFO:tasks.workunit.client.0.smithi063.stdout:4/512: fsync de/d2d/d52/f84 0 2024-09-17T01:56:28.207 INFO:tasks.workunit.client.0.smithi063.stdout:4/513: write de/d17/d36/f81 [426902,114662] 0 2024-09-17T01:56:28.207 INFO:tasks.workunit.client.0.smithi063.stdout:9/402: mknod d9/de/d20/d32/c8b 0 2024-09-17T01:56:28.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/402: write d1/d7/d28/d2f/d41/d49/f23 [283654,80150] 0 2024-09-17T01:56:28.210 INFO:tasks.workunit.client.0.smithi063.stdout:6/489: truncate dc/d14/d18/f31 1092006 0 2024-09-17T01:56:28.211 INFO:tasks.workunit.client.0.smithi063.stdout:1/558: mknod d0/d2d/d35/d3f/d81/d50/d8b/db3/cbe 0 2024-09-17T01:56:28.211 INFO:tasks.workunit.client.0.smithi063.stdout:7/383: unlink d2/d3/d27/f41 0 2024-09-17T01:56:28.211 INFO:tasks.workunit.client.0.smithi063.stdout:5/526: dwrite d6/d23/d29/d36/f5b [0,4194304] 0 2024-09-17T01:56:28.212 INFO:tasks.workunit.client.0.smithi063.stdout:6/490: mkdir dc/d14/d19/d20/d32/d68/d9c 0 2024-09-17T01:56:28.212 INFO:tasks.workunit.client.0.smithi063.stdout:0/460: rename d1/d3/db/d18/d85/f8e to d1/d1d/f99 0 2024-09-17T01:56:28.213 INFO:tasks.workunit.client.0.smithi063.stdout:5/527: mkdir d6/d23/d29/d2b/d31/da8 0 2024-09-17T01:56:28.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/514: mkdir de/d17/d1b/d9e 0 2024-09-17T01:56:28.213 INFO:tasks.workunit.client.0.smithi063.stdout:9/403: link d9/de/d20/c31 d9/de/d20/d1b/d25/c8c 0 2024-09-17T01:56:28.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/515: sync 2024-09-17T01:56:28.213 INFO:tasks.workunit.client.0.smithi063.stdout:6/491: write dc/f13 [1490606,111962] 0 2024-09-17T01:56:28.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/403: rename d1/d7/d28/d2a/f5a to d1/d7/d1d/f7f 0 2024-09-17T01:56:28.214 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:28.217+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:28.215 INFO:tasks.workunit.client.0.smithi063.stdout:1/559: write d0/d2d/d35/d3f/d81/f45 [2033134,1118] 0 2024-09-17T01:56:28.215 INFO:tasks.workunit.client.0.smithi063.stdout:7/384: creat d2/f7d x:0 0 0 2024-09-17T01:56:28.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/516: stat de/d17/d1b/d67/f37 0 2024-09-17T01:56:28.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/461: mkdir d1/d1d/d74/d9a 0 2024-09-17T01:56:28.215 INFO:tasks.workunit.client.0.smithi063.stdout:5/528: mkdir d6/d9/d32/d8c/da7/da9 0 2024-09-17T01:56:28.216 INFO:tasks.workunit.client.0.smithi063.stdout:9/404: rename d9/de/d20/d1e to d9/d8d 0 2024-09-17T01:56:28.216 INFO:tasks.workunit.client.0.smithi063.stdout:8/404: symlink d1/d7/d28/d2a/d53/l80 0 2024-09-17T01:56:28.216 INFO:tasks.workunit.client.0.smithi063.stdout:1/560: write d0/d2d/d35/d3f/d4e/f5f [4483536,32507] 0 2024-09-17T01:56:28.216 INFO:tasks.workunit.client.0.smithi063.stdout:0/462: rename d1/d3/c6a to d1/d44/d7c/d88/c9b 0 2024-09-17T01:56:28.217 INFO:tasks.workunit.client.0.smithi063.stdout:8/405: mkdir d1/d27/d81 0 2024-09-17T01:56:28.217 INFO:tasks.workunit.client.0.smithi063.stdout:4/517: truncate de/d17/d1b/d67/f4e 327281 0 2024-09-17T01:56:28.217 INFO:tasks.workunit.client.0.smithi063.stdout:9/405: creat d9/de/d20/d37/f8e x:0 0 0 2024-09-17T01:56:28.218 INFO:tasks.workunit.client.0.smithi063.stdout:1/561: creat d0/d2d/d35/d3f/d94/fbf x:0 0 0 2024-09-17T01:56:28.218 INFO:tasks.workunit.client.0.smithi063.stdout:8/406: mkdir d1/d27/d82 0 2024-09-17T01:56:28.218 INFO:tasks.workunit.client.0.smithi063.stdout:0/463: write d1/d3/d32/f7b [486988,67532] 0 2024-09-17T01:56:28.218 INFO:tasks.workunit.client.0.smithi063.stdout:4/518: write de/d17/d36/d70/f8f [943648,39678] 0 2024-09-17T01:56:28.218 INFO:tasks.workunit.client.0.smithi063.stdout:2/410: dread d3/f21 [0,4194304] 0 2024-09-17T01:56:28.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/464: chown d1/d3/d1b/f29 11853272 1 2024-09-17T01:56:28.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/562: dread - d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a zero size 2024-09-17T01:56:28.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:28.222 INFO:tasks.workunit.client.0.smithi063.stdout:4/519: stat de/d17/d1b/d67/d28/d30/f7b 0 2024-09-17T01:56:28.222 INFO:tasks.workunit.client.0.smithi063.stdout:9/406: link d9/d27/c82 d9/de/d20/d37/d42/c8f 0 2024-09-17T01:56:28.222 INFO:tasks.workunit.client.0.smithi063.stdout:2/411: creat d3/d7/d76/f77 x:0 0 0 2024-09-17T01:56:28.223 INFO:tasks.workunit.client.0.smithi063.stdout:1/563: rename d0/d2d/d35/d3f/d94/fa2 to d0/d2d/d35/d6f/fc0 0 2024-09-17T01:56:28.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/520: creat de/d17/d1b/d67/f9f x:0 0 0 2024-09-17T01:56:28.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/412: rmdir d3/d7/df/d5a 39 2024-09-17T01:56:28.225 INFO:tasks.workunit.client.0.smithi063.stdout:9/407: rmdir d9/d8d/d2a/d40/d4f 0 2024-09-17T01:56:28.226 INFO:tasks.workunit.client.0.smithi063.stdout:8/407: dwrite d1/f5e [0,4194304] 0 2024-09-17T01:56:28.226 INFO:tasks.workunit.client.0.smithi063.stdout:7/385: dread d2/d15/d2f/d45/f69 [0,4194304] 0 2024-09-17T01:56:28.227 INFO:tasks.workunit.client.0.smithi063.stdout:4/521: symlink de/d17/d1b/d67/la0 0 2024-09-17T01:56:28.230 INFO:tasks.workunit.client.0.smithi063.stdout:9/408: creat d9/de/d20/d37/d42/d4c/f90 x:0 0 0 2024-09-17T01:56:28.232 INFO:tasks.workunit.client.0.smithi063.stdout:9/409: sync 2024-09-17T01:56:28.232 INFO:tasks.workunit.client.0.smithi063.stdout:1/564: truncate d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a 867936 0 2024-09-17T01:56:28.232 INFO:tasks.workunit.client.0.smithi063.stdout:7/386: fdatasync d2/d15/d2f/d45/d48/f78 0 2024-09-17T01:56:28.232 INFO:tasks.workunit.client.0.smithi063.stdout:8/408: chown d1/d7/d28/d2a/d37/c4f 1021866 1 2024-09-17T01:56:28.232 INFO:tasks.workunit.client.0.smithi063.stdout:0/465: dwrite d1/d3/db/d18/f5b [0,4194304] 0 2024-09-17T01:56:28.233 INFO:tasks.workunit.client.0.smithi063.stdout:8/409: fdatasync d1/f10 0 2024-09-17T01:56:28.233 INFO:tasks.workunit.client.0.smithi063.stdout:6/492: dread dc/f4e [0,4194304] 0 2024-09-17T01:56:28.233 INFO:tasks.workunit.client.0.smithi063.stdout:6/493: write dc/d14/d19/f1c [2239124,70286] 0 2024-09-17T01:56:28.234 INFO:tasks.workunit.client.0.smithi063.stdout:1/565: symlink d0/d2d/d35/d3f/d81/d50/d8b/lc1 0 2024-09-17T01:56:28.234 INFO:tasks.workunit.client.0.smithi063.stdout:0/466: rename d1/d1d/c59 to d1/d1d/d74/d9a/c9c 0 2024-09-17T01:56:28.235 INFO:tasks.workunit.client.0.smithi063.stdout:6/494: fsync dc/f44 0 2024-09-17T01:56:28.237 INFO:tasks.workunit.client.0.smithi063.stdout:2/413: dread d3/d7/d38/f45 [0,4194304] 0 2024-09-17T01:56:28.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/495: creat dc/d14/d18/d74/f9d x:0 0 0 2024-09-17T01:56:28.238 INFO:tasks.workunit.client.0.smithi063.stdout:0/467: chown d1/d3/d1b/d50/d6c/c72 4027 1 2024-09-17T01:56:28.239 INFO:tasks.workunit.client.0.smithi063.stdout:9/410: dwrite d9/de/d20/d37/d42/d7f/f83 [0,4194304] 0 2024-09-17T01:56:28.239 INFO:tasks.workunit.client.0.smithi063.stdout:2/414: symlink d3/d7/d38/l78 0 2024-09-17T01:56:28.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/411: write d9/f5b [314204,80468] 0 2024-09-17T01:56:28.240 INFO:tasks.workunit.client.0.smithi063.stdout:6/496: write dc/d14/d18/f94 [1003027,53538] 0 2024-09-17T01:56:28.241 INFO:tasks.workunit.client.0.smithi063.stdout:8/410: dwrite d1/d7/d28/f45 [0,4194304] 0 2024-09-17T01:56:28.242 INFO:tasks.workunit.client.0.smithi063.stdout:1/566: write d0/d93/fb9 [420290,121143] 0 2024-09-17T01:56:28.242 INFO:tasks.workunit.client.0.smithi063.stdout:4/522: dread de/d17/d1b/f4f [0,4194304] 0 2024-09-17T01:56:28.244 INFO:tasks.workunit.client.0.smithi063.stdout:9/412: rename d9/d27/f89 to d9/de/d20/d37/f91 0 2024-09-17T01:56:28.244 INFO:tasks.workunit.client.0.smithi063.stdout:5/529: dread d6/d9/d13/f1e [0,4194304] 0 2024-09-17T01:56:28.244 INFO:tasks.workunit.client.0.smithi063.stdout:8/411: write d1/d7/d28/f51 [550974,103494] 0 2024-09-17T01:56:28.246 INFO:tasks.workunit.client.0.smithi063.stdout:1/567: creat d0/d2d/fc2 x:0 0 0 2024-09-17T01:56:28.247 INFO:tasks.workunit.client.0.smithi063.stdout:6/497: mknod dc/d14/d19/d20/d32/d52/d5a/c9e 0 2024-09-17T01:56:28.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/487: dread df/d12/d43/f69 [0,4194304] 0 2024-09-17T01:56:28.247 INFO:tasks.workunit.client.0.smithi063.stdout:2/415: dread d3/f21 [0,4194304] 0 2024-09-17T01:56:28.248 INFO:tasks.workunit.client.0.smithi063.stdout:4/523: symlink de/d17/d1b/d67/d28/la1 0 2024-09-17T01:56:28.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/413: creat d9/de/d20/d37/d42/d7f/f92 x:0 0 0 2024-09-17T01:56:28.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/524: chown de/d17/d36/c7e 470 1 2024-09-17T01:56:28.250 INFO:tasks.workunit.client.0.smithi063.stdout:3/488: unlink df/d28/f90 0 2024-09-17T01:56:28.252 INFO:tasks.workunit.client.0.smithi063.stdout:9/414: read d9/d27/f3a [258164,57957] 0 2024-09-17T01:56:28.252 INFO:tasks.workunit.client.0.smithi063.stdout:3/489: chown df/d12/d43/d50/f5d 0 1 2024-09-17T01:56:28.253 INFO:tasks.workunit.client.0.smithi063.stdout:5/530: dwrite d6/fd [8388608,4194304] 0 2024-09-17T01:56:28.253 INFO:tasks.workunit.client.0.smithi063.stdout:4/525: truncate de/d17/f23 3363529 0 2024-09-17T01:56:28.253 INFO:tasks.workunit.client.0.smithi063.stdout:6/498: dwrite dc/d1b/f29 [8388608,4194304] 0 2024-09-17T01:56:28.255 INFO:tasks.workunit.client.0.smithi063.stdout:5/531: fsync d6/d23/d29/d2b/d4f/f52 0 2024-09-17T01:56:28.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/490: write df/d12/d1e/f4f [8976234,83258] 0 2024-09-17T01:56:28.258 INFO:tasks.workunit.client.0.smithi063.stdout:4/526: dread de/f3b [0,4194304] 0 2024-09-17T01:56:28.258 INFO:tasks.workunit.client.0.smithi063.stdout:6/499: symlink dc/d14/d19/d20/d32/d52/d5a/d43/l9f 0 2024-09-17T01:56:28.258 INFO:tasks.workunit.client.0.smithi063.stdout:5/532: symlink d6/d23/laa 0 2024-09-17T01:56:28.259 INFO:tasks.workunit.client.0.smithi063.stdout:3/491: symlink df/d12/d30/d8a/la5 0 2024-09-17T01:56:28.259 INFO:tasks.workunit.client.0.smithi063.stdout:3/492: chown df/c22 716602 1 2024-09-17T01:56:28.260 INFO:tasks.workunit.client.0.smithi063.stdout:2/416: truncate d3/d2a/f54 411074 0 2024-09-17T01:56:28.261 INFO:tasks.workunit.client.0.smithi063.stdout:6/500: mknod dc/d1b/d5e/ca0 0 2024-09-17T01:56:28.261 INFO:tasks.workunit.client.0.smithi063.stdout:2/417: write d3/f44 [2294032,84941] 0 2024-09-17T01:56:28.262 INFO:tasks.workunit.client.0.smithi063.stdout:5/533: creat d6/d9/d32/d8c/da7/da9/fab x:0 0 0 2024-09-17T01:56:28.262 INFO:tasks.workunit.client.0.smithi063.stdout:3/493: unlink df/d12/d3a/f64 0 2024-09-17T01:56:28.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/412: read d1/d7/d28/f51 [510128,59443] 0 2024-09-17T01:56:28.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/501: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/da1 0 2024-09-17T01:56:28.263 INFO:tasks.workunit.client.0.smithi063.stdout:2/418: creat d3/f79 x:0 0 0 2024-09-17T01:56:28.264 INFO:tasks.workunit.client.0.smithi063.stdout:8/413: rmdir d1/d7/d28/d2a/d53 39 2024-09-17T01:56:28.264 INFO:tasks.workunit.client.0.smithi063.stdout:9/415: dwrite d9/d8d/d2a/f35 [4194304,4194304] 0 2024-09-17T01:56:28.265 INFO:tasks.workunit.client.0.smithi063.stdout:8/414: read d1/d7/d28/d2f/d41/d49/f33 [228040,62834] 0 2024-09-17T01:56:28.265 INFO:tasks.workunit.client.0.smithi063.stdout:2/419: truncate d3/d7/df/d68/f74 356709 0 2024-09-17T01:56:28.267 INFO:tasks.workunit.client.0.smithi063.stdout:9/416: read d9/de/d20/d1b/d25/f4e [1230476,107479] 0 2024-09-17T01:56:28.268 INFO:tasks.workunit.client.0.smithi063.stdout:6/502: dread dc/d14/d19/f1a [0,4194304] 0 2024-09-17T01:56:28.270 INFO:tasks.workunit.client.0.smithi063.stdout:6/503: truncate dc/d14/d19/d20/d32/d52/d5a/f9b 986879 0 2024-09-17T01:56:28.270 INFO:tasks.workunit.client.0.smithi063.stdout:4/527: read de/d17/d1b/f6a [109603,82896] 0 2024-09-17T01:56:28.271 INFO:tasks.workunit.client.0.smithi063.stdout:6/504: chown dc/d14/d18/d74/f88 835 1 2024-09-17T01:56:28.271 INFO:tasks.workunit.client.0.smithi063.stdout:2/420: creat d3/d7/d76/f7a x:0 0 0 2024-09-17T01:56:28.271 INFO:tasks.workunit.client.0.smithi063.stdout:8/415: symlink d1/d7/l83 0 2024-09-17T01:56:28.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/568: dread d0/f1a [0,4194304] 0 2024-09-17T01:56:28.272 INFO:tasks.workunit.client.0.smithi063.stdout:4/528: symlink de/d17/d1b/d67/la2 0 2024-09-17T01:56:28.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/529: mknod de/d17/d36/d70/d77/d90/ca3 0 2024-09-17T01:56:28.275 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:28.277+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:28.275 INFO:tasks.workunit.client.0.smithi063.stdout:4/530: chown de/d17/d1b/d67/d28/l97 217 1 2024-09-17T01:56:28.275 INFO:tasks.workunit.client.0.smithi063.stdout:4/531: readlink de/d17/d1b/d67/l27 0 2024-09-17T01:56:28.276 INFO:tasks.workunit.client.0.smithi063.stdout:4/532: rmdir de 39 2024-09-17T01:56:28.277 INFO:tasks.workunit.client.0.smithi063.stdout:4/533: fdatasync de/f2e 0 2024-09-17T01:56:28.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/387: dread d2/f7 [0,4194304] 0 2024-09-17T01:56:28.278 INFO:tasks.workunit.client.0.smithi063.stdout:7/388: mkdir d2/d3/d7e 0 2024-09-17T01:56:28.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/494: dread df/f49 [0,4194304] 0 2024-09-17T01:56:28.279 INFO:tasks.workunit.client.0.smithi063.stdout:6/505: write dc/d14/d19/f53 [890929,31111] 0 2024-09-17T01:56:28.280 INFO:tasks.workunit.client.0.smithi063.stdout:4/534: link de/d17/d1b/d67/d28/l97 de/d17/d1b/d67/la4 0 2024-09-17T01:56:28.280 INFO:tasks.workunit.client.0.smithi063.stdout:8/416: truncate d1/d27/f64 336223 0 2024-09-17T01:56:28.281 INFO:tasks.workunit.client.0.smithi063.stdout:0/468: dread d1/d1d/f2d [0,4194304] 0 2024-09-17T01:56:28.281 INFO:tasks.workunit.client.0.smithi063.stdout:7/389: write d2/d15/d2f/f3d [975102,6277] 0 2024-09-17T01:56:28.281 INFO:tasks.workunit.client.0.smithi063.stdout:3/495: chown df/d12/d30/c84 1458775 1 2024-09-17T01:56:28.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/417: stat d1/d7/d28/d2a/d37/d3a/l60 0 2024-09-17T01:56:28.282 INFO:tasks.workunit.client.0.smithi063.stdout:3/496: dread - df/d12/d43/d50/d58/f6b zero size 2024-09-17T01:56:28.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/469: write d1/d3/d1b/f54 [1891258,11640] 0 2024-09-17T01:56:28.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/390: truncate d2/d3/d27/d65/f6d 893876 0 2024-09-17T01:56:28.284 INFO:tasks.workunit.client.0.smithi063.stdout:8/418: readlink d1/d7/d28/d2a/l3f 0 2024-09-17T01:56:28.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/569: dwrite d0/d2d/d35/d3f/d81/d50/f54 [0,4194304] 0 2024-09-17T01:56:28.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/391: creat d2/d15/d2f/d45/d48/f7f x:0 0 0 2024-09-17T01:56:28.288 INFO:tasks.workunit.client.0.smithi063.stdout:8/419: mknod d1/d7/d28/d2a/d37/c84 0 2024-09-17T01:56:28.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/420: mkdir d1/d7/d28/d2a/d37/d3a/d85 0 2024-09-17T01:56:28.290 INFO:tasks.workunit.client.0.smithi063.stdout:7/392: mknod d2/d3/d27/d39/c80 0 2024-09-17T01:56:28.290 INFO:tasks.workunit.client.0.smithi063.stdout:1/570: rename d0/d2d/l61 to d0/d2d/d5e/d7e/lc3 0 2024-09-17T01:56:28.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/421: dread d3/f44 [0,4194304] 0 2024-09-17T01:56:28.291 INFO:tasks.workunit.client.0.smithi063.stdout:1/571: mkdir d0/d93/dc4 0 2024-09-17T01:56:28.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/421: symlink d1/d7/d28/d2f/l86 0 2024-09-17T01:56:28.292 INFO:tasks.workunit.client.0.smithi063.stdout:7/393: getdents d2 0 2024-09-17T01:56:28.292 INFO:tasks.workunit.client.0.smithi063.stdout:8/422: mkdir d1/d7/d28/d87 0 2024-09-17T01:56:28.292 INFO:tasks.workunit.client.0.smithi063.stdout:1/572: mkdir d0/d2d/d5e/dc5 0 2024-09-17T01:56:28.293 INFO:tasks.workunit.client.0.smithi063.stdout:8/423: chown d1/d7/d28/d2a/d44 194304 1 2024-09-17T01:56:28.294 INFO:tasks.workunit.client.0.smithi063.stdout:0/470: dwrite d1/d3/d32/f51 [0,4194304] 0 2024-09-17T01:56:28.295 INFO:tasks.workunit.client.0.smithi063.stdout:8/424: write d1/d7/d28/d2a/d4d/f7c [100703,127524] 0 2024-09-17T01:56:28.295 INFO:tasks.workunit.client.0.smithi063.stdout:0/471: chown d1/d3/d32 937916 1 2024-09-17T01:56:28.295 INFO:tasks.workunit.client.0.smithi063.stdout:2/422: getdents d3/d7/df/d30 0 2024-09-17T01:56:28.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/417: dread d9/de/f2f [4194304,4194304] 0 2024-09-17T01:56:28.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/535: dread de/d2d/f33 [0,4194304] 0 2024-09-17T01:56:28.301 INFO:tasks.workunit.client.0.smithi063.stdout:2/423: dread d3/d7/df/d68/f35 [0,4194304] 0 2024-09-17T01:56:28.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/536: creat de/d17/d36/d70/d77/fa5 x:0 0 0 2024-09-17T01:56:28.303 INFO:tasks.workunit.client.0.smithi063.stdout:1/573: dwrite d0/d2d/fc2 [0,4194304] 0 2024-09-17T01:56:28.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/394: dread d2/d15/d2f/f64 [0,4194304] 0 2024-09-17T01:56:28.303 INFO:tasks.workunit.client.0.smithi063.stdout:2/424: write d3/d7/d76/f77 [235928,32825] 0 2024-09-17T01:56:28.303 INFO:tasks.workunit.client.0.smithi063.stdout:0/472: dwrite d1/d3/db/d18/d33/f71 [0,4194304] 0 2024-09-17T01:56:28.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/395: read - d2/d15/f6b zero size 2024-09-17T01:56:28.304 INFO:tasks.workunit.client.0.smithi063.stdout:1/574: stat d0/d2d/d35/d8c/d97 0 2024-09-17T01:56:28.304 INFO:tasks.workunit.client.0.smithi063.stdout:7/396: fsync d2/fd 0 2024-09-17T01:56:28.305 INFO:tasks.workunit.client.0.smithi063.stdout:0/473: chown d1/d1d/d74/d9a 65569603 1 2024-09-17T01:56:28.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/537: mkdir de/d17/d36/d70/d77/d90/da6 0 2024-09-17T01:56:28.308 INFO:tasks.workunit.client.0.smithi063.stdout:2/425: write d3/d7/df/d68/f35 [1953288,100931] 0 2024-09-17T01:56:28.309 INFO:tasks.workunit.client.0.smithi063.stdout:7/397: creat d2/d3/d27/d33/f81 x:0 0 0 2024-09-17T01:56:28.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/538: symlink de/d17/d1b/d67/la7 0 2024-09-17T01:56:28.311 INFO:tasks.workunit.client.0.smithi063.stdout:1/575: dwrite d0/f2 [0,4194304] 0 2024-09-17T01:56:28.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/539: symlink de/d2d/d52/d9c/la8 0 2024-09-17T01:56:28.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/576: creat d0/d2d/d5e/d7e/fc6 x:0 0 0 2024-09-17T01:56:28.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/577: fdatasync d0/d2d/d35/d3f/d81/f45 0 2024-09-17T01:56:28.314 INFO:tasks.workunit.client.0.smithi063.stdout:7/398: dwrite d2/f7d [0,4194304] 0 2024-09-17T01:56:28.315 INFO:tasks.workunit.client.0.smithi063.stdout:4/540: truncate de/d2d/d52/f5f 1494303 0 2024-09-17T01:56:28.316 INFO:tasks.workunit.client.0.smithi063.stdout:7/399: write d2/d3/d27/d39/f4b [4178983,95803] 0 2024-09-17T01:56:28.316 INFO:tasks.workunit.client.0.smithi063.stdout:4/541: creat de/d17/d36/d70/fa9 x:0 0 0 2024-09-17T01:56:28.317 INFO:tasks.workunit.client.0.smithi063.stdout:7/400: fsync d2/d3/d67/f7c 0 2024-09-17T01:56:28.317 INFO:tasks.workunit.client.0.smithi063.stdout:7/401: fdatasync d2/fd 0 2024-09-17T01:56:28.318 INFO:tasks.workunit.client.0.smithi063.stdout:0/474: truncate d1/d3/db/d18/f5b 1067733 0 2024-09-17T01:56:28.318 INFO:tasks.workunit.client.0.smithi063.stdout:1/578: dread d0/d2d/d35/d3f/d81/f3e [0,4194304] 0 2024-09-17T01:56:28.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/402: mkdir d2/d15/d2f/d45/d82 0 2024-09-17T01:56:28.320 INFO:tasks.workunit.client.0.smithi063.stdout:1/579: creat d0/d2d/d35/d6f/db7/fc7 x:0 0 0 2024-09-17T01:56:28.320 INFO:tasks.workunit.client.0.smithi063.stdout:2/426: read d3/d7/df/d68/f51 [3428389,122723] 0 2024-09-17T01:56:28.321 INFO:tasks.workunit.client.0.smithi063.stdout:7/403: getdents d2/d3/d7e 0 2024-09-17T01:56:28.321 INFO:tasks.workunit.client.0.smithi063.stdout:1/580: mknod d0/d1c/cc8 0 2024-09-17T01:56:28.321 INFO:tasks.workunit.client.0.smithi063.stdout:7/404: creat d2/d3/d22/d3a/f83 x:0 0 0 2024-09-17T01:56:28.322 INFO:tasks.workunit.client.0.smithi063.stdout:1/581: symlink d0/d2d/d35/d9d/lc9 0 2024-09-17T01:56:28.324 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:28.324 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:28.326 INFO:tasks.workunit.client.0.smithi063.stdout:2/427: dwrite d3/f6e [0,4194304] 0 2024-09-17T01:56:28.327 INFO:tasks.workunit.client.0.smithi063.stdout:2/428: chown d3/d7/df/l17 73846 1 2024-09-17T01:56:28.327 INFO:tasks.workunit.client.0.smithi063.stdout:1/582: dread d0/d2d/f37 [0,4194304] 0 2024-09-17T01:56:28.328 INFO:tasks.workunit.client.0.smithi063.stdout:2/429: write d3/f9 [9062434,86175] 0 2024-09-17T01:56:28.328 INFO:tasks.workunit.client.0.smithi063.stdout:2/430: write d3/d7/df/f2f [1417414,56730] 0 2024-09-17T01:56:28.329 INFO:tasks.workunit.client.0.smithi063.stdout:2/431: mknod d3/d7/df/c7b 0 2024-09-17T01:56:28.330 INFO:tasks.workunit.client.0.smithi063.stdout:2/432: unlink d3/d7/df/d5a/l60 0 2024-09-17T01:56:28.331 INFO:tasks.workunit.client.0.smithi063.stdout:2/433: rename d3/l57 to d3/d7/df/d43/l7c 0 2024-09-17T01:56:28.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/583: dwrite d0/f20 [0,4194304] 0 2024-09-17T01:56:28.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/405: read d2/d3/d27/d39/f46 [4405875,121551] 0 2024-09-17T01:56:28.337 INFO:tasks.workunit.client.0.smithi063.stdout:1/584: getdents d0/d2d/d35/d3f 0 2024-09-17T01:56:28.337 INFO:tasks.workunit.client.0.smithi063.stdout:7/406: write d2/d3/d27/d39/f3c [3408128,30251] 0 2024-09-17T01:56:28.337 INFO:tasks.workunit.client.0.smithi063.stdout:8/425: dread d1/d7/f4c [0,4194304] 0 2024-09-17T01:56:28.337 INFO:tasks.workunit.client.0.smithi063.stdout:7/407: readlink d2/d15/l3b 0 2024-09-17T01:56:28.337 INFO:tasks.workunit.client.0.smithi063.stdout:8/426: stat d1/d27/f64 0 2024-09-17T01:56:28.338 INFO:tasks.workunit.client.0.smithi063.stdout:7/408: chown d2/d15/d2f/d45/d48/l4d 0 1 2024-09-17T01:56:28.338 INFO:tasks.workunit.client.0.smithi063.stdout:7/409: readlink d2/d3/d22/l2e 0 2024-09-17T01:56:28.340 INFO:tasks.workunit.client.0.smithi063.stdout:8/427: rmdir d1/d7/d28/d2a/d37/d6c 0 2024-09-17T01:56:28.343 INFO:tasks.workunit.client.0.smithi063.stdout:8/428: creat d1/d27/d82/f88 x:0 0 0 2024-09-17T01:56:28.345 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:28.345 INFO:tasks.workunit.client.0.smithi063.stdout:8/429: read - d1/f5c zero size 2024-09-17T01:56:28.346 INFO:tasks.workunit.client.0.smithi063.stdout:7/410: dwrite d2/d3/d27/f32 [0,4194304] 0 2024-09-17T01:56:28.346 INFO:tasks.workunit.client.0.smithi063.stdout:5/534: sync 2024-09-17T01:56:28.346 INFO:tasks.workunit.client.0.smithi063.stdout:9/418: sync 2024-09-17T01:56:28.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/497: sync 2024-09-17T01:56:28.346 INFO:tasks.workunit.client.0.smithi063.stdout:6/506: sync 2024-09-17T01:56:28.347 INFO:tasks.workunit.client.0.smithi063.stdout:0/475: sync 2024-09-17T01:56:28.347 INFO:tasks.workunit.client.0.smithi063.stdout:8/430: truncate d1/d27/d82/f88 638765 0 2024-09-17T01:56:28.347 INFO:tasks.workunit.client.0.smithi063.stdout:7/411: stat d2/d3/d67/l72 0 2024-09-17T01:56:28.349 INFO:tasks.workunit.client.0.smithi063.stdout:9/419: creat d9/de/d20/d37/d42/f93 x:0 0 0 2024-09-17T01:56:28.349 INFO:tasks.workunit.client.0.smithi063.stdout:7/412: chown d2/d3/l26 38 1 2024-09-17T01:56:28.350 INFO:tasks.workunit.client.0.smithi063.stdout:6/507: chown dc/d14/d19/d20/c76 7421 1 2024-09-17T01:56:28.351 INFO:tasks.workunit.client.0.smithi063.stdout:1/585: dwrite d0/d2d/d35/d3f/f68 [0,4194304] 0 2024-09-17T01:56:28.351 INFO:tasks.workunit.client.0.smithi063.stdout:4/542: dread de/d17/d36/d70/d77/d90/f91 [0,4194304] 0 2024-09-17T01:56:28.351 INFO:tasks.workunit.client.0.smithi063.stdout:8/431: rename d1/d7/d28/d2f to d1/d7/d28/d89 0 2024-09-17T01:56:28.351 INFO:tasks.workunit.client.0.smithi063.stdout:7/413: mkdir d2/d15/d2f/d45/d84 0 2024-09-17T01:56:28.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/420: symlink d9/d8d/d2a/d40/l94 0 2024-09-17T01:56:28.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/508: fdatasync dc/d14/d2f/f5b 0 2024-09-17T01:56:28.355 INFO:tasks.workunit.client.0.smithi063.stdout:0/476: dwrite d1/d3/db/d18/d43/f7e [0,4194304] 0 2024-09-17T01:56:28.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/535: getdents d6/d37/d19/d50/d98 0 2024-09-17T01:56:28.358 INFO:tasks.workunit.client.0.smithi063.stdout:9/421: chown d9/de/d20/d1b/d25/c41 115 1 2024-09-17T01:56:28.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/414: write d2/d15/d2f/d45/f69 [1007791,96431] 0 2024-09-17T01:56:28.359 INFO:tasks.workunit.client.0.smithi063.stdout:8/432: dread d1/d7/f4c [0,4194304] 0 2024-09-17T01:56:28.360 INFO:tasks.workunit.client.0.smithi063.stdout:1/586: truncate d0/d1c/f28 6332868 0 2024-09-17T01:56:28.361 INFO:tasks.workunit.client.0.smithi063.stdout:9/422: creat d9/de/d20/d1b/f95 x:0 0 0 2024-09-17T01:56:28.361 INFO:tasks.workunit.client.0.smithi063.stdout:5/536: write d6/d23/d29/d2b/d31/f33 [451912,103983] 0 2024-09-17T01:56:28.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/543: creat de/d17/d1b/faa x:0 0 0 2024-09-17T01:56:28.361 INFO:tasks.workunit.client.0.smithi063.stdout:1/587: mkdir d0/d93/d9e/dca 0 2024-09-17T01:56:28.362 INFO:tasks.workunit.client.0.smithi063.stdout:1/588: write d0/d1c/f96 [2727228,121276] 0 2024-09-17T01:56:28.363 INFO:tasks.workunit.client.0.smithi063.stdout:9/423: chown d9/d8d/c21 2752 1 2024-09-17T01:56:28.364 INFO:tasks.workunit.client.0.smithi063.stdout:6/509: getdents dc/d14/d19/d20/d66 0 2024-09-17T01:56:28.365 INFO:tasks.workunit.client.0.smithi063.stdout:9/424: stat d9/de/d20/d37/f61 0 2024-09-17T01:56:28.365 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:56:28.366 INFO:tasks.workunit.client.0.smithi063.stdout:5/537: fsync d6/d9/f28 0 2024-09-17T01:56:28.366 INFO:tasks.workunit.client.0.smithi063.stdout:1/589: unlink d0/d2d/d35/d3f/f7b 0 2024-09-17T01:56:28.366 INFO:tasks.workunit.client.0.smithi063.stdout:8/433: link d1/d7/d28/d2a/d53/l80 d1/d7/d28/d2a/d37/d3a/l8a 0 2024-09-17T01:56:28.367 INFO:tasks.workunit.client.0.smithi063.stdout:6/510: mknod dc/d14/d19/d20/ca2 0 2024-09-17T01:56:28.367 INFO:tasks.workunit.client.0.smithi063.stdout:5/538: mkdir d6/d23/d3f/dac 0 2024-09-17T01:56:28.367 INFO:tasks.workunit.client.0.smithi063.stdout:8/434: chown d1/d27/d82 31 1 2024-09-17T01:56:28.367 INFO:tasks.workunit.client.0.smithi063.stdout:6/511: chown dc/d14/d19/f82 0 1 2024-09-17T01:56:28.369 INFO:tasks.workunit.client.0.smithi063.stdout:4/544: dwrite de/d2d/d3c/f87 [0,4194304] 0 2024-09-17T01:56:28.369 INFO:tasks.workunit.client.0.smithi063.stdout:6/512: mknod dc/d14/d19/d20/d32/d52/d5a/ca3 0 2024-09-17T01:56:28.370 INFO:tasks.workunit.client.0.smithi063.stdout:3/498: dread fe [0,4194304] 0 2024-09-17T01:56:28.371 INFO:tasks.workunit.client.0.smithi063.stdout:4/545: chown de/d17/d1b/d67/d28/c42 109441 1 2024-09-17T01:56:28.372 INFO:tasks.workunit.client.0.smithi063.stdout:8/435: getdents d1/d7/d28/d2a 0 2024-09-17T01:56:28.373 INFO:tasks.workunit.client.0.smithi063.stdout:2/434: dread d3/d7/df/d68/f46 [0,4194304] 0 2024-09-17T01:56:28.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/546: link de/d17/d1b/d67/la2 de/d17/d1b/d67/d28/d8d/lab 0 2024-09-17T01:56:28.375 INFO:tasks.workunit.client.0.smithi063.stdout:8/436: creat d1/d7/d28/d89/d41/d49/f8b x:0 0 0 2024-09-17T01:56:28.375 INFO:tasks.workunit.client.0.smithi063.stdout:4/547: write de/d2d/d52/f84 [242977,68468] 0 2024-09-17T01:56:28.375 INFO:tasks.workunit.client.0.smithi063.stdout:5/539: dwrite d6/d23/d29/d36/f5e [0,4194304] 0 2024-09-17T01:56:28.376 INFO:tasks.workunit.client.0.smithi063.stdout:8/437: symlink d1/d7/d28/d89/d62/l8c 0 2024-09-17T01:56:28.376 INFO:tasks.workunit.client.0.smithi063.stdout:4/548: chown de/d17/d1b/d67/f60 131 1 2024-09-17T01:56:28.377 INFO:tasks.workunit.client.0.smithi063.stdout:5/540: creat d6/d37/d19/d68/fad x:0 0 0 2024-09-17T01:56:28.377 INFO:tasks.workunit.client.0.smithi063.stdout:5/541: write d6/f44 [4321838,111477] 0 2024-09-17T01:56:28.378 INFO:tasks.workunit.client.0.smithi063.stdout:4/549: unlink de/c49 0 2024-09-17T01:56:28.378 INFO:tasks.workunit.client.0.smithi063.stdout:8/438: link d1/d7/d28/f45 d1/d7/d28/d2a/f8d 0 2024-09-17T01:56:28.379 INFO:tasks.workunit.client.0.smithi063.stdout:8/439: chown d1/l3 206632 1 2024-09-17T01:56:28.380 INFO:tasks.workunit.client.0.smithi063.stdout:7/415: truncate d2/d3/d27/f32 3526186 0 2024-09-17T01:56:28.380 INFO:tasks.workunit.client.0.smithi063.stdout:6/513: getdents dc/d14/d19/d20 0 2024-09-17T01:56:28.381 INFO:tasks.workunit.client.0.smithi063.stdout:4/550: mknod de/d2d/d52/d9c/cac 0 2024-09-17T01:56:28.381 INFO:tasks.workunit.client.0.smithi063.stdout:7/416: fsync d2/d3/d67/f10 0 2024-09-17T01:56:28.382 INFO:tasks.workunit.client.0.smithi063.stdout:6/514: chown dc/d14/d19/d20/d66 1000771 1 2024-09-17T01:56:28.382 INFO:tasks.workunit.client.0.smithi063.stdout:8/440: fsync d1/d7/d1d/f40 0 2024-09-17T01:56:28.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/435: dwrite d3/d7/d76/f77 [0,4194304] 0 2024-09-17T01:56:28.385 INFO:tasks.workunit.client.0.smithi063.stdout:5/542: dread d6/d23/f58 [0,4194304] 0 2024-09-17T01:56:28.385 INFO:tasks.workunit.client.0.smithi063.stdout:7/417: mknod d2/d3/d17/d25/c85 0 2024-09-17T01:56:28.385 INFO:tasks.workunit.client.0.smithi063.stdout:5/543: chown d6/d9/d13/d1d/l4d 10628712 1 2024-09-17T01:56:28.386 INFO:tasks.workunit.client.0.smithi063.stdout:2/436: write d3/d7/df/f1e [1664660,103826] 0 2024-09-17T01:56:28.386 INFO:tasks.workunit.client.0.smithi063.stdout:6/515: creat dc/d14/d19/d20/d32/d68/d9c/fa4 x:0 0 0 2024-09-17T01:56:28.386 INFO:tasks.workunit.client.0.smithi063.stdout:7/418: symlink d2/d15/d2f/d52/l86 0 2024-09-17T01:56:28.386 INFO:tasks.workunit.client.0.smithi063.stdout:5/544: rmdir d6 39 2024-09-17T01:56:28.386 INFO:tasks.workunit.client.0.smithi063.stdout:4/551: getdents de/d17/d1b/d67/d28/d8b 0 2024-09-17T01:56:28.387 INFO:tasks.workunit.client.0.smithi063.stdout:6/516: creat dc/d14/d65/fa5 x:0 0 0 2024-09-17T01:56:28.387 INFO:tasks.workunit.client.0.smithi063.stdout:2/437: read d3/d7/d38/f45 [291264,44963] 0 2024-09-17T01:56:28.387 INFO:tasks.workunit.client.0.smithi063.stdout:5/545: dread - d6/d23/d29/d2b/fa2 zero size 2024-09-17T01:56:28.388 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:28.393+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:28.390 INFO:tasks.workunit.client.0.smithi063.stdout:1/590: dwrite d0/d2d/d35/d3f/d94/fbf [0,4194304] 0 2024-09-17T01:56:28.391 INFO:tasks.workunit.client.0.smithi063.stdout:6/517: mknod dc/d14/d2f/ca6 0 2024-09-17T01:56:28.391 INFO:tasks.workunit.client.0.smithi063.stdout:7/419: creat d2/d15/d2f/d45/d84/f87 x:0 0 0 2024-09-17T01:56:28.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/552: truncate de/d2d/d52/f5f 992764 0 2024-09-17T01:56:28.392 INFO:tasks.workunit.client.0.smithi063.stdout:2/438: rename d3/d7/df/c7b to d3/d7/df/d68/c7d 0 2024-09-17T01:56:28.392 INFO:tasks.workunit.client.0.smithi063.stdout:3/499: dread df/d28/f48 [0,4194304] 0 2024-09-17T01:56:28.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/553: fsync de/d17/f68 0 2024-09-17T01:56:28.395 INFO:tasks.workunit.client.0.smithi063.stdout:3/500: mknod df/ca6 0 2024-09-17T01:56:28.398 INFO:tasks.workunit.client.0.smithi063.stdout:5/546: creat d6/d37/d19/d50/d92/fae x:0 0 0 2024-09-17T01:56:28.398 INFO:tasks.workunit.client.0.smithi063.stdout:1/591: mknod d0/d2d/d5e/dc5/ccb 0 2024-09-17T01:56:28.398 INFO:tasks.workunit.client.0.smithi063.stdout:3/501: rmdir df/d12/d3a/d7a 39 2024-09-17T01:56:28.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/420: dwrite d2/f7 [0,4194304] 0 2024-09-17T01:56:28.402 INFO:tasks.workunit.client.0.smithi063.stdout:3/502: dread - df/d12/d3a/fa0 zero size 2024-09-17T01:56:28.404 INFO:tasks.workunit.client.0.smithi063.stdout:1/592: chown d0/d2d/d35/d3f/d4e/f83 3 1 2024-09-17T01:56:28.405 INFO:tasks.workunit.client.0.smithi063.stdout:4/554: dwrite de/d17/d36/f5b [0,4194304] 0 2024-09-17T01:56:28.405 INFO:tasks.workunit.client.0.smithi063.stdout:6/518: dwrite dc/d14/d19/d20/d32/d68/f6c [0,4194304] 0 2024-09-17T01:56:28.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/421: creat d2/d3/d22/d3a/f88 x:0 0 0 2024-09-17T01:56:28.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/439: dwrite d3/d7/d38/f65 [0,4194304] 0 2024-09-17T01:56:28.406 INFO:tasks.workunit.client.0.smithi063.stdout:8/441: dwrite d1/d7/d28/d2a/d53/f55 [0,4194304] 0 2024-09-17T01:56:28.407 INFO:tasks.workunit.client.0.smithi063.stdout:6/519: fdatasync dc/d14/d18/d74/f9d 0 2024-09-17T01:56:28.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/440: chown d3/d7/df/f71 2 1 2024-09-17T01:56:28.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/503: symlink df/d83/la7 0 2024-09-17T01:56:28.408 INFO:tasks.workunit.client.0.smithi063.stdout:2/441: stat d3/d7/d38/f61 0 2024-09-17T01:56:28.408 INFO:tasks.workunit.client.0.smithi063.stdout:7/422: mknod d2/d3/d27/d65/c89 0 2024-09-17T01:56:28.409 INFO:tasks.workunit.client.0.smithi063.stdout:3/504: rmdir df/d28 39 2024-09-17T01:56:28.409 INFO:tasks.workunit.client.0.smithi063.stdout:2/442: fsync d3/f44 0 2024-09-17T01:56:28.409 INFO:tasks.workunit.client.0.smithi063.stdout:3/505: write df/d12/d1e/d39/f95 [739466,59113] 0 2024-09-17T01:56:28.409 INFO:tasks.workunit.client.0.smithi063.stdout:7/423: getdents d2/d3/d17 0 2024-09-17T01:56:28.410 INFO:tasks.workunit.client.0.smithi063.stdout:2/443: read d3/d2a/f3d [441838,129697] 0 2024-09-17T01:56:28.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/506: mknod df/d12/d2d/d2f/ca8 0 2024-09-17T01:56:28.411 INFO:tasks.workunit.client.0.smithi063.stdout:7/424: chown d2/d3/d27/d39/l57 145920 1 2024-09-17T01:56:28.411 INFO:tasks.workunit.client.0.smithi063.stdout:2/444: symlink d3/d7/df/d30/l7e 0 2024-09-17T01:56:28.412 INFO:tasks.workunit.client.0.smithi063.stdout:3/507: dread df/f49 [0,4194304] 0 2024-09-17T01:56:28.412 INFO:tasks.workunit.client.0.smithi063.stdout:2/445: write d3/d2a/f3d [1054041,21571] 0 2024-09-17T01:56:28.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/508: creat df/d12/d43/d50/d87/fa9 x:0 0 0 2024-09-17T01:56:28.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/509: chown df/d12/d1e/d39/f6c 1 1 2024-09-17T01:56:28.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/425: sync 2024-09-17T01:56:28.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/510: mkdir df/d12/d43/d50/d58/d97/daa 0 2024-09-17T01:56:28.417 INFO:tasks.workunit.client.0.smithi063.stdout:9/426: write d9/d8d/d2a/d36/f6f [2079213,87386] 0 2024-09-17T01:56:28.417 INFO:tasks.workunit.client.0.smithi063.stdout:7/425: dwrite d2/d3/d22/d3a/f83 [0,4194304] 0 2024-09-17T01:56:28.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/511: unlink df/d12/d1e/d39/f95 0 2024-09-17T01:56:28.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/427: creat d9/de/d20/d1b/d25/d73/f96 x:0 0 0 2024-09-17T01:56:28.419 INFO:tasks.workunit.client.0.smithi063.stdout:9/428: symlink d9/de/d20/d1b/l97 0 2024-09-17T01:56:28.419 INFO:tasks.workunit.client.0.smithi063.stdout:9/429: mknod d9/d27/c98 0 2024-09-17T01:56:28.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/430: readlink d9/de/d33/l4b 0 2024-09-17T01:56:28.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/431: mknod d9/de/d20/d37/d42/c99 0 2024-09-17T01:56:28.423 INFO:tasks.workunit.client.0.smithi063.stdout:9/432: fsync d9/d8d/d2a/f53 0 2024-09-17T01:56:28.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/433: symlink d9/de/d20/d37/d42/l9a 0 2024-09-17T01:56:28.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/434: write d9/d27/f7d [790014,81973] 0 2024-09-17T01:56:28.425 INFO:tasks.workunit.client.0.smithi063.stdout:0/477: dread d1/f19 [4194304,4194304] 0 2024-09-17T01:56:28.426 INFO:tasks.workunit.client.0.smithi063.stdout:9/435: dread - d9/f56 zero size 2024-09-17T01:56:28.427 INFO:tasks.workunit.client.0.smithi063.stdout:5/547: truncate d6/f74 1682920 0 2024-09-17T01:56:28.427 INFO:tasks.workunit.client.0.smithi063.stdout:8/442: write d1/f16 [5933106,90297] 0 2024-09-17T01:56:28.427 INFO:tasks.workunit.client.0.smithi063.stdout:9/436: write d9/f74 [328839,13620] 0 2024-09-17T01:56:28.427 INFO:tasks.workunit.client.0.smithi063.stdout:4/555: write de/d17/d1b/d67/f55 [1345241,92039] 0 2024-09-17T01:56:28.428 INFO:tasks.workunit.client.0.smithi063.stdout:5/548: write d6/d37/d79/f7c [1900224,53618] 0 2024-09-17T01:56:28.432 INFO:tasks.workunit.client.0.smithi063.stdout:1/593: truncate d0/d1c/f96 3000316 0 2024-09-17T01:56:28.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/478: rename d1/d3/db/d18/d43/f60 to d1/d44/d53/d62/f9d 0 2024-09-17T01:56:28.432 INFO:tasks.workunit.client.0.smithi063.stdout:4/556: creat de/d17/d36/d70/d77/d90/d9a/fad x:0 0 0 2024-09-17T01:56:28.432 INFO:tasks.workunit.client.0.smithi063.stdout:5/549: symlink d6/d37/d19/d50/d98/da0/laf 0 2024-09-17T01:56:28.433 INFO:tasks.workunit.client.0.smithi063.stdout:1/594: write d0/f4 [1277195,31214] 0 2024-09-17T01:56:28.433 INFO:tasks.workunit.client.0.smithi063.stdout:4/557: chown de/d2d/d3c 109316 1 2024-09-17T01:56:28.433 INFO:tasks.workunit.client.0.smithi063.stdout:5/550: readlink d6/d23/d29/d2b/d31/l94 0 2024-09-17T01:56:28.434 INFO:tasks.workunit.client.0.smithi063.stdout:0/479: rename d1/d3/db/c17 to d1/d3/db/d4b/d82/c9e 0 2024-09-17T01:56:28.434 INFO:tasks.workunit.client.0.smithi063.stdout:5/551: readlink d6/d35/l5f 0 2024-09-17T01:56:28.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/437: read d9/de/d20/d1b/f1f [2465025,11255] 0 2024-09-17T01:56:28.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/480: write d1/d3/db/d18/d33/f2e [2002945,81707] 0 2024-09-17T01:56:28.435 INFO:tasks.workunit.client.0.smithi063.stdout:9/438: fsync d9/d8d/d2a/d36/f84 0 2024-09-17T01:56:28.436 INFO:tasks.workunit.client.0.smithi063.stdout:8/443: dwrite d1/d7/d1d/f5f [0,4194304] 0 2024-09-17T01:56:28.437 INFO:tasks.workunit.client.0.smithi063.stdout:8/444: dread - d1/d7/d1d/f7f zero size 2024-09-17T01:56:28.437 INFO:tasks.workunit.client.0.smithi063.stdout:9/439: chown d9/de/d20/d37/f58 7 1 2024-09-17T01:56:28.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/481: creat d1/d3/d1b/f9f x:0 0 0 2024-09-17T01:56:28.438 INFO:tasks.workunit.client.0.smithi063.stdout:0/482: write d1/f1e [1620979,59524] 0 2024-09-17T01:56:28.443 INFO:tasks.workunit.client.0.smithi063.stdout:0/483: getdents d1/d3 0 2024-09-17T01:56:28.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/440: rename d9/de/d20/d37/d42/c8f to d9/de/d20/d37/d42/d7f/c9b 0 2024-09-17T01:56:28.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/484: fsync d1/d3/db/f39 0 2024-09-17T01:56:28.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/441: creat d9/de/d20/d1b/f9c x:0 0 0 2024-09-17T01:56:28.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/552: dwrite d6/f12 [8388608,4194304] 0 2024-09-17T01:56:28.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/558: write de/d17/d1b/f32 [663334,64920] 0 2024-09-17T01:56:28.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/442: creat d9/d8d/d2a/d36/f9d x:0 0 0 2024-09-17T01:56:28.447 INFO:tasks.workunit.client.0.smithi063.stdout:0/485: fsync d1/d3/db/d18/d33/f67 0 2024-09-17T01:56:28.448 INFO:tasks.workunit.client.0.smithi063.stdout:4/559: unlink de/d2d/f33 0 2024-09-17T01:56:28.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/443: creat d9/de/d20/d37/f9e x:0 0 0 2024-09-17T01:56:28.451 INFO:tasks.workunit.client.0.smithi063.stdout:0/486: mknod d1/d3/d1b/d50/d6c/ca0 0 2024-09-17T01:56:28.451 INFO:tasks.workunit.client.0.smithi063.stdout:0/487: readlink d1/lc 0 2024-09-17T01:56:28.451 INFO:tasks.workunit.client.0.smithi063.stdout:5/553: truncate d6/d9/d13/d1d/f55 786922 0 2024-09-17T01:56:28.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/444: symlink d9/de/d33/l9f 0 2024-09-17T01:56:28.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/445: dwrite d1/d7/d28/d2a/d53/f55 [0,4194304] 0 2024-09-17T01:56:28.452 INFO:tasks.workunit.client.0.smithi063.stdout:4/560: chown de/d17/f23 2781708 1 2024-09-17T01:56:28.452 INFO:tasks.workunit.client.0.smithi063.stdout:4/561: fsync de/f10 0 2024-09-17T01:56:28.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/554: link d6/d23/d29/d2b/d31/l53 d6/d23/d69/lb0 0 2024-09-17T01:56:28.452 INFO:tasks.workunit.client.0.smithi063.stdout:0/488: link d1/d3/db/d4b/d82/l87 d1/d44/la1 0 2024-09-17T01:56:28.453 INFO:tasks.workunit.client.0.smithi063.stdout:8/446: creat d1/d7/d28/d87/f8e x:0 0 0 2024-09-17T01:56:28.453 INFO:tasks.workunit.client.0.smithi063.stdout:1/595: dread d0/d2d/d35/d3f/d81/d50/f70 [0,4194304] 0 2024-09-17T01:56:28.454 INFO:tasks.workunit.client.0.smithi063.stdout:5/555: write d6/d37/d19/f2c [2873304,58952] 0 2024-09-17T01:56:28.455 INFO:tasks.workunit.client.0.smithi063.stdout:4/562: link de/d17/d1b/d67/f60 de/d17/d1b/d9e/fae 0 2024-09-17T01:56:28.455 INFO:tasks.workunit.client.0.smithi063.stdout:5/556: unlink d6/l22 0 2024-09-17T01:56:28.456 INFO:tasks.workunit.client.0.smithi063.stdout:0/489: creat d1/d3/db/d6e/fa2 x:0 0 0 2024-09-17T01:56:28.456 INFO:tasks.workunit.client.0.smithi063.stdout:8/447: getdents d1/d7/d28/d89/d62/d66 0 2024-09-17T01:56:28.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/596: creat d0/d93/d9e/dca/fcc x:0 0 0 2024-09-17T01:56:28.457 INFO:tasks.workunit.client.0.smithi063.stdout:5/557: creat d6/d23/d29/d2b/d31/fb1 x:0 0 0 2024-09-17T01:56:28.458 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:28.458 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:28.459 INFO:tasks.workunit.client.0.smithi063.stdout:9/445: dwrite d9/de/d20/d37/f50 [0,4194304] 0 2024-09-17T01:56:28.459 INFO:tasks.workunit.client.0.smithi063.stdout:0/490: rename d1/lc to d1/d3/db/d18/d33/la3 0 2024-09-17T01:56:28.459 INFO:tasks.workunit.client.0.smithi063.stdout:8/448: symlink d1/d7/d28/d89/d62/l8f 0 2024-09-17T01:56:28.459 INFO:tasks.workunit.client.0.smithi063.stdout:9/446: mknod d9/d27/ca0 0 2024-09-17T01:56:28.460 INFO:tasks.workunit.client.0.smithi063.stdout:0/491: creat d1/d3/db/d6e/fa4 x:0 0 0 2024-09-17T01:56:28.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/563: rename de/d17/d1b/d67/l9d to de/d17/d1b/d67/laf 0 2024-09-17T01:56:28.460 INFO:tasks.workunit.client.0.smithi063.stdout:8/449: dread - d1/d7/d28/d89/d41/d49/f63 zero size 2024-09-17T01:56:28.461 INFO:tasks.workunit.client.0.smithi063.stdout:0/492: write d1/d3/db/d18/d33/f2e [4032576,3818] 0 2024-09-17T01:56:28.461 INFO:tasks.workunit.client.0.smithi063.stdout:8/450: write d1/d7/f4c [7421390,52380] 0 2024-09-17T01:56:28.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/447: mknod d9/de/d20/d37/d42/d7f/ca1 0 2024-09-17T01:56:28.464 INFO:tasks.workunit.client.0.smithi063.stdout:9/448: mknod d9/d27/ca2 0 2024-09-17T01:56:28.465 INFO:tasks.workunit.client.0.smithi063.stdout:5/558: write d6/d9/f28 [2960524,81075] 0 2024-09-17T01:56:28.466 INFO:tasks.workunit.client.0.smithi063.stdout:5/559: readlink d6/d37/d19/l4b 0 2024-09-17T01:56:28.466 INFO:tasks.workunit.client.0.smithi063.stdout:5/560: creat d6/d23/d54/fb2 x:0 0 0 2024-09-17T01:56:28.468 INFO:tasks.workunit.client.0.smithi063.stdout:8/451: dread d1/d27/f64 [0,4194304] 0 2024-09-17T01:56:28.471 INFO:tasks.workunit.client.0.smithi063.stdout:4/564: dwrite de/d17/d1b/d9e/fae [0,4194304] 0 2024-09-17T01:56:28.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/565: stat de/d17/c93 0 2024-09-17T01:56:28.472 INFO:tasks.workunit.client.0.smithi063.stdout:8/452: getdents d1/d7/d28/d2a/d44/d6e 0 2024-09-17T01:56:28.474 INFO:tasks.workunit.client.0.smithi063.stdout:9/449: dwrite d9/d27/f7d [0,4194304] 0 2024-09-17T01:56:28.476 INFO:tasks.workunit.client.0.smithi063.stdout:8/453: symlink d1/d7/d28/d2a/d37/d3a/l90 0 2024-09-17T01:56:28.476 INFO:tasks.workunit.client.0.smithi063.stdout:8/454: stat d1/f5e 0 2024-09-17T01:56:28.476 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:28.477+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:28.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/561: dwrite d6/d23/d54/fb2 [0,4194304] 0 2024-09-17T01:56:28.477 INFO:tasks.workunit.client.0.smithi063.stdout:0/493: dread d1/d3/db/d4b/f66 [0,4194304] 0 2024-09-17T01:56:28.478 INFO:tasks.workunit.client.0.smithi063.stdout:5/562: write d6/d37/d19/f75 [564062,111618] 0 2024-09-17T01:56:28.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/455: symlink d1/l91 0 2024-09-17T01:56:28.479 INFO:tasks.workunit.client.0.smithi063.stdout:5/563: symlink d6/d23/d3f/dac/lb3 0 2024-09-17T01:56:28.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/494: mkdir d1/d1d/da5 0 2024-09-17T01:56:28.479 INFO:tasks.workunit.client.0.smithi063.stdout:8/456: dread - d1/d7/d28/d89/d41/f52 zero size 2024-09-17T01:56:28.481 INFO:tasks.workunit.client.0.smithi063.stdout:1/597: dread d0/d2d/d35/d3f/d94/fbb [0,4194304] 0 2024-09-17T01:56:28.481 INFO:tasks.workunit.client.0.smithi063.stdout:5/564: rename d6/d23/d3f/l7b to d6/d37/d19/d76/d8f/lb4 0 2024-09-17T01:56:28.482 INFO:tasks.workunit.client.0.smithi063.stdout:5/565: fdatasync d6/d23/d29/d36/f5b 0 2024-09-17T01:56:28.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/566: read - d6/d23/d29/d2b/fa2 zero size 2024-09-17T01:56:28.484 INFO:tasks.workunit.client.0.smithi063.stdout:9/450: dwrite d9/f6a [0,4194304] 0 2024-09-17T01:56:28.485 INFO:tasks.workunit.client.0.smithi063.stdout:9/451: rmdir d9/d8d/d2a/d36 39 2024-09-17T01:56:28.486 INFO:tasks.workunit.client.0.smithi063.stdout:1/598: dread d0/d2d/d35/d3f/d94/fbf [0,4194304] 0 2024-09-17T01:56:28.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/452: write d9/de/d20/d1b/f95 [787806,76717] 0 2024-09-17T01:56:28.487 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:28.487 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:28.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/453: creat d9/de/d20/fa3 x:0 0 0 2024-09-17T01:56:28.488 INFO:tasks.workunit.client.0.smithi063.stdout:1/599: fdatasync d0/f1b 0 2024-09-17T01:56:28.488 INFO:tasks.workunit.client.0.smithi063.stdout:4/566: truncate de/d2d/d3c/f87 1007550 0 2024-09-17T01:56:28.488 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:28.489 INFO:tasks.workunit.client.0.smithi063.stdout:9/454: stat d9/d27/ca2 0 2024-09-17T01:56:28.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/567: readlink de/d2d/d52/l82 0 2024-09-17T01:56:28.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/600: readlink d0/l82 0 2024-09-17T01:56:28.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/495: dwrite d1/d3/d1b/f65 [0,4194304] 0 2024-09-17T01:56:28.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/568: write de/f2f [3383517,64804] 0 2024-09-17T01:56:28.489 INFO:tasks.workunit.client.0.smithi063.stdout:9/455: mkdir d9/de/d20/d1b/d25/d73/da4 0 2024-09-17T01:56:28.490 INFO:tasks.workunit.client.0.smithi063.stdout:0/496: readlink d1/d1d/l61 0 2024-09-17T01:56:28.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/456: fdatasync d9/d8d/d2a/f3f 0 2024-09-17T01:56:28.491 INFO:tasks.workunit.client.0.smithi063.stdout:0/497: rename d1 to d1/d3/d10/da6 22 2024-09-17T01:56:28.491 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:28.492 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:28.492 INFO:tasks.workunit.client.0.smithi063.stdout:0/498: creat d1/d3/db/fa7 x:0 0 0 2024-09-17T01:56:28.492 INFO:tasks.workunit.client.0.smithi063.stdout:9/457: truncate d9/de/d20/d37/f61 91624 0 2024-09-17T01:56:28.495 INFO:tasks.workunit.client.0.smithi063.stdout:1/601: dwrite d0/d2d/f7a [0,4194304] 0 2024-09-17T01:56:28.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/602: symlink d0/d2d/d35/d3f/d81/d50/d8b/db3/lcd 0 2024-09-17T01:56:28.498 INFO:tasks.workunit.client.0.smithi063.stdout:1/603: dread - d0/d2d/d35/d3f/d6b/f80 zero size 2024-09-17T01:56:28.499 INFO:tasks.workunit.client.0.smithi063.stdout:1/604: unlink d0/d2d/d35/d3f/d4e/f84 0 2024-09-17T01:56:28.499 INFO:tasks.workunit.client.0.smithi063.stdout:4/569: dread de/d17/d1b/d67/d28/d30/f7b [0,4194304] 0 2024-09-17T01:56:28.501 INFO:tasks.workunit.client.0.smithi063.stdout:1/605: write d0/d2d/d35/d3f/d6b/f80 [96519,90625] 0 2024-09-17T01:56:28.501 INFO:tasks.workunit.client.0.smithi063.stdout:4/570: write de/f4c [3171690,97764] 0 2024-09-17T01:56:28.501 INFO:tasks.workunit.client.0.smithi063.stdout:1/606: mkdir d0/d2d/d35/d3f/d81/dce 0 2024-09-17T01:56:28.502 INFO:tasks.workunit.client.0.smithi063.stdout:1/607: unlink d0/d2d/f7a 0 2024-09-17T01:56:28.502 INFO:tasks.workunit.client.0.smithi063.stdout:1/608: rename d0/d93/d9e/dca to d0/d93/d9e/dca/dcf 22 2024-09-17T01:56:28.504 INFO:tasks.workunit.client.0.smithi063.stdout:1/609: rename d0/d2d/d35/d3f/f68 to d0/d2d/d35/d6f/db7/fd0 0 2024-09-17T01:56:28.505 INFO:tasks.workunit.client.0.smithi063.stdout:1/610: chown d0/d2d/d35/d6f/lb6 955 1 2024-09-17T01:56:28.506 INFO:tasks.workunit.client.0.smithi063.stdout:4/571: dwrite de/d2d/f64 [0,4194304] 0 2024-09-17T01:56:28.515 INFO:tasks.workunit.client.0.smithi063.stdout:4/572: truncate de/f14 1204451 0 2024-09-17T01:56:28.516 INFO:tasks.workunit.client.0.smithi063.stdout:4/573: creat de/d17/d1b/d67/d28/d8d/fb0 x:0 0 0 2024-09-17T01:56:28.517 INFO:tasks.workunit.client.0.smithi063.stdout:4/574: symlink de/d17/d1b/d67/d28/d30/lb1 0 2024-09-17T01:56:28.518 INFO:tasks.workunit.client.0.smithi063.stdout:4/575: fsync de/d17/d1b/d67/f9f 0 2024-09-17T01:56:28.519 INFO:tasks.workunit.client.0.smithi063.stdout:4/576: write de/d2d/d52/f5f [1605645,72423] 0 2024-09-17T01:56:28.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/457: dread d1/d7/d28/d89/d41/d49/f33 [4194304,4194304] 0 2024-09-17T01:56:28.520 INFO:tasks.workunit.client.0.smithi063.stdout:4/577: dread - de/d17/d36/d70/d77/fa5 zero size 2024-09-17T01:56:28.521 INFO:tasks.workunit.client.0.smithi063.stdout:0/499: dread d1/d3/db/d4b/f1c [0,4194304] 0 2024-09-17T01:56:28.521 INFO:tasks.workunit.client.0.smithi063.stdout:0/500: readlink d1/d3/d1b/l2b 0 2024-09-17T01:56:28.522 INFO:tasks.workunit.client.0.smithi063.stdout:4/578: link de/d17/d1b/d67/d28/d30/f61 de/fb2 0 2024-09-17T01:56:28.523 INFO:tasks.workunit.client.0.smithi063.stdout:9/458: dread d9/d8d/d2a/f53 [0,4194304] 0 2024-09-17T01:56:28.525 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:28.525 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:28.525 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:28.525 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:28.525 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:28.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/459: rename d9/de/d20/d37/d42/d7f/c9b to d9/de/d20/d32/ca5 0 2024-09-17T01:56:28.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/460: readlink d9/d8d/d2a/d40/l5a 0 2024-09-17T01:56:28.529 INFO:tasks.workunit.client.0.smithi063.stdout:0/501: dwrite d1/d3/d10/f5a [0,4194304] 0 2024-09-17T01:56:28.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/579: dwrite de/d17/d1b/d67/f9f [0,4194304] 0 2024-09-17T01:56:28.531 INFO:tasks.workunit.client.0.smithi063.stdout:8/458: dwrite d1/d7/d28/d89/d41/d49/f1b [0,4194304] 0 2024-09-17T01:56:28.532 INFO:tasks.workunit.client.0.smithi063.stdout:8/459: chown d1/d7/d28/d2a/d37/f78 32165208 1 2024-09-17T01:56:28.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/502: mkdir d1/d3/db/d18/d85/da8 0 2024-09-17T01:56:28.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/460: symlink d1/d27/d81/l92 0 2024-09-17T01:56:28.534 INFO:tasks.workunit.client.0.smithi063.stdout:4/580: link de/d17/d1b/d67/la7 de/d2d/lb3 0 2024-09-17T01:56:28.535 INFO:tasks.workunit.client.0.smithi063.stdout:8/461: creat d1/d7/d28/d2a/d37/d3a/d85/f93 x:0 0 0 2024-09-17T01:56:28.536 INFO:tasks.workunit.client.0.smithi063.stdout:4/581: write de/d17/d1b/d67/d28/d8d/fb0 [464701,9409] 0 2024-09-17T01:56:28.536 INFO:tasks.workunit.client.0.smithi063.stdout:9/461: dwrite f7 [4194304,4194304] 0 2024-09-17T01:56:28.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/503: creat d1/d3/fa9 x:0 0 0 2024-09-17T01:56:28.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/582: symlink de/d17/d1b/d67/d28/lb4 0 2024-09-17T01:56:28.539 INFO:tasks.workunit.client.0.smithi063.stdout:1/611: dread d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:28.539 INFO:tasks.workunit.client.0.smithi063.stdout:9/462: write d9/de/d20/d37/f91 [444194,96320] 0 2024-09-17T01:56:28.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/520: sync 2024-09-17T01:56:28.539 INFO:tasks.workunit.client.0.smithi063.stdout:4/583: mknod de/d2d/d3c/cb5 0 2024-09-17T01:56:28.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/521: stat dc/d14/d19/d20/d32/d52/c58 0 2024-09-17T01:56:28.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/584: write de/d2d/f43 [1487542,31088] 0 2024-09-17T01:56:28.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/612: truncate d0/d2d/d35/d8c/fb4 841322 0 2024-09-17T01:56:28.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/613: creat d0/d2d/d35/d3f/d6b/fd1 x:0 0 0 2024-09-17T01:56:28.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/585: read de/d17/d1b/f32 [154159,85444] 0 2024-09-17T01:56:28.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/614: dread - d0/d2d/d5e/d7e/fa9 zero size 2024-09-17T01:56:28.542 INFO:tasks.workunit.client.0.smithi063.stdout:6/522: rename dc/d14/d19/d20/d32/d52/d5a/d62/d7e/c92 to dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/ca7 0 2024-09-17T01:56:28.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:28.544 INFO:tasks.workunit.client.0.smithi063.stdout:8/462: write d1/d7/d1d/f77 [2031111,20242] 0 2024-09-17T01:56:28.544 INFO:tasks.workunit.client.0.smithi063.stdout:6/523: creat dc/fa8 x:0 0 0 2024-09-17T01:56:28.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/524: symlink dc/d14/d18/d91/la9 0 2024-09-17T01:56:28.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/504: symlink d1/d3/db/d18/d33/d83/laa 0 2024-09-17T01:56:28.546 INFO:tasks.workunit.client.0.smithi063.stdout:9/463: dwrite d9/de/d33/f38 [0,4194304] 0 2024-09-17T01:56:28.546 INFO:tasks.workunit.client.0.smithi063.stdout:4/586: dread de/d17/d36/d70/d77/d90/f91 [0,4194304] 0 2024-09-17T01:56:28.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/505: creat d1/d3/db/d4b/d98/fab x:0 0 0 2024-09-17T01:56:28.548 INFO:tasks.workunit.client.0.smithi063.stdout:9/464: creat d9/de/fa6 x:0 0 0 2024-09-17T01:56:28.548 INFO:tasks.workunit.client.0.smithi063.stdout:0/506: dread - d1/d1d/d6d/f94 zero size 2024-09-17T01:56:28.548 INFO:tasks.workunit.client.0.smithi063.stdout:4/587: chown de/d17/d1b/d67/d28/d8d/lab 123474276 1 2024-09-17T01:56:28.549 INFO:tasks.workunit.client.0.smithi063.stdout:0/507: readlink d1/d3/l3c 0 2024-09-17T01:56:28.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/588: mknod de/d17/d1b/d9e/cb6 0 2024-09-17T01:56:28.550 INFO:tasks.workunit.client.0.smithi063.stdout:9/465: symlink d9/de/d20/d32/la7 0 2024-09-17T01:56:28.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/589: creat de/d17/d36/d70/d77/fb7 x:0 0 0 2024-09-17T01:56:28.551 INFO:tasks.workunit.client.0.smithi063.stdout:9/466: creat d9/de/d20/d1b/fa8 x:0 0 0 2024-09-17T01:56:28.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/467: stat d9/de/d20/d37/f91 0 2024-09-17T01:56:28.552 INFO:tasks.workunit.client.0.smithi063.stdout:4/590: creat de/d17/d36/d70/d77/d90/d9a/fb8 x:0 0 0 2024-09-17T01:56:28.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/591: rename de/d17/d1b/d67/f60 to de/d2d/d52/d9c/fb9 0 2024-09-17T01:56:28.558 INFO:tasks.workunit.client.0.smithi063.stdout:8/463: truncate d1/d7/d28/d89/d41/d49/f3b 2263897 0 2024-09-17T01:56:28.559 INFO:tasks.workunit.client.0.smithi063.stdout:8/464: creat d1/d7/d28/d2a/d53/f94 x:0 0 0 2024-09-17T01:56:28.559 INFO:tasks.workunit.client.0.smithi063.stdout:8/465: rmdir d1/d7/d28/d89/d62 39 2024-09-17T01:56:28.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/468: truncate d9/d8d/d2a/f35 2246506 0 2024-09-17T01:56:28.563 INFO:tasks.workunit.client.0.smithi063.stdout:4/592: dread de/f14 [0,4194304] 0 2024-09-17T01:56:28.564 INFO:tasks.workunit.client.0.smithi063.stdout:6/525: dread dc/f38 [0,4194304] 0 2024-09-17T01:56:28.566 INFO:tasks.workunit.client.0.smithi063.stdout:0/508: dwrite f0 [0,4194304] 0 2024-09-17T01:56:28.566 INFO:tasks.workunit.client.0.smithi063.stdout:4/593: creat de/d17/d36/d70/d77/d90/da6/fba x:0 0 0 2024-09-17T01:56:28.567 INFO:tasks.workunit.client.0.smithi063.stdout:8/466: dwrite d1/d7/d28/d89/d41/d49/f61 [0,4194304] 0 2024-09-17T01:56:28.568 INFO:tasks.workunit.client.0.smithi063.stdout:6/526: mknod dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/caa 0 2024-09-17T01:56:28.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/509: creat d1/d3/db/d18/d33/d83/fac x:0 0 0 2024-09-17T01:56:28.568 INFO:tasks.workunit.client.0.smithi063.stdout:8/467: mknod d1/d7/d28/c95 0 2024-09-17T01:56:28.569 INFO:tasks.workunit.client.0.smithi063.stdout:0/510: write d1/d3/db/d18/f30 [2397451,117673] 0 2024-09-17T01:56:28.570 INFO:tasks.workunit.client.0.smithi063.stdout:9/469: truncate d9/de/d20/d1b/f1f 2711349 0 2024-09-17T01:56:28.571 INFO:tasks.workunit.client.0.smithi063.stdout:9/470: creat d9/de/fa9 x:0 0 0 2024-09-17T01:56:28.571 INFO:tasks.workunit.client.0.smithi063.stdout:9/471: chown d9/de/d20/d37/d42/f60 2 1 2024-09-17T01:56:28.572 INFO:tasks.workunit.client.0.smithi063.stdout:0/511: creat d1/d3/db/d18/d85/da8/fad x:0 0 0 2024-09-17T01:56:28.572 INFO:tasks.workunit.client.0.smithi063.stdout:9/472: write d9/de/d20/d37/f61 [180613,73092] 0 2024-09-17T01:56:28.573 INFO:tasks.workunit.client.0.smithi063.stdout:0/512: mkdir d1/d3/db/d18/d85/dae 0 2024-09-17T01:56:28.573 INFO:tasks.workunit.client.0.smithi063.stdout:9/473: creat d9/de/d20/d37/d42/d4c/faa x:0 0 0 2024-09-17T01:56:28.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/468: dread d1/d7/d28/d2a/f5b [0,4194304] 0 2024-09-17T01:56:28.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/474: dread - d9/de/d20/fa3 zero size 2024-09-17T01:56:28.575 INFO:tasks.workunit.client.0.smithi063.stdout:9/475: stat d9/d8d/d2a/d40/f71 0 2024-09-17T01:56:28.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/469: readlink d1/d7/d28/d89/d41/l7e 0 2024-09-17T01:56:28.577 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:28.577+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:28.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/513: getdents d1/d1d/d6d 0 2024-09-17T01:56:28.577 INFO:tasks.workunit.client.0.smithi063.stdout:8/470: chown d1/d7/d28/d2a/d37/d3a/l60 57 1 2024-09-17T01:56:28.577 INFO:tasks.workunit.client.0.smithi063.stdout:6/527: dwrite dc/d14/d19/d20/d32/d52/d5a/d43/f50 [0,4194304] 0 2024-09-17T01:56:28.578 INFO:tasks.workunit.client.0.smithi063.stdout:8/471: chown d1/d7/d28/d2a/d4d/f6b 44833 1 2024-09-17T01:56:28.578 INFO:tasks.workunit.client.0.smithi063.stdout:6/528: write dc/d14/d19/f1c [5007190,81056] 0 2024-09-17T01:56:28.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/514: truncate d1/d3/db/d6e/fa2 963857 0 2024-09-17T01:56:28.579 INFO:tasks.workunit.client.0.smithi063.stdout:6/529: creat dc/d14/d19/d20/d32/d68/d9c/fab x:0 0 0 2024-09-17T01:56:28.580 INFO:tasks.workunit.client.0.smithi063.stdout:0/515: rename d1/d3/c34 to d1/d3/d32/d63/caf 0 2024-09-17T01:56:28.580 INFO:tasks.workunit.client.0.smithi063.stdout:0/516: mkdir d1/d1d/d6d/db0 0 2024-09-17T01:56:28.581 INFO:tasks.workunit.client.0.smithi063.stdout:6/530: getdents dc/d14/d19/d20/d32/d52/d5a/d62 0 2024-09-17T01:56:28.582 INFO:tasks.workunit.client.0.smithi063.stdout:0/517: read d1/d1d/f99 [4087989,57014] 0 2024-09-17T01:56:28.582 INFO:tasks.workunit.client.0.smithi063.stdout:6/531: symlink dc/d14/d19/d20/d32/d68/lac 0 2024-09-17T01:56:28.583 INFO:tasks.workunit.client.0.smithi063.stdout:6/532: creat dc/d14/d18/fad x:0 0 0 2024-09-17T01:56:28.589 INFO:tasks.workunit.client.0.smithi063.stdout:6/533: dread dc/d14/d19/d20/d32/d52/d5a/f26 [0,4194304] 0 2024-09-17T01:56:28.590 INFO:tasks.workunit.client.0.smithi063.stdout:6/534: mknod dc/d14/d19/cae 0 2024-09-17T01:56:28.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/594: dread de/d2d/d52/f5f [0,4194304] 0 2024-09-17T01:56:28.591 INFO:tasks.workunit.client.0.smithi063.stdout:6/535: write dc/d14/d19/d20/d32/d52/f60 [1030274,79117] 0 2024-09-17T01:56:28.591 INFO:tasks.workunit.client.0.smithi063.stdout:9/476: truncate d9/de/f2f 6160734 0 2024-09-17T01:56:28.591 INFO:tasks.workunit.client.0.smithi063.stdout:4/595: write de/d17/d1b/f6a [762305,90038] 0 2024-09-17T01:56:28.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/596: chown de/d17/c93 2578 1 2024-09-17T01:56:28.592 INFO:tasks.workunit.client.0.smithi063.stdout:6/536: write dc/d1b/f4b [398303,79353] 0 2024-09-17T01:56:28.592 INFO:tasks.workunit.client.0.smithi063.stdout:9/477: fsync d9/de/d20/d1b/d25/d73/f7c 0 2024-09-17T01:56:28.592 INFO:tasks.workunit.client.0.smithi063.stdout:9/478: fsync d9/d27/f3a 0 2024-09-17T01:56:28.593 INFO:tasks.workunit.client.0.smithi063.stdout:4/597: creat de/d17/d1b/fbb x:0 0 0 2024-09-17T01:56:28.593 INFO:tasks.workunit.client.0.smithi063.stdout:6/537: symlink dc/d14/d19/d20/d32/d52/d5a/laf 0 2024-09-17T01:56:28.593 INFO:tasks.workunit.client.0.smithi063.stdout:9/479: mknod d9/d8d/d75/cab 0 2024-09-17T01:56:28.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/518: creat d1/d3/db/d6e/d86/fb1 x:0 0 0 2024-09-17T01:56:28.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/480: dread d9/d8d/d2a/d40/f6c [0,4194304] 0 2024-09-17T01:56:28.600 INFO:tasks.workunit.client.0.smithi063.stdout:4/598: dwrite de/f14 [0,4194304] 0 2024-09-17T01:56:28.601 INFO:tasks.workunit.client.0.smithi063.stdout:4/599: dread - de/d17/d36/f94 zero size 2024-09-17T01:56:28.601 INFO:tasks.workunit.client.0.smithi063.stdout:9/481: read d9/d8d/f34 [16012,34334] 0 2024-09-17T01:56:28.602 INFO:tasks.workunit.client.0.smithi063.stdout:0/519: dwrite d1/d3/db/d18/d33/f71 [0,4194304] 0 2024-09-17T01:56:28.604 INFO:tasks.workunit.client.0.smithi063.stdout:9/482: rmdir d9/de/d20/d37/d42 39 2024-09-17T01:56:28.604 INFO:tasks.workunit.client.0.smithi063.stdout:4/600: write de/d17/d36/d70/f8a [935942,52094] 0 2024-09-17T01:56:28.605 INFO:tasks.workunit.client.0.smithi063.stdout:9/483: write d9/d8d/d2a/d40/f71 [745632,130588] 0 2024-09-17T01:56:28.605 INFO:tasks.workunit.client.0.smithi063.stdout:4/601: mkdir de/d17/d36/d70/d77/d90/dbc 0 2024-09-17T01:56:28.606 INFO:tasks.workunit.client.0.smithi063.stdout:0/520: write d1/d3/db/d4b/f1c [2621456,23495] 0 2024-09-17T01:56:28.606 INFO:tasks.workunit.client.0.smithi063.stdout:4/602: dread - de/d17/d1b/fbb zero size 2024-09-17T01:56:28.606 INFO:tasks.workunit.client.0.smithi063.stdout:4/603: fdatasync de/d17/f68 0 2024-09-17T01:56:28.608 INFO:tasks.workunit.client.0.smithi063.stdout:0/521: symlink d1/d44/lb2 0 2024-09-17T01:56:28.608 INFO:tasks.workunit.client.0.smithi063.stdout:8/472: dread d1/d7/d28/d89/d41/d49/f3b [0,4194304] 0 2024-09-17T01:56:28.608 INFO:tasks.workunit.client.0.smithi063.stdout:0/522: write d1/d3/db/d4b/d2f/d56/f57 [4590269,109543] 0 2024-09-17T01:56:28.609 INFO:tasks.workunit.client.0.smithi063.stdout:8/473: write d1/d7/d28/d89/d41/d49/f1b [3141043,122729] 0 2024-09-17T01:56:28.612 INFO:tasks.workunit.client.0.smithi063.stdout:9/484: dwrite d9/f56 [0,4194304] 0 2024-09-17T01:56:28.613 INFO:tasks.workunit.client.0.smithi063.stdout:9/485: mkdir d9/d8d/d2a/d40/dac 0 2024-09-17T01:56:28.615 INFO:tasks.workunit.client.0.smithi063.stdout:9/486: write d9/de/d20/d1b/d25/d73/f7c [256903,64720] 0 2024-09-17T01:56:28.615 INFO:tasks.workunit.client.0.smithi063.stdout:0/523: dwrite d1/d3/db/d4b/d98/fab [0,4194304] 0 2024-09-17T01:56:28.617 INFO:tasks.workunit.client.0.smithi063.stdout:0/524: symlink d1/d44/d53/lb3 0 2024-09-17T01:56:28.617 INFO:tasks.workunit.client.0.smithi063.stdout:9/487: mknod d9/de/d20/d1b/d25/d73/da4/cad 0 2024-09-17T01:56:28.618 INFO:tasks.workunit.client.0.smithi063.stdout:0/525: creat d1/d3/db/d4b/d82/fb4 x:0 0 0 2024-09-17T01:56:28.619 INFO:tasks.workunit.client.0.smithi063.stdout:8/474: truncate d1/f16 5512742 0 2024-09-17T01:56:28.619 INFO:tasks.workunit.client.0.smithi063.stdout:9/488: chown d9/de/d20/d37/d42/d7e/l8a 1246158062 1 2024-09-17T01:56:28.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/475: rmdir d1/d7/d28 39 2024-09-17T01:56:28.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/526: link d1/d1f/c73 d1/d3/db/d4b/d2f/d56/cb5 0 2024-09-17T01:56:28.621 INFO:tasks.workunit.client.0.smithi063.stdout:9/489: rename d9/d8d/d2a/d40/l5a to d9/d8d/d75/lae 0 2024-09-17T01:56:28.621 INFO:tasks.workunit.client.0.smithi063.stdout:8/476: creat d1/d7/d28/f96 x:0 0 0 2024-09-17T01:56:28.622 INFO:tasks.workunit.client.0.smithi063.stdout:0/527: mkdir d1/d44/d7c/db6 0 2024-09-17T01:56:28.622 INFO:tasks.workunit.client.0.smithi063.stdout:9/490: getdents d9/de/d20/d1b 0 2024-09-17T01:56:28.623 INFO:tasks.workunit.client.0.smithi063.stdout:0/528: mkdir d1/d3/db/d18/d33/d83/db7 0 2024-09-17T01:56:28.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/604: dread de/d17/d36/f81 [0,4194304] 0 2024-09-17T01:56:28.623 INFO:tasks.workunit.client.0.smithi063.stdout:9/491: creat d9/faf x:0 0 0 2024-09-17T01:56:28.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/477: link d1/d7/lb d1/d7/d28/d2a/d59/l97 0 2024-09-17T01:56:28.624 INFO:tasks.workunit.client.0.smithi063.stdout:0/529: mknod d1/d3/d1b/cb8 0 2024-09-17T01:56:28.624 INFO:tasks.workunit.client.0.smithi063.stdout:9/492: chown d9/de/d20/d37/f8e 30923533 1 2024-09-17T01:56:28.625 INFO:tasks.workunit.client.0.smithi063.stdout:9/493: mknod d9/d8d/d2a/d40/dac/cb0 0 2024-09-17T01:56:28.625 INFO:tasks.workunit.client.0.smithi063.stdout:7/426: sync 2024-09-17T01:56:28.625 INFO:tasks.workunit.client.0.smithi063.stdout:5/567: sync 2024-09-17T01:56:28.625 INFO:tasks.workunit.client.0.smithi063.stdout:2/446: sync 2024-09-17T01:56:28.625 INFO:tasks.workunit.client.0.smithi063.stdout:3/512: sync 2024-09-17T01:56:28.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/427: rmdir d2/d3/d17 39 2024-09-17T01:56:28.626 INFO:tasks.workunit.client.0.smithi063.stdout:5/568: write d6/d35/f95 [1884082,24322] 0 2024-09-17T01:56:28.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/513: symlink df/d12/d1e/lab 0 2024-09-17T01:56:28.627 INFO:tasks.workunit.client.0.smithi063.stdout:4/605: dread de/d17/d1b/d67/d28/d8b/f8c [0,4194304] 0 2024-09-17T01:56:28.629 INFO:tasks.workunit.client.0.smithi063.stdout:3/514: symlink df/d12/d3a/lac 0 2024-09-17T01:56:28.630 INFO:tasks.workunit.client.0.smithi063.stdout:5/569: rename d6/d23/d29/d2b/d31/fb1 to d6/d23/fb5 0 2024-09-17T01:56:28.631 INFO:tasks.workunit.client.0.smithi063.stdout:4/606: rename de/d17/d36/d70/d77/l80 to de/lbd 0 2024-09-17T01:56:28.631 INFO:tasks.workunit.client.0.smithi063.stdout:5/570: unlink d6/d37/f86 0 2024-09-17T01:56:28.633 INFO:tasks.workunit.client.0.smithi063.stdout:9/494: dwrite d9/de/fa6 [0,4194304] 0 2024-09-17T01:56:28.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/447: dwrite d3/f9 [4194304,4194304] 0 2024-09-17T01:56:28.635 INFO:tasks.workunit.client.0.smithi063.stdout:5/571: creat d6/d23/d29/d36/fb6 x:0 0 0 2024-09-17T01:56:28.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/495: fdatasync d9/d8d/d2a/d40/f5c 0 2024-09-17T01:56:28.635 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-17T01:56:28.635 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:56:28.635 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T01:56:28.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T01:56:28.636 INFO:tasks.workunit.client.0.smithi063.stdout:7/428: dwrite d2/d3/d27/d39/f3c [4194304,4194304] 0 2024-09-17T01:56:28.636 INFO:tasks.workunit.client.0.smithi063.stdout:9/496: fdatasync d9/de/d20/d1b/fa8 0 2024-09-17T01:56:28.637 INFO:tasks.workunit.client.0.smithi063.stdout:4/607: rename de/d17/d36/d70/d77/d90 to de/d17/d36/dbe 0 2024-09-17T01:56:28.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/448: symlink d3/d7/d76/l7f 0 2024-09-17T01:56:28.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/449: symlink d3/d28/l80 0 2024-09-17T01:56:28.640 INFO:tasks.workunit.client.0.smithi063.stdout:5/572: creat d6/d23/d29/d2b/fb7 x:0 0 0 2024-09-17T01:56:28.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/515: dwrite f3 [0,4194304] 0 2024-09-17T01:56:28.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/516: readlink df/d12/d1e/d5e/l70 0 2024-09-17T01:56:28.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/450: symlink d3/d7/d38/l81 0 2024-09-17T01:56:28.641 INFO:tasks.workunit.client.0.smithi063.stdout:0/530: dwrite d1/d3/db/d18/d33/f67 [4194304,4194304] 0 2024-09-17T01:56:28.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/451: write d3/d7/df/d43/f55 [3448415,100251] 0 2024-09-17T01:56:28.643 INFO:tasks.workunit.client.0.smithi063.stdout:0/531: rename d1/d3/db/d18/d33/d83/db7 to d1/d3/db/d18/d33/d83/db7/db9 22 2024-09-17T01:56:28.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/532: symlink d1/d3/db/d18/d85/da8/lba 0 2024-09-17T01:56:28.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/452: creat d3/d2a/f82 x:0 0 0 2024-09-17T01:56:28.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/453: readlink d3/d28/l3f 0 2024-09-17T01:56:28.647 INFO:tasks.workunit.client.0.smithi063.stdout:0/533: write d1/d3/db/d6e/d86/fb1 [60399,63898] 0 2024-09-17T01:56:28.647 INFO:tasks.workunit.client.0.smithi063.stdout:3/517: link df/d28/c34 df/d12/d43/d50/d87/cad 0 2024-09-17T01:56:28.647 INFO:tasks.workunit.client.0.smithi063.stdout:2/454: fsync d3/d7/df/d68/f46 0 2024-09-17T01:56:28.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/518: chown df/d12/d1e/f57 1916 1 2024-09-17T01:56:28.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/573: dwrite d6/d23/d29/d2b/d4f/f82 [0,4194304] 0 2024-09-17T01:56:28.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/574: readlink d6/l1a 0 2024-09-17T01:56:28.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/455: creat d3/f83 x:0 0 0 2024-09-17T01:56:28.649 INFO:tasks.workunit.client.0.smithi063.stdout:3/519: link df/c22 df/d12/cae 0 2024-09-17T01:56:28.649 INFO:tasks.workunit.client.0.smithi063.stdout:2/456: unlink d3/c23 0 2024-09-17T01:56:28.650 INFO:tasks.workunit.client.0.smithi063.stdout:2/457: mkdir d3/d28/d84 0 2024-09-17T01:56:28.650 INFO:tasks.workunit.client.0.smithi063.stdout:3/520: rename fc to df/d12/d2d/faf 0 2024-09-17T01:56:28.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/458: truncate d3/f79 128272 0 2024-09-17T01:56:28.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/521: symlink df/d12/d1e/d53/lb0 0 2024-09-17T01:56:28.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/459: chown d3/f8 76 1 2024-09-17T01:56:28.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/522: dread - df/d12/d2d/fa1 zero size 2024-09-17T01:56:28.655 INFO:tasks.workunit.client.0.smithi063.stdout:5/575: dwrite d6/d37/d19/f26 [0,4194304] 0 2024-09-17T01:56:28.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/608: truncate de/d2d/f43 281221 0 2024-09-17T01:56:28.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/576: chown d6/d9/d13/f1e 999606 1 2024-09-17T01:56:28.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/609: write de/d17/d36/d70/f72 [267447,23947] 0 2024-09-17T01:56:28.660 INFO:tasks.workunit.client.0.smithi063.stdout:4/610: mknod de/d17/d36/cbf 0 2024-09-17T01:56:28.660 INFO:tasks.workunit.client.0.smithi063.stdout:5/577: write d6/d23/f58 [221459,71034] 0 2024-09-17T01:56:28.662 INFO:tasks.workunit.client.0.smithi063.stdout:4/611: getdents de/d2d/d52/d9c 0 2024-09-17T01:56:28.662 INFO:tasks.workunit.client.0.smithi063.stdout:5/578: unlink d6/d9/d13/d1d/l4d 0 2024-09-17T01:56:28.662 INFO:tasks.workunit.client.0.smithi063.stdout:5/579: chown d6/d9/d32/c6a 7 1 2024-09-17T01:56:28.663 INFO:tasks.workunit.client.0.smithi063.stdout:5/580: write d6/d23/d29/d36/f97 [18921,4124] 0 2024-09-17T01:56:28.664 INFO:tasks.workunit.client.0.smithi063.stdout:5/581: write d6/d23/d54/fb2 [4969552,6493] 0 2024-09-17T01:56:28.665 INFO:tasks.workunit.client.0.smithi063.stdout:5/582: fsync d6/d23/d29/f96 0 2024-09-17T01:56:28.666 INFO:tasks.workunit.client.0.smithi063.stdout:5/583: symlink d6/d37/d79/lb8 0 2024-09-17T01:56:28.667 INFO:tasks.workunit.client.0.smithi063.stdout:9/497: dread d9/d8d/d2a/f35 [0,4194304] 0 2024-09-17T01:56:28.667 INFO:tasks.workunit.client.0.smithi063.stdout:5/584: truncate d6/d23/f77 399891 0 2024-09-17T01:56:28.668 INFO:tasks.workunit.client.0.smithi063.stdout:9/498: creat d9/d27/fb1 x:0 0 0 2024-09-17T01:56:28.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/499: rename d9/d8d/d2a/d36/l86 to d9/d8d/d2a/lb2 0 2024-09-17T01:56:28.672 INFO:tasks.workunit.client.0.smithi063.stdout:7/429: dread d2/d3/d27/d39/f3c [0,4194304] 0 2024-09-17T01:56:28.672 INFO:tasks.workunit.client.0.smithi063.stdout:7/430: dread - d2/d3/d22/f77 zero size 2024-09-17T01:56:28.673 INFO:tasks.workunit.client.0.smithi063.stdout:7/431: stat d2/d15/l1a 0 2024-09-17T01:56:28.673 INFO:tasks.workunit.client.0.smithi063.stdout:3/523: dread df/d12/d1e/f2b [0,4194304] 0 2024-09-17T01:56:28.675 INFO:tasks.workunit.client.0.smithi063.stdout:3/524: write df/d28/f48 [818276,98294] 0 2024-09-17T01:56:28.675 INFO:tasks.workunit.client.0.smithi063.stdout:3/525: stat df/d12/d2d/f40 0 2024-09-17T01:56:28.677 INFO:tasks.workunit.client.0.smithi063.stdout:3/526: mkdir df/d12/d43/d50/d58/d97/daa/db1 0 2024-09-17T01:56:28.677 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:28.677+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:28.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/527: creat df/d12/d30/d8a/fb2 x:0 0 0 2024-09-17T01:56:28.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/528: write df/d12/d1e/d39/f7b [712900,99660] 0 2024-09-17T01:56:28.679 INFO:tasks.workunit.client.0.smithi063.stdout:7/432: read d2/d3/d67/f75 [799758,21109] 0 2024-09-17T01:56:28.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/529: write df/d12/d1e/f55 [940273,70298] 0 2024-09-17T01:56:28.680 INFO:tasks.workunit.client.0.smithi063.stdout:4/612: dread de/f4c [0,4194304] 0 2024-09-17T01:56:28.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/433: rmdir d2/d15/d2f 39 2024-09-17T01:56:28.680 INFO:tasks.workunit.client.0.smithi063.stdout:3/530: unlink df/d12/d2d/f4b 0 2024-09-17T01:56:28.681 INFO:tasks.workunit.client.0.smithi063.stdout:4/613: write de/d17/d1b/d67/d28/d8d/fb0 [1292641,101509] 0 2024-09-17T01:56:28.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/460: dread d3/d7/df/f1a [0,4194304] 0 2024-09-17T01:56:28.682 INFO:tasks.workunit.client.0.smithi063.stdout:3/531: rename df/l1a to df/d12/d43/d50/lb3 0 2024-09-17T01:56:28.682 INFO:tasks.workunit.client.0.smithi063.stdout:4/614: truncate de/fb2 660319 0 2024-09-17T01:56:28.683 INFO:tasks.workunit.client.0.smithi063.stdout:2/461: rename d3/d7/df/d30/c40 to d3/d7/df/d5a/c85 0 2024-09-17T01:56:28.683 INFO:tasks.workunit.client.0.smithi063.stdout:4/615: fsync de/d2d/d52/d9c/fb9 0 2024-09-17T01:56:28.683 INFO:tasks.workunit.client.0.smithi063.stdout:3/532: truncate df/d12/d2d/f3c 4587644 0 2024-09-17T01:56:28.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/533: creat df/d12/d43/fb4 x:0 0 0 2024-09-17T01:56:28.684 INFO:tasks.workunit.client.0.smithi063.stdout:4/616: rename l6 to de/d17/d1b/d67/d28/d8d/lc0 0 2024-09-17T01:56:28.686 INFO:tasks.workunit.client.0.smithi063.stdout:3/534: mkdir df/d12/d43/d50/d58/db5 0 2024-09-17T01:56:28.687 INFO:tasks.workunit.client.0.smithi063.stdout:7/434: dwrite d2/d15/d2f/d52/f68 [0,4194304] 0 2024-09-17T01:56:28.690 INFO:tasks.workunit.client.0.smithi063.stdout:2/462: truncate d3/d7/df/d68/f53 838562 0 2024-09-17T01:56:28.690 INFO:tasks.workunit.client.0.smithi063.stdout:3/535: readlink df/d12/d43/d50/lb3 0 2024-09-17T01:56:28.691 INFO:tasks.workunit.client.0.smithi063.stdout:4/617: rename de/d17/d1b/d67/d28/d8d/lc0 to de/d17/d1b/d67/d28/d30/lc1 0 2024-09-17T01:56:28.691 INFO:tasks.workunit.client.0.smithi063.stdout:3/536: read - df/d12/d43/fb4 zero size 2024-09-17T01:56:28.691 INFO:tasks.workunit.client.0.smithi063.stdout:7/435: creat d2/d3/d27/d39/f8a x:0 0 0 2024-09-17T01:56:28.692 INFO:tasks.workunit.client.0.smithi063.stdout:7/436: fdatasync d2/d15/d2f/d52/f63 0 2024-09-17T01:56:28.692 INFO:tasks.workunit.client.0.smithi063.stdout:7/437: fsync d2/d15/d2f/f3d 0 2024-09-17T01:56:28.693 INFO:tasks.workunit.client.0.smithi063.stdout:7/438: creat d2/d3/d17/d25/f8b x:0 0 0 2024-09-17T01:56:28.694 INFO:tasks.workunit.client.0.smithi063.stdout:7/439: write d2/d3/d27/d33/f81 [479715,69810] 0 2024-09-17T01:56:28.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/440: creat d2/d15/d2f/d45/d84/f8c x:0 0 0 2024-09-17T01:56:28.697 INFO:tasks.workunit.client.0.smithi063.stdout:4/618: dwrite de/d17/d1b/d67/d28/d30/f7b [0,4194304] 0 2024-09-17T01:56:28.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/537: dwrite df/d12/d43/d50/d58/f75 [0,4194304] 0 2024-09-17T01:56:28.699 INFO:tasks.workunit.client.0.smithi063.stdout:3/538: rename df/d12/d43/c8c to df/d83/cb6 0 2024-09-17T01:56:28.700 INFO:tasks.workunit.client.0.smithi063.stdout:3/539: fdatasync df/d12/d1e/d39/f6c 0 2024-09-17T01:56:28.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/540: creat df/d12/d43/d50/d58/d97/fb7 x:0 0 0 2024-09-17T01:56:28.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/441: dwrite d2/d15/d2f/f3d [0,4194304] 0 2024-09-17T01:56:28.703 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1525793740000001, 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:28.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:28.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.710 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1477776970000004, 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.711 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:28.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:28.716 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1447051990000006, 2024-09-17T01:56:28.717 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.718 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.719 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.720 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.721 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:28.722 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.723 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1427690439999996, 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.724 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:28.725 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.726 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:28.727 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.728 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:28.729 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.730 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1407873389999992, 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.731 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.732 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:28.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:28.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:28.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1375337860000005, 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.737 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:28.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.740 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:28.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.743 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1270892680000006, 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.744 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.746 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:28.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:28.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1179204879999993, 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.750 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:28.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:28.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:28.756 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1138911310000008, 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:28.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.762 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1075655740000006, 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.763 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:28.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:28.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1043749290000004, 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.770 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:28.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:28.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1032192779999992, 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.776 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:28.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:28.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.782 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.1011459390000002, 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.783 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:28.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0940451109999998, 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:28.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0887961209999997, 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.795 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:28.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:28.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.801 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0876020939999993, 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:28.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.807 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0809976609999996, 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.808 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0786160630000001, 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.815 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:28.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:28.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.075513226, 2024-09-17T01:56:28.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:28.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:28.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 9.0696607809999996, 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:28.828 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:28.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:28.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:28.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:28.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:28.834 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:28.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:28.837 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:28.837+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:28.850 INFO:tasks.workunit.client.0.smithi063.stdout:7/442: mkdir d2/d3/d67/d8d 0 2024-09-17T01:56:28.850 INFO:tasks.workunit.client.0.smithi063.stdout:4/619: dwrite de/d17/d36/f5b [0,4194304] 0 2024-09-17T01:56:28.850 INFO:tasks.workunit.client.0.smithi063.stdout:7/443: fsync d2/d15/d2f/d45/d48/f6f 0 2024-09-17T01:56:28.850 INFO:tasks.workunit.client.0.smithi063.stdout:4/620: unlink de/d17/d1b/d67/d28/d8b/f92 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/444: symlink d2/d3/d27/d33/l8e 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/445: mkdir d2/d3/d27/d8f 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/446: dread - d2/d3/d22/d3a/f70 zero size 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/447: chown d2/d3/d27/d8f 696341 1 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:4/621: dread - de/d17/d36/dbe/d9a/fad zero size 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:4/622: mknod de/d2d/d52/cc2 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/448: truncate d2/d3/d22/d3a/f70 530618 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:4/623: symlink de/d17/d36/dbe/lc3 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:4/624: read - de/d17/d1b/faa zero size 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/449: read d2/fb [4069359,45381] 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:4/625: symlink de/d17/d36/dbe/lc4 0 2024-09-17T01:56:28.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/450: link d2/d15/d2f/d45/d48/l5a d2/d3/d67/d8d/l90 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/451: chown d2/d15/d2f/d52/l86 307961465 1 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/452: chown d2/d15/d2f/d45/d48/f6f 3496 1 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:4/626: dread de/d2d/f64 [0,4194304] 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/453: getdents d2/d15/d2f/d3e/d73 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/454: dread - d2/d3/d27/d39/f8a zero size 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/455: mknod d2/d3/d27/d33/d7b/c91 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/456: mkdir d2/d3/d27/d39/d40/d92 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/457: chown d2/f7 94793791 1 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/458: creat d2/d3/d27/d8f/f93 x:0 0 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/459: stat d2/d3/d27/d65/c89 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:4/627: dwrite de/d2d/d52/d9c/fb9 [0,4194304] 0 2024-09-17T01:56:28.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/460: link d2/d15/f59 d2/d15/d2f/d52/f94 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/628: write de/d17/d36/d70/f72 [257867,40426] 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/461: symlink d2/d3/d27/d39/l95 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/462: chown d2/d3/d22/d3a 505 1 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:3/541: dread df/d12/d43/f69 [0,4194304] 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/463: mkdir d2/d15/d2f/d3e/d73/d96 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/464: fdatasync d2/d3/d27/d39/f46 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/465: mkdir d2/d15/d2f/d52/d97 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/466: mkdir d2/d98 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/629: read de/f16 [3185598,107372] 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/630: symlink de/d17/d1b/d67/d28/lc5 0 2024-09-17T01:56:28.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/631: mkdir de/d17/dc6 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/632: dwrite de/d17/d1b/d67/f37 [4194304,4194304] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/633: getdents de/d2d/d52 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/634: rename de/d17/d1b/d67 to de/d17/d1b/dc7 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/635: symlink de/d2d/lc8 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/467: dread d2/d3/d17/d25/f1b [4194304,4194304] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/468: mknod d2/d3/d22/d3a/c99 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/469: dread d2/d15/d2f/d52/f68 [0,4194304] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/470: write d2/d3/d27/d39/f4e [4096105,6953] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/636: dread de/f2f [0,4194304] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/637: dread de/d17/d1b/dc7/f4e [0,4194304] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/471: dread d2/d15/d2f/f3d [0,4194304] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/472: unlink d2/d3/d27/d39/f4b 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/473: write d2/d15/d2f/d45/d48/f6f [942835,35510] 0 2024-09-17T01:56:28.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/474: creat d2/d15/f9a x:0 0 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:7/475: mkdir d2/d3/d27/d33/d7b/d9b 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:4/638: truncate de/d17/d36/dbe/f91 3195030 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:8/478: sync 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:6/538: sync 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/534: sync 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:1/615: sync 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/535: creat d1/d3/db/d4b/fbb x:0 0 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:4/639: dread de/fb2 [0,4194304] 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/536: mknod d1/d44/d7c/cbc 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:4/640: rename de/d17/d36/f81 to de/d17/d36/d70/fc9 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:1/616: dread d0/d2d/d35/d3f/d4e/f5f [0,4194304] 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:4/641: mknod de/cca 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:7/476: dwrite d2/d3/d27/f32 [0,4194304] 0 2024-09-17T01:56:28.855 INFO:tasks.workunit.client.0.smithi063.stdout:1/617: write d0/d2d/d35/d8c/fb4 [810219,32392] 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/477: fdatasync d2/d3/d17/d25/f1b 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/479: dwrite d1/d7/d28/d2a/d37/d3a/f3c [0,4194304] 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/480: mknod d1/d7/d28/d89/d62/d66/c98 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/478: creat d2/d3/d27/d39/f9c x:0 0 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:1/618: rename d0/d2d/d35/d3f/d81/dce to d0/d2d/d5e/d7e/dd2 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/479: chown d2/f23 7384605 1 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/481: truncate d1/d7/d28/f42 790637 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:6/539: truncate dc/d14/d19/f2d 3600988 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/480: mknod d2/d3/d22/c9d 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/482: mknod d1/d7/d28/d89/d62/d66/c99 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/481: fdatasync d2/d3/d27/d33/f81 0 2024-09-17T01:56:28.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/483: chown d1/d7/d28/f50 1034147537 1 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:4/642: dwrite de/d17/d36/d70/d77/fa5 [0,4194304] 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:7/482: readlink d2/d3/d67/d8d/l90 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:4/643: creat de/fcb x:0 0 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:7/483: symlink d2/d15/d2f/l9e 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:4/644: write de/d17/d1b/dc7/f9f [5068254,93743] 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:7/484: rmdir d2/d3/d17/d76 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/619: dwrite d0/d2d/d35/d6f/db7/fd0 [4194304,4194304] 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/540: dwrite dc/f13 [4194304,4194304] 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/541: dread - dc/d14/d65/fa5 zero size 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/620: dwrite d0/d2d/d35/d3f/d6b/fd1 [0,4194304] 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/621: readlink d0/d93/l99 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/622: fsync d0/d2d/d35/d9d/fa8 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/623: write d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a [1770579,41778] 0 2024-09-17T01:56:28.857 INFO:tasks.workunit.client.0.smithi063.stdout:8/484: truncate d1/d7/d1d/f77 1545157 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:4/645: truncate de/d17/d36/f5b 4795127 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/485: readlink d1/d7/d28/d89/d41/l7e 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/485: rename d2/f7 to d2/d3/d17/d25/f9f 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/486: write d1/d7/d28/d2a/d37/d3a/f3c [3469608,121140] 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/624: dwrite d0/d2d/f33 [0,4194304] 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:4/646: creat de/d17/d1b/d9b/fcc x:0 0 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:4/647: write f8 [3177515,85753] 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/625: creat d0/d2d/d35/d3f/d81/d50/d6c/fd3 x:0 0 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/487: truncate d1/d7/d28/d89/d41/d49/f3b 2867223 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/626: mkdir d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/627: readlink d0/d2d/d35/d6f/l79 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/628: creat d0/d93/d9e/dca/fd5 x:0 0 0 2024-09-17T01:56:28.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/486: symlink d2/d3/d27/la0 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:1/629: creat d0/d93/fd6 x:0 0 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:4/648: dwrite de/d17/d36/d70/f8a [0,4194304] 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/487: read - d2/d15/d2f/d45/d48/f7f zero size 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:4/649: fdatasync de/d17/d36/d70/fc9 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/488: dwrite d1/d7/f4e [0,4194304] 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:1/630: creat d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 x:0 0 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/489: write d1/d7/f4c [8501865,30661] 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/488: getdents d2/d15/d2f/d45 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:4/650: truncate de/d17/d1b/dc7/d28/d30/f61 1695059 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:4/651: fsync de/f10 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/490: rename d1/d7/d28/d89 to d1/d7/d28/d2a/d37/d3a/d75/d9a 0 2024-09-17T01:56:28.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/489: read d2/d3/d22/d3a/f62 [953575,79487] 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/491: rmdir d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66 39 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/490: symlink d2/d3/d27/d33/d7b/la1 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/492: chown d1/d7/d28/f51 2 1 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/491: chown d2/d3/d22/d3a/f70 3202 1 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/492: mknod d2/d3/d27/d8f/ca2 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/493: creat d2/d3/d27/d33/d7b/fa3 x:0 0 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:1/631: fdatasync d0/d2d/f33 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:4/652: dwrite de/d17/d36/d70/fa9 [0,4194304] 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:4/653: link de/d17/d36/dbe/ca3 de/d17/d36/d70/d77/ccd 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:4/654: link de/d17/d1b/dc7/la7 de/d17/d1b/dc7/d28/d8b/lce 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/493: truncate d1/d7/d1d/f3e 3163586 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:4/655: read de/d17/d1b/dc7/d28/d30/f61 [230661,50070] 0 2024-09-17T01:56:28.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/494: truncate d2/d3/d27/f32 3209498 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/656: mknod de/d17/d36/dbe/ccf 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:8/494: dread d1/d27/d82/f88 [0,4194304] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/632: dread d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a [0,4194304] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/633: fdatasync d0/d2d/d35/d3f/d81/fa4 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:7/495: dread d2/d3/d27/d39/f3c [0,4194304] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/634: write d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [685614,90641] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/657: dwrite de/d17/d1b/f4f [0,4194304] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/658: mkdir de/d2d/d3c/dd0 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/635: dwrite d0/f2 [0,4194304] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/659: dwrite de/f57 [0,4194304] 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:7/496: truncate d2/d3/d22/d3a/f83 3137970 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/636: mkdir d0/d2d/d5e/dd8 0 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:7/497: chown c0 757907 1 2024-09-17T01:56:28.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/660: readlink de/d17/d1b/dc7/d28/d30/l48 0 2024-09-17T01:56:28.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/637: readlink d0/d2d/d35/d3f/d81/d50/d8b/lc1 0 2024-09-17T01:56:28.862 INFO:tasks.workunit.client.0.smithi063.stdout:4/661: mknod de/d17/d36/dbe/dbc/cd1 0 2024-09-17T01:56:28.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/638: creat d0/d2d/d35/d6f/db7/fd9 x:0 0 0 2024-09-17T01:56:28.862 INFO:tasks.workunit.client.0.smithi063.stdout:4/662: symlink de/d17/d36/ld2 0 2024-09-17T01:56:28.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/639: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [0,4194304] 0 2024-09-17T01:56:28.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/640: symlink d0/d2d/lda 0 2024-09-17T01:56:28.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/641: symlink d0/d1c/ldb 0 2024-09-17T01:56:28.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/498: dread d2/d15/d2f/d45/f69 [0,4194304] 0 2024-09-17T01:56:28.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/499: link d2/d3/d22/d3a/c99 d2/d3/d27/ca4 0 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/642: dwrite d0/d2d/d35/d3f/d4e/f5f [4194304,4194304] 0 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/500: fsync d2/d15/d2f/d45/d48/f78 0 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/643: chown d0/d2d/d35/d8c/fb4 1665249 1 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/501: link d2/d15/d2f/f3d d2/d3/d27/d33/d7b/fa5 0 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/644: dread d0/d93/fb9 [0,4194304] 0 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/502: chown d2/d3/d67/f53 1133864356 1 2024-09-17T01:56:28.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/503: read d2/d3/d27/d33/d7b/fa5 [631506,109861] 0 2024-09-17T01:56:28.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/645: mkdir d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc 0 2024-09-17T01:56:28.869 INFO:tasks.workunit.client.0.smithi063.stdout:7/504: dwrite d2/d3/d27/d65/f6d [0,4194304] 0 2024-09-17T01:56:28.871 INFO:tasks.workunit.client.0.smithi063.stdout:5/585: sync 2024-09-17T01:56:28.871 INFO:tasks.workunit.client.0.smithi063.stdout:5/586: creat d6/d23/d29/d2b/d4f/fb9 x:0 0 0 2024-09-17T01:56:28.872 INFO:tasks.workunit.client.0.smithi063.stdout:1/646: truncate d0/d2d/d35/d3f/d4e/f6a 3937745 0 2024-09-17T01:56:28.873 INFO:tasks.workunit.client.0.smithi063.stdout:1/647: chown d0/d1c/f4c 21450 1 2024-09-17T01:56:28.873 INFO:tasks.workunit.client.0.smithi063.stdout:1/648: stat d0/d2d/d35/d8c/l98 0 2024-09-17T01:56:28.874 INFO:tasks.workunit.client.0.smithi063.stdout:7/505: truncate d2/d3/d27/d39/f42 9039839 0 2024-09-17T01:56:28.875 INFO:tasks.workunit.client.0.smithi063.stdout:1/649: creat d0/d2d/d5e/dd8/fdd x:0 0 0 2024-09-17T01:56:28.875 INFO:tasks.workunit.client.0.smithi063.stdout:1/650: mkdir d0/d1c/db1/dde 0 2024-09-17T01:56:28.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/651: fsync d0/d2d/d35/d3f/d81/d50/f9c 0 2024-09-17T01:56:28.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/652: unlink d0/d2d/d35/d3f/d94/fbf 0 2024-09-17T01:56:28.878 INFO:tasks.workunit.client.0.smithi063.stdout:1/653: chown d0/d93/dc4 8904 1 2024-09-17T01:56:28.879 INFO:tasks.workunit.client.0.smithi063.stdout:7/506: dwrite d2/d3/d22/d3a/f62 [0,4194304] 0 2024-09-17T01:56:28.880 INFO:tasks.workunit.client.0.smithi063.stdout:7/507: chown d2/d15/d2f/d45/d84/f8c 60244 1 2024-09-17T01:56:28.880 INFO:tasks.workunit.client.0.smithi063.stdout:7/508: chown d2/d15/d2f/d45/d48/c61 12976326 1 2024-09-17T01:56:28.881 INFO:tasks.workunit.client.0.smithi063.stdout:7/509: rmdir d2/d15/d2f/d45 39 2024-09-17T01:56:28.881 INFO:tasks.workunit.client.0.smithi063.stdout:1/654: link d0/d2d/d35/d6f/lbc d0/d2d/d35/d6f/ldf 0 2024-09-17T01:56:28.882 INFO:tasks.workunit.client.0.smithi063.stdout:1/655: mknod d0/d2d/d35/d3f/d81/d50/d6c/d90/ce0 0 2024-09-17T01:56:28.884 INFO:tasks.workunit.client.0.smithi063.stdout:1/656: read d0/d1c/f96 [383812,85974] 0 2024-09-17T01:56:28.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/510: truncate d2/d3/d27/d33/f81 1354830 0 2024-09-17T01:56:28.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/511: rename d2/d3/d7e to d2/d3/d27/d33/d7b/d9b/da6 0 2024-09-17T01:56:28.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/512: write d2/d15/d2f/d45/d48/f7f [574676,77605] 0 2024-09-17T01:56:28.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/513: chown d2/d15/d2f/f64 434281 1 2024-09-17T01:56:28.888 INFO:tasks.workunit.client.0.smithi063.stdout:7/514: rmdir d2/d15/d2f 39 2024-09-17T01:56:28.889 INFO:tasks.workunit.client.0.smithi063.stdout:7/515: write d2/d3/d22/d3a/f62 [1901114,111993] 0 2024-09-17T01:56:28.889 INFO:tasks.workunit.client.0.smithi063.stdout:7/516: chown d2/d3/d27/l43 0 1 2024-09-17T01:56:28.890 INFO:tasks.workunit.client.0.smithi063.stdout:7/517: chown d2/d3/d67/f10 19495415 1 2024-09-17T01:56:28.890 INFO:tasks.workunit.client.0.smithi063.stdout:1/657: dwrite d0/d2d/d35/d3f/d6b/f80 [0,4194304] 0 2024-09-17T01:56:28.891 INFO:tasks.workunit.client.0.smithi063.stdout:7/518: symlink d2/d3/d27/d39/d40/la7 0 2024-09-17T01:56:28.892 INFO:tasks.workunit.client.0.smithi063.stdout:1/658: symlink d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc/le1 0 2024-09-17T01:56:28.896 INFO:tasks.workunit.client.0.smithi063.stdout:1/659: mkdir d0/d2d/d35/d9d/de2 0 2024-09-17T01:56:28.896 INFO:tasks.workunit.client.0.smithi063.stdout:7/519: dwrite d2/d3/d27/d39/f4e [0,4194304] 0 2024-09-17T01:56:28.897 INFO:tasks.workunit.client.0.smithi063.stdout:1/660: symlink d0/d2d/d35/d8c/le3 0 2024-09-17T01:56:28.898 INFO:tasks.workunit.client.0.smithi063.stdout:1/661: unlink d0/d2d/d35/d3f/d81/d50/d6c/cba 0 2024-09-17T01:56:28.899 INFO:tasks.workunit.client.0.smithi063.stdout:1/662: chown d0/d2d/d5e/d7e/lc3 0 1 2024-09-17T01:56:28.900 INFO:tasks.workunit.client.0.smithi063.stdout:1/663: write d0/d2d/d35/d6f/db7/fc7 [792359,120784] 0 2024-09-17T01:56:28.901 INFO:tasks.workunit.client.0.smithi063.stdout:1/664: creat d0/d93/d9e/fe4 x:0 0 0 2024-09-17T01:56:28.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/665: write d0/d2d/d35/d3f/d94/fa0 [657819,54863] 0 2024-09-17T01:56:28.903 INFO:tasks.workunit.client.0.smithi063.stdout:1/666: truncate d0/d1c/f28 668983 0 2024-09-17T01:56:28.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/667: creat d0/d2d/d35/d3f/d4e/d66/fe5 x:0 0 0 2024-09-17T01:56:28.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/668: mknod d0/d1c/db1/ce6 0 2024-09-17T01:56:28.906 INFO:tasks.workunit.client.0.smithi063.stdout:1/669: creat d0/d2d/d35/d3f/d81/d50/d6c/fe7 x:0 0 0 2024-09-17T01:56:28.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/670: rename d0/d2d/d35/d3f/d6b to d0/d2d/d35/d3f/d81/d50/d6c/de8 0 2024-09-17T01:56:28.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/671: mkdir d0/d2d/d35/d3f/d81/d50/d6c/de8/de9 0 2024-09-17T01:56:28.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/672: fdatasync d0/d2d/d35/d3f/d81/f3e 0 2024-09-17T01:56:28.915 INFO:tasks.workunit.client.0.smithi063.stdout:1/673: unlink d0/l23 0 2024-09-17T01:56:28.915 INFO:tasks.workunit.client.0.smithi063.stdout:1/674: mknod d0/cea 0 2024-09-17T01:56:28.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/520: dread d2/d3/d17/d25/f9f [0,4194304] 0 2024-09-17T01:56:28.918 INFO:tasks.workunit.client.0.smithi063.stdout:7/521: truncate d2/d15/d2f/d45/d48/f6f 1125272 0 2024-09-17T01:56:28.918 INFO:tasks.workunit.client.0.smithi063.stdout:7/522: unlink d2/d3/d27/d8f/f93 0 2024-09-17T01:56:28.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/523: chown d2/d3/d22/c3f 42 1 2024-09-17T01:56:28.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/524: fsync d2/d15/d2f/d52/f68 0 2024-09-17T01:56:28.920 INFO:tasks.workunit.client.0.smithi063.stdout:7/525: symlink d2/d15/d2f/d52/d97/la8 0 2024-09-17T01:56:28.922 INFO:tasks.workunit.client.0.smithi063.stdout:7/526: rename d2/d3/d27/l36 to d2/d15/la9 0 2024-09-17T01:56:28.922 INFO:tasks.workunit.client.0.smithi063.stdout:2/463: sync 2024-09-17T01:56:28.922 INFO:tasks.workunit.client.0.smithi063.stdout:9/500: sync 2024-09-17T01:56:28.922 INFO:tasks.workunit.client.0.smithi063.stdout:6/542: sync 2024-09-17T01:56:28.923 INFO:tasks.workunit.client.0.smithi063.stdout:3/542: sync 2024-09-17T01:56:28.923 INFO:tasks.workunit.client.0.smithi063.stdout:0/537: sync 2024-09-17T01:56:28.923 INFO:tasks.workunit.client.0.smithi063.stdout:4/663: sync 2024-09-17T01:56:28.923 INFO:tasks.workunit.client.0.smithi063.stdout:8/495: sync 2024-09-17T01:56:28.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/587: sync 2024-09-17T01:56:28.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/527: fsync d2/fb 0 2024-09-17T01:56:28.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/588: fsync d6/d23/d29/d2b/fb7 0 2024-09-17T01:56:28.926 INFO:tasks.workunit.client.0.smithi063.stdout:6/543: mknod dc/d14/d65/cb0 0 2024-09-17T01:56:28.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/543: write df/d12/d43/d50/d58/f81 [642867,9024] 0 2024-09-17T01:56:28.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/496: write d1/f2e [1298379,127537] 0 2024-09-17T01:56:28.926 INFO:tasks.workunit.client.0.smithi063.stdout:9/501: chown d9/de/c57 3 1 2024-09-17T01:56:28.926 INFO:tasks.workunit.client.0.smithi063.stdout:0/538: symlink d1/d3/lbd 0 2024-09-17T01:56:28.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/664: write de/d17/d1b/f32 [791379,82916] 0 2024-09-17T01:56:28.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/464: rename d3/d7/df/d68/c5f to d3/d28/d72/c86 0 2024-09-17T01:56:28.927 INFO:tasks.workunit.client.0.smithi063.stdout:6/544: stat dc/d14/d19/d20/d66/l96 0 2024-09-17T01:56:28.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/589: creat d6/d37/d19/d50/d98/fba x:0 0 0 2024-09-17T01:56:28.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/544: mkdir df/d12/d30/db8 0 2024-09-17T01:56:28.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/539: dread - d1/d3/db/d4b/f45 zero size 2024-09-17T01:56:28.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/665: mkdir de/d2d/d3c/dd3 0 2024-09-17T01:56:28.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/502: mknod d9/d8d/d2a/cb3 0 2024-09-17T01:56:28.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/590: mkdir d6/d9/d32/dbb 0 2024-09-17T01:56:28.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/666: write de/d17/d1b/d9e/fae [1180683,86092] 0 2024-09-17T01:56:28.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/591: write d6/d23/d29/d36/f7d [509056,91135] 0 2024-09-17T01:56:28.929 INFO:tasks.workunit.client.0.smithi063.stdout:2/465: symlink d3/d7/df/l87 0 2024-09-17T01:56:28.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/503: rmdir d9/de/d20/d37/d42/d4c 39 2024-09-17T01:56:28.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/592: fdatasync d6/d9/f40 0 2024-09-17T01:56:28.930 INFO:tasks.workunit.client.0.smithi063.stdout:4/667: mknod de/d17/d36/dbe/d9a/cd4 0 2024-09-17T01:56:28.931 INFO:tasks.workunit.client.0.smithi063.stdout:9/504: dread - d9/de/d33/f88 zero size 2024-09-17T01:56:28.931 INFO:tasks.workunit.client.0.smithi063.stdout:2/466: mknod d3/d7/df/d30/c88 0 2024-09-17T01:56:28.932 INFO:tasks.workunit.client.0.smithi063.stdout:4/668: write de/d17/d36/d70/fa9 [1156605,6533] 0 2024-09-17T01:56:28.934 INFO:tasks.workunit.client.0.smithi063.stdout:9/505: symlink d9/de/d20/d1b/d25/lb4 0 2024-09-17T01:56:28.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/593: read d6/d23/d29/d2b/d4f/f52 [2728234,100653] 0 2024-09-17T01:56:28.934 INFO:tasks.workunit.client.0.smithi063.stdout:2/467: symlink d3/d7/df/d5a/l89 0 2024-09-17T01:56:28.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/675: dread d0/d2d/d35/d3f/d4e/f5d [0,4194304] 0 2024-09-17T01:56:28.937 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:28.941+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:28.937 INFO:tasks.workunit.client.0.smithi063.stdout:9/506: creat d9/de/d20/d37/d42/d7f/fb5 x:0 0 0 2024-09-17T01:56:28.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/545: dwrite df/d12/d43/fb4 [0,4194304] 0 2024-09-17T01:56:28.938 INFO:tasks.workunit.client.0.smithi063.stdout:2/468: chown d3/d7/df/d68/f46 6 1 2024-09-17T01:56:28.938 INFO:tasks.workunit.client.0.smithi063.stdout:1/676: dread - d0/d2d/d35/d3f/d81/d50/d6c/fd3 zero size 2024-09-17T01:56:28.940 INFO:tasks.workunit.client.0.smithi063.stdout:4/669: dread de/d2d/f64 [0,4194304] 0 2024-09-17T01:56:28.941 INFO:tasks.workunit.client.0.smithi063.stdout:3/546: mknod df/d12/d43/d50/d58/d97/cb9 0 2024-09-17T01:56:28.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/507: mknod d9/d8d/d2a/cb6 0 2024-09-17T01:56:28.941 INFO:tasks.workunit.client.0.smithi063.stdout:1/677: symlink d0/d2d/d35/leb 0 2024-09-17T01:56:28.942 INFO:tasks.workunit.client.0.smithi063.stdout:4/670: rmdir de/d17/d1b/dc7/d28/d8b 39 2024-09-17T01:56:28.943 INFO:tasks.workunit.client.0.smithi063.stdout:3/547: creat df/d12/d43/d50/d87/fba x:0 0 0 2024-09-17T01:56:28.943 INFO:tasks.workunit.client.0.smithi063.stdout:9/508: write d9/f5b [4665671,25036] 0 2024-09-17T01:56:28.944 INFO:tasks.workunit.client.0.smithi063.stdout:5/594: dwrite d6/d23/d29/d36/f97 [0,4194304] 0 2024-09-17T01:56:28.945 INFO:tasks.workunit.client.0.smithi063.stdout:9/509: write f7 [5575664,1243] 0 2024-09-17T01:56:28.946 INFO:tasks.workunit.client.0.smithi063.stdout:7/528: dread d2/d3/d67/f10 [0,4194304] 0 2024-09-17T01:56:28.946 INFO:tasks.workunit.client.0.smithi063.stdout:3/548: stat df/d12/d43/d50/d58/d97/daa 0 2024-09-17T01:56:28.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/510: dread - d9/de/d20/d37/d42/f93 zero size 2024-09-17T01:56:28.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/595: write d6/d23/d29/d36/f7d [452322,41655] 0 2024-09-17T01:56:28.947 INFO:tasks.workunit.client.0.smithi063.stdout:1/678: mknod d0/d2d/d35/d3f/d81/d50/d6c/d90/cec 0 2024-09-17T01:56:28.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/545: dread dc/d1b/f29 [4194304,4194304] 0 2024-09-17T01:56:28.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/529: rmdir d2/d15/d2f/d52/d97 39 2024-09-17T01:56:28.949 INFO:tasks.workunit.client.0.smithi063.stdout:6/546: creat dc/d14/d18/d74/fb1 x:0 0 0 2024-09-17T01:56:28.949 INFO:tasks.workunit.client.0.smithi063.stdout:9/511: write d9/de/d20/d37/d42/f93 [590655,118458] 0 2024-09-17T01:56:28.949 INFO:tasks.workunit.client.0.smithi063.stdout:3/549: read df/d12/d2d/f40 [1200808,48421] 0 2024-09-17T01:56:28.950 INFO:tasks.workunit.client.0.smithi063.stdout:4/671: dread de/d17/d1b/dc7/d28/d30/f7b [0,4194304] 0 2024-09-17T01:56:28.951 INFO:tasks.workunit.client.0.smithi063.stdout:3/550: write df/d12/d1e/d39/f6c [74081,62873] 0 2024-09-17T01:56:28.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/530: truncate d2/d15/d2f/d52/f68 5129455 0 2024-09-17T01:56:28.952 INFO:tasks.workunit.client.0.smithi063.stdout:8/497: dread d1/d7/d28/d2a/f8d [0,4194304] 0 2024-09-17T01:56:28.952 INFO:tasks.workunit.client.0.smithi063.stdout:9/512: rename d9/de/d20/d37/d42/d7e to d9/de/d20/d1b/db7 0 2024-09-17T01:56:28.953 INFO:tasks.workunit.client.0.smithi063.stdout:3/551: mkdir df/d12/d43/d50/d87/dbb 0 2024-09-17T01:56:28.953 INFO:tasks.workunit.client.0.smithi063.stdout:8/498: fdatasync d1/d7/d28/d2a/d37/d3a/d75/d9a/f7b 0 2024-09-17T01:56:28.954 INFO:tasks.workunit.client.0.smithi063.stdout:3/552: fsync df/d12/f16 0 2024-09-17T01:56:28.954 INFO:tasks.workunit.client.0.smithi063.stdout:7/531: symlink d2/d3/d27/d33/d7b/d9b/laa 0 2024-09-17T01:56:28.954 INFO:tasks.workunit.client.0.smithi063.stdout:3/553: fdatasync df/d12/d1e/d5e/f9c 0 2024-09-17T01:56:28.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/499: read - d1/d7/d28/d2a/d44/f73 zero size 2024-09-17T01:56:28.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/500: fsync d1/f5c 0 2024-09-17T01:56:28.955 INFO:tasks.workunit.client.0.smithi063.stdout:3/554: unlink df/d12/d43/d50/lb3 0 2024-09-17T01:56:28.956 INFO:tasks.workunit.client.0.smithi063.stdout:8/501: chown d1/d7/d28/d2a/d4d/f6b 66892364 1 2024-09-17T01:56:28.956 INFO:tasks.workunit.client.0.smithi063.stdout:1/679: truncate d0/d1c/f5c 2054652 0 2024-09-17T01:56:28.957 INFO:tasks.workunit.client.0.smithi063.stdout:3/555: mknod df/d28/cbc 0 2024-09-17T01:56:28.957 INFO:tasks.workunit.client.0.smithi063.stdout:1/680: stat d0/d2d/d35/d3f/cad 0 2024-09-17T01:56:28.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/596: dread d6/d9/d13/d1d/f56 [0,4194304] 0 2024-09-17T01:56:28.959 INFO:tasks.workunit.client.0.smithi063.stdout:3/556: creat df/d12/d43/d50/d58/fbd x:0 0 0 2024-09-17T01:56:28.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/681: mknod d0/d1c/db1/ced 0 2024-09-17T01:56:28.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/513: dwrite d9/de/d20/d1b/f9c [0,4194304] 0 2024-09-17T01:56:28.962 INFO:tasks.workunit.client.0.smithi063.stdout:1/682: creat d0/d93/d9e/dca/fee x:0 0 0 2024-09-17T01:56:28.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/540: sync 2024-09-17T01:56:28.963 INFO:tasks.workunit.client.0.smithi063.stdout:2/469: sync 2024-09-17T01:56:28.963 INFO:tasks.workunit.client.0.smithi063.stdout:6/547: sync 2024-09-17T01:56:28.963 INFO:tasks.workunit.client.0.smithi063.stdout:3/557: rename df/d12/d2d/d2f to df/d12/d43/d50/d87/dbb/dbe 0 2024-09-17T01:56:28.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/514: fsync d9/d8d/d2a/d40/f5c 0 2024-09-17T01:56:28.963 INFO:tasks.workunit.client.0.smithi063.stdout:2/470: stat d3/l1b 0 2024-09-17T01:56:28.964 INFO:tasks.workunit.client.0.smithi063.stdout:1/683: write d0/d1c/f48 [4591772,82783] 0 2024-09-17T01:56:28.964 INFO:tasks.workunit.client.0.smithi063.stdout:7/532: dwrite d2/d3/d22/d3a/f70 [0,4194304] 0 2024-09-17T01:56:28.964 INFO:tasks.workunit.client.0.smithi063.stdout:2/471: chown d3/d7/df/d68/f51 28 1 2024-09-17T01:56:28.965 INFO:tasks.workunit.client.0.smithi063.stdout:9/515: creat d9/de/d20/fb8 x:0 0 0 2024-09-17T01:56:28.966 INFO:tasks.workunit.client.0.smithi063.stdout:2/472: truncate d3/f79 1142784 0 2024-09-17T01:56:28.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/533: write d2/d3/d27/d65/f6d [2536620,57339] 0 2024-09-17T01:56:28.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/684: mkdir d0/d2d/d35/d3f/d81/d50/d6c/d74/def 0 2024-09-17T01:56:28.968 INFO:tasks.workunit.client.0.smithi063.stdout:9/516: creat d9/de/d20/d1b/db7/fb9 x:0 0 0 2024-09-17T01:56:28.968 INFO:tasks.workunit.client.0.smithi063.stdout:2/473: mknod d3/d28/d72/c8a 0 2024-09-17T01:56:28.968 INFO:tasks.workunit.client.0.smithi063.stdout:7/534: readlink d2/le 0 2024-09-17T01:56:28.969 INFO:tasks.workunit.client.0.smithi063.stdout:2/474: chown d3/d7/df/f1a 796141 1 2024-09-17T01:56:28.970 INFO:tasks.workunit.client.0.smithi063.stdout:6/548: link dc/d14/d65/c7c dc/d14/d65/cb2 0 2024-09-17T01:56:28.970 INFO:tasks.workunit.client.0.smithi063.stdout:1/685: readlink d0/d2d/d35/d3f/d81/l88 0 2024-09-17T01:56:28.970 INFO:tasks.workunit.client.0.smithi063.stdout:7/535: write d2/d3/d67/f10 [5413234,54474] 0 2024-09-17T01:56:28.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/541: chown d1/d44/la1 266522899 1 2024-09-17T01:56:28.970 INFO:tasks.workunit.client.0.smithi063.stdout:2/475: stat d3/d7/f34 0 2024-09-17T01:56:28.970 INFO:tasks.workunit.client.0.smithi063.stdout:9/517: mknod d9/de/cba 0 2024-09-17T01:56:28.971 INFO:tasks.workunit.client.0.smithi063.stdout:1/686: stat d0/d2d/d35/d6f/db7 0 2024-09-17T01:56:28.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/536: fdatasync d2/d3/f1e 0 2024-09-17T01:56:28.972 INFO:tasks.workunit.client.0.smithi063.stdout:3/558: dread df/d12/d2d/f4c [0,4194304] 0 2024-09-17T01:56:28.972 INFO:tasks.workunit.client.0.smithi063.stdout:7/537: truncate d2/d3/d27/d39/f46 9044617 0 2024-09-17T01:56:28.975 INFO:tasks.workunit.client.0.smithi063.stdout:1/687: unlink d0/d2d/d5e/lb0 0 2024-09-17T01:56:28.975 INFO:tasks.workunit.client.0.smithi063.stdout:7/538: creat d2/d15/d2f/d45/fab x:0 0 0 2024-09-17T01:56:28.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/542: getdents d1/d3/db/d4b 0 2024-09-17T01:56:28.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/543: chown d1/d1d/d74/d9a 464 1 2024-09-17T01:56:28.976 INFO:tasks.workunit.client.0.smithi063.stdout:1/688: write d0/d2d/d35/d3f/d81/d50/f9c [962171,47864] 0 2024-09-17T01:56:28.978 INFO:tasks.workunit.client.0.smithi063.stdout:7/539: getdents d2/d3/d27/d33/d7b/d9b 0 2024-09-17T01:56:28.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/544: creat d1/d3/db/d4b/d98/fbe x:0 0 0 2024-09-17T01:56:28.980 INFO:tasks.workunit.client.0.smithi063.stdout:2/476: dwrite d3/d7/df/f71 [0,4194304] 0 2024-09-17T01:56:28.980 INFO:tasks.workunit.client.0.smithi063.stdout:6/549: write dc/d14/d19/d20/f23 [5456611,61727] 0 2024-09-17T01:56:28.980 INFO:tasks.workunit.client.0.smithi063.stdout:2/477: stat l0 0 2024-09-17T01:56:28.982 INFO:tasks.workunit.client.0.smithi063.stdout:9/518: dwrite d9/de/d20/d1b/f9c [0,4194304] 0 2024-09-17T01:56:28.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/559: dwrite df/d12/d1e/d39/f7b [0,4194304] 0 2024-09-17T01:56:28.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/540: truncate d2/d15/d2f/d45/d84/f8c 468101 0 2024-09-17T01:56:28.982 INFO:tasks.workunit.client.0.smithi063.stdout:1/689: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/ff0 x:0 0 0 2024-09-17T01:56:28.983 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:28.983 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:28.983 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:28.983 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:28.983 INFO:tasks.workunit.client.0.smithi063.stdout:2/478: creat d3/d2a/f8b x:0 0 0 2024-09-17T01:56:28.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/545: mknod d1/d3/cbf 0 2024-09-17T01:56:28.984 INFO:tasks.workunit.client.0.smithi063.stdout:4/672: dread de/d17/d36/f7a [0,4194304] 0 2024-09-17T01:56:28.987 INFO:tasks.workunit.client.0.smithi063.stdout:3/560: mkdir df/d12/d1e/d39/dbf 0 2024-09-17T01:56:28.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/479: mkdir d3/d7/df/d5a/d8c 0 2024-09-17T01:56:28.987 INFO:tasks.workunit.client.0.smithi063.stdout:9/519: creat d9/de/d33/fbb x:0 0 0 2024-09-17T01:56:28.987 INFO:tasks.workunit.client.0.smithi063.stdout:4/673: symlink de/d17/d1b/d9b/ld5 0 2024-09-17T01:56:28.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/520: write d9/de/d20/d37/d42/f93 [36772,35334] 0 2024-09-17T01:56:28.988 INFO:tasks.workunit.client.0.smithi063.stdout:8/502: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/f30 [0,4194304] 0 2024-09-17T01:56:28.988 INFO:tasks.workunit.client.0.smithi063.stdout:3/561: write df/d12/d43/d50/d58/f5b [4413183,104895] 0 2024-09-17T01:56:28.989 INFO:tasks.workunit.client.0.smithi063.stdout:6/550: write dc/d14/d19/f2d [3021535,58638] 0 2024-09-17T01:56:28.990 INFO:tasks.workunit.client.0.smithi063.stdout:2/480: mkdir d3/d7/d8d 0 2024-09-17T01:56:28.990 INFO:tasks.workunit.client.0.smithi063.stdout:8/503: read d1/d7/d28/d2a/f8d [2469165,98619] 0 2024-09-17T01:56:28.990 INFO:tasks.workunit.client.0.smithi063.stdout:4/674: mknod de/d17/dc6/cd6 0 2024-09-17T01:56:28.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/551: creat dc/d14/d18/d91/fb3 x:0 0 0 2024-09-17T01:56:28.991 INFO:tasks.workunit.client.0.smithi063.stdout:0/546: getdents d1/d3/db/d18 0 2024-09-17T01:56:28.993 INFO:tasks.workunit.client.0.smithi063.stdout:7/541: dread d2/d3/d27/f32 [0,4194304] 0 2024-09-17T01:56:28.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/552: write dc/d14/f70 [792437,124669] 0 2024-09-17T01:56:28.994 INFO:tasks.workunit.client.0.smithi063.stdout:2/481: chown d3/d2a/f8b 462744 1 2024-09-17T01:56:28.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/553: unlink cb 0 2024-09-17T01:56:28.995 INFO:tasks.workunit.client.0.smithi063.stdout:4/675: getdents de/d17 0 2024-09-17T01:56:28.996 INFO:tasks.workunit.client.0.smithi063.stdout:2/482: readlink d3/d7/d38/l52 0 2024-09-17T01:56:28.997 INFO:tasks.workunit.client.0.smithi063.stdout:7/542: write d2/d3/d17/d25/f9f [571180,94641] 0 2024-09-17T01:56:28.997 INFO:tasks.workunit.client.0.smithi063.stdout:1/690: dwrite d0/f1a [0,4194304] 0 2024-09-17T01:56:28.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/483: chown d3/d7/df/d68 6 1 2024-09-17T01:56:28.998 INFO:tasks.workunit.client.0.smithi063.stdout:9/521: dwrite d9/d8d/d2a/f53 [0,4194304] 0 2024-09-17T01:56:28.999 INFO:tasks.workunit.client.0.smithi063.stdout:4/676: write de/d17/d36/d70/f8a [4667025,65839] 0 2024-09-17T01:56:28.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/554: write dc/d14/d19/d20/d32/d52/d5a/f40 [798809,24503] 0 2024-09-17T01:56:28.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/543: dread - d2/d15/d2f/d45/fab zero size 2024-09-17T01:56:28.999 INFO:tasks.workunit.client.0.smithi063.stdout:2/484: chown d3/d2a/f73 1555 1 2024-09-17T01:56:29.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/691: mknod d0/d93/cf1 0 2024-09-17T01:56:29.001 INFO:tasks.workunit.client.0.smithi063.stdout:9/522: creat d9/de/d20/d32/fbc x:0 0 0 2024-09-17T01:56:29.001 INFO:tasks.workunit.client.0.smithi063.stdout:7/544: rmdir d2/d3/d67/d8d 39 2024-09-17T01:56:29.001 INFO:tasks.workunit.client.0.smithi063.stdout:8/504: dwrite d1/d7/f14 [0,4194304] 0 2024-09-17T01:56:29.002 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:29.004 INFO:tasks.workunit.client.0.smithi063.stdout:4/677: write de/d17/d36/d70/f8a [2413681,101689] 0 2024-09-17T01:56:29.004 INFO:tasks.workunit.client.0.smithi063.stdout:9/523: unlink d9/de/c57 0 2024-09-17T01:56:29.004 INFO:tasks.workunit.client.0.smithi063.stdout:6/555: mkdir dc/d14/d19/d20/d32/d68/db4 0 2024-09-17T01:56:29.004 INFO:tasks.workunit.client.0.smithi063.stdout:5/597: dread d6/d23/d54/fb2 [0,4194304] 0 2024-09-17T01:56:29.004 INFO:tasks.workunit.client.0.smithi063.stdout:2/485: link d3/d7/d76/f7a d3/d7/df/d30/f8e 0 2024-09-17T01:56:29.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/486: truncate d3/d2a/f82 154870 0 2024-09-17T01:56:29.005 INFO:tasks.workunit.client.0.smithi063.stdout:7/545: link d2/d15/l1a d2/d3/d27/d33/d7b/d9b/da6/lac 0 2024-09-17T01:56:29.007 INFO:tasks.workunit.client.0.smithi063.stdout:6/556: rename dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f to dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/db5 22 2024-09-17T01:56:29.007 INFO:tasks.workunit.client.0.smithi063.stdout:8/505: dread - d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f8b zero size 2024-09-17T01:56:29.007 INFO:tasks.workunit.client.0.smithi063.stdout:9/524: getdents d9/de/d20 0 2024-09-17T01:56:29.007 INFO:tasks.workunit.client.0.smithi063.stdout:1/692: write d0/d2d/d35/d3f/d81/d50/d6c/de8/fd1 [3833254,81585] 0 2024-09-17T01:56:29.008 INFO:tasks.workunit.client.0.smithi063.stdout:9/525: read - d9/de/d20/d37/f9e zero size 2024-09-17T01:56:29.009 INFO:tasks.workunit.client.0.smithi063.stdout:6/557: rename dc/d14/d18/l37 to dc/d14/d19/d20/d32/d68/db4/lb6 0 2024-09-17T01:56:29.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/506: truncate d1/d7/d28/d2a/f5b 1261095 0 2024-09-17T01:56:29.010 INFO:tasks.workunit.client.0.smithi063.stdout:9/526: write d9/d8d/d2a/d36/f9d [855106,110265] 0 2024-09-17T01:56:29.010 INFO:tasks.workunit.client.0.smithi063.stdout:1/693: symlink d0/d2d/d35/d3f/d81/d50/d6c/de8/de9/lf2 0 2024-09-17T01:56:29.010 INFO:tasks.workunit.client.0.smithi063.stdout:5/598: getdents d6/d9/d32/d8c 0 2024-09-17T01:56:29.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/527: dread - d9/de/d20/fb8 zero size 2024-09-17T01:56:29.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/678: dwrite de/d17/d1b/dc7/f96 [0,4194304] 0 2024-09-17T01:56:29.012 INFO:tasks.workunit.client.0.smithi063.stdout:5/599: symlink d6/d23/d3f/lbc 0 2024-09-17T01:56:29.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/694: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ff3 x:0 0 0 2024-09-17T01:56:29.014 INFO:tasks.workunit.client.0.smithi063.stdout:9/528: symlink d9/de/d20/d37/lbd 0 2024-09-17T01:56:29.014 INFO:tasks.workunit.client.0.smithi063.stdout:8/507: link d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/c46 d1/d7/d28/d2a/d37/d3a/d85/c9b 0 2024-09-17T01:56:29.015 INFO:tasks.workunit.client.0.smithi063.stdout:1/695: symlink d0/d2d/d5e/dd8/lf4 0 2024-09-17T01:56:29.016 INFO:tasks.workunit.client.0.smithi063.stdout:8/508: mkdir d1/d7/d1d/d9c 0 2024-09-17T01:56:29.016 INFO:tasks.workunit.client.0.smithi063.stdout:4/679: link de/d17/d1b/dc7/d28/d8b/lce de/d2d/d52/ld7 0 2024-09-17T01:56:29.018 INFO:tasks.workunit.client.0.smithi063.stdout:4/680: write de/d17/d36/f94 [537526,129511] 0 2024-09-17T01:56:29.018 INFO:tasks.workunit.client.0.smithi063.stdout:3/562: dwrite df/d12/f2e [4194304,4194304] 0 2024-09-17T01:56:29.020 INFO:tasks.workunit.client.0.smithi063.stdout:3/563: write df/d12/d43/d50/d58/d97/fb7 [993268,26042] 0 2024-09-17T01:56:29.022 INFO:tasks.workunit.client.0.smithi063.stdout:8/509: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/l7e to d1/d7/d28/d2a/d37/d3a/d75/l9d 0 2024-09-17T01:56:29.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/600: read d6/d23/d69/f7a [972362,82188] 0 2024-09-17T01:56:29.030 INFO:tasks.workunit.client.0.smithi063.stdout:2/487: dread d3/d7/d76/f77 [0,4194304] 0 2024-09-17T01:56:29.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/547: truncate f0 2245510 0 2024-09-17T01:56:29.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/696: dread d0/d2d/d35/f7f [0,4194304] 0 2024-09-17T01:56:29.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/697: chown d0/d2d/d35 376210 1 2024-09-17T01:56:29.036 INFO:tasks.workunit.client.0.smithi063.stdout:0/548: creat d1/d1d/da5/fc0 x:0 0 0 2024-09-17T01:56:29.036 INFO:tasks.workunit.client.0.smithi063.stdout:0/549: fdatasync d1/d1d/d6d/f94 0 2024-09-17T01:56:29.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/698: write d0/d2d/d35/d3f/d81/f45 [1317053,39275] 0 2024-09-17T01:56:29.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/699: stat d0/d2d/d5e/l60 0 2024-09-17T01:56:29.041 INFO:tasks.workunit.client.0.smithi063.stdout:1/700: unlink d0/d1c/c5b 0 2024-09-17T01:56:29.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/558: dread dc/d14/d19/d20/f23 [0,4194304] 0 2024-09-17T01:56:29.042 INFO:tasks.workunit.client.0.smithi063.stdout:1/701: chown d0/d2d/d35/d6f/lb6 462580 1 2024-09-17T01:56:29.043 INFO:tasks.workunit.client.0.smithi063.stdout:6/559: symlink dc/d14/d19/d20/d32/d52/lb7 0 2024-09-17T01:56:29.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/529: dread d9/d8d/f46 [0,4194304] 0 2024-09-17T01:56:29.044 INFO:tasks.workunit.client.0.smithi063.stdout:0/550: dwrite d1/d3/d1b/f29 [0,4194304] 0 2024-09-17T01:56:29.045 INFO:tasks.workunit.client.0.smithi063.stdout:7/546: truncate d2/d3/d27/d39/f4e 579447 0 2024-09-17T01:56:29.046 INFO:tasks.workunit.client.0.smithi063.stdout:0/551: fdatasync d1/d3/d1b/f54 0 2024-09-17T01:56:29.047 INFO:tasks.workunit.client.0.smithi063.stdout:6/560: mkdir dc/d14/d19/d20/d32/d52/d5a/d97/db8 0 2024-09-17T01:56:29.047 INFO:tasks.workunit.client.0.smithi063.stdout:7/547: symlink d2/d15/d2f/d47/lad 0 2024-09-17T01:56:29.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/530: unlink d9/d8d/d75/lae 0 2024-09-17T01:56:29.049 INFO:tasks.workunit.client.0.smithi063.stdout:7/548: creat d2/d15/d2f/d45/d84/fae x:0 0 0 2024-09-17T01:56:29.049 INFO:tasks.workunit.client.0.smithi063.stdout:7/549: chown d2/d3/l8 168268747 1 2024-09-17T01:56:29.051 INFO:tasks.workunit.client.0.smithi063.stdout:1/702: dwrite d0/d2d/d35/d9d/fa8 [4194304,4194304] 0 2024-09-17T01:56:29.051 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:29.053+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:29.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/488: dread d3/f44 [0,4194304] 0 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 56, 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "7af2c608-be6c-4ac4-a462-cff6aa13e357", 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-17T01:54:21.836260+0000", 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-17T01:56:28.358430+0000", 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-17T01:56:19.298653+0000", 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-17T01:54:23.678756+0000", 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5806080, 2024-09-17T01:56:29.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "nodeep-scrub", 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "noscrub", 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 4, 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T01:56:29.054 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 3, 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "luminous", 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-17T01:56:29.055 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:32.050776+0000", 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:29.056 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-17T01:56:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:29.058 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "11", 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:29.059 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:29.060 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:29.061 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 3.0299999713897705, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 3.0299999713897705, 2024-09-17T01:56:29.062 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.33000001311302185, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:38.032150+0000", 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-17T01:56:29.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:29.064 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:29.065 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "15", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 2, 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 15, 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:29.066 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:29.067 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:29.068 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.8700000047683716, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.8700000047683716, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.25, 2024-09-17T01:56:29.069 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.25, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.055353+0000", 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:29.070 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-17T01:56:29.071 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:29.072 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:29.073 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:29.074 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:29.075 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:56:29.076 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-17T01:56:29.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.076 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:29.076 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:29.077 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.690000057220459, 2024-09-17T01:56:29.077 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.690000057220459, 2024-09-17T01:56:29.077 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.078 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-17T01:56:29.079 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-17T01:56:29.079 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-17T01:54:43.558395+0000", 2024-09-17T01:56:29.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-17T01:56:29.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-17T01:56:29.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-17T01:56:29.079 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-17T01:56:29.080 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-17T01:56:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "19", 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-17T01:56:29.082 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-17T01:56:29.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-17T01:56:29.084 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5399999618530273, 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5399999618530273, 2024-09-17T01:56:29.085 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.67000001668930054, 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.0299999713897705, 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.0299999713897705, 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "321981a6-5caa-44f3-b6ae-aa4e97947db6", 2024-09-17T01:56:29.086 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 52, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.087 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6800", 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6801", 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6802", 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6803", 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6806", 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6807", 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6804", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.96:6805", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1783419646 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.96:6801/1783419646", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.96:6803/1783419646", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.96:6807/1783419646", 2024-09-17T01:56:29.091 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.96:6805/1783419646", 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "36930e57-781c-48b6-a499-40cb00df2f38", 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:56:29.092 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 52, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6800", 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6801", 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6802", 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6803", 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6806", 2024-09-17T01:56:29.095 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6807", 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6804", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.98:6805", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3191117572 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.98:6801/3191117572", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.98:6803/3191117572", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3191117572", 2024-09-17T01:56:29.097 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3191117572", 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5a5a5a07-1fcd-4160-a4b1-e8431052e44c", 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 0, 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-17T01:56:29.098 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 8, 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 43, 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 52, 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6800", 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6801", 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6802", 2024-09-17T01:56:29.100 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6803", 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.101 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6806", 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6807", 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-17T01:56:29.102 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6804", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.154:6805", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 495067980 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.154:6801/495067980", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.154:6803/495067980", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.154:6807/495067980", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.154:6805/495067980", 2024-09-17T01:56:29.103 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "exists" 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:56:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.631084+0000", 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.623706+0000", 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-17T01:54:29.711322+0000", 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 51 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [ 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.106 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.2", 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: 2, 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: 1 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "4.2d", 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: 1, 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: 0 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-17T01:56:29.107 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-17T01:56:29.108 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-17T01:56:29.109 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-17T01:56:29.110 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T01:56:29.110 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:4/681: write de/d2d/f43 [55695,13565] 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/703: creat d0/d2d/d35/d3f/d81/d50/d6c/d90/ff5 x:0 0 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:7/550: dwrite d2/d15/d2f/d45/d48/f78 [0,4194304] 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/704: symlink d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/lf6 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:5/601: dwrite d6/d9/d13/d1d/f56 [0,4194304] 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:7/551: write d2/d3/d22/d3a/f88 [805464,15371] 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/510: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f4a 2022200 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:5/602: rename d6/d9/d32 to d6/d9/d32/d8c/da7/dbd 22 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:6/561: getdents dc/d14/d19/d20/d32/d52/d5a/d97 0 2024-09-17T01:56:29.114 INFO:tasks.workunit.client.0.smithi063.stdout:7/552: dread d2/d15/d2f/d45/d84/f8c [0,4194304] 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:6/562: mknod dc/d14/d19/d20/d32/d52/d5a/cb9 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:7/553: fdatasync d2/d15/d2f/f64 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/511: rename d1/d7/d28/d2a/d59/l97 to d1/d7/d28/d2a/d37/d3a/d75/d9a/l9e 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:7/554: dread - d2/d3/d27/d39/f8a zero size 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:6/563: fsync dc/d14/d19/d20/f23 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/512: write d1/d7/d28/f42 [609503,102036] 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/513: creat d1/d7/d28/f9f x:0 0 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:4/682: dwrite de/d17/d36/f5b [0,4194304] 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:5/603: dwrite d6/d23/d29/d36/f5b [4194304,4194304] 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/514: symlink d1/d7/d28/d2a/d37/d3a/d75/la0 0 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:5/604: chown d6/d23/d3f/c47 65463 1 2024-09-17T01:56:29.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/515: rmdir d1/d7/d28/d2a/d37 39 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/605: rmdir d6/d9 39 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/683: creat de/d17/d36/dbe/dbc/fd8 x:0 0 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:7/555: dwrite d2/d15/d2f/d45/d84/fae [0,4194304] 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/564: sync 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/565: creat df/d12/d1e/d53/fc0 x:0 0 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/566: creat df/d12/d30/d8a/fc1 x:0 0 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/606: dwrite d6/d23/d29/d2b/fa2 [0,4194304] 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:7/556: dwrite d2/fd [8388608,4194304] 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/567: mknod df/d12/d30/d8a/cc2 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/607: unlink d6/d37/d19/l4b 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:7/557: rmdir d2/d15/d2f/d45/d84 39 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/684: dwrite de/fb2 [0,4194304] 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/568: mkdir df/d12/d43/d50/d58/dc3 0 2024-09-17T01:56:29.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/608: creat d6/d37/d19/d68/fbe x:0 0 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:7/558: write d2/d3/d22/d3a/f88 [271979,91485] 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:4/685: write de/f10 [5505786,115754] 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:4/686: fdatasync de/d17/f68 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:4/687: mknod de/d2d/d3c/cd9 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:7/559: creat d2/d3/d27/d8f/faf x:0 0 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:3/569: link df/d12/d1e/d5e/f9c df/d83/fc4 0 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:7/560: chown d2/d3/d22/d3a/f70 159 1 2024-09-17T01:56:29.117 INFO:tasks.workunit.client.0.smithi063.stdout:3/570: readlink df/d12/d1e/d53/l78 0 2024-09-17T01:56:29.119 INFO:tasks.thrashosds.thrasher:j is {'epoch': 56, 'fsid': '7af2c608-be6c-4ac4-a462-cff6aa13e357', 'created': '2024-09-17T01:54:21.836260+0000', 'modified': '2024-09-17T01:56:28.358430+0000', 'last_up_change': '2024-09-17T01:56:19.298653+0000', 'last_in_change': '2024-09-17T01:54:23.678756+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:54:32.050776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T01:54:38.032150+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T01:54:43.055353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T01:54:43.558395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '321981a6-5caa-44f3-b6ae-aa4e97947db6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6800', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6801', 'nonce': 1783419646}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 1783419646}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6806', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6807', 'nonce': 1783419646}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6804', 'nonce': 1783419646}, {'type': 'v1', 'addr': '172.21.15.96:6805', 'nonce': 1783419646}]}, 'public_addr': '172.21.15.96:6801/1783419646', 'cluster_addr': '172.21.15.96:6803/1783419646', 'heartbeat_back_addr': '172.21.15.96:6807/1783419646', 'heartbeat_front_addr': '172.21.15.96:6805/1783419646', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '36930e57-781c-48b6-a499-40cb00df2f38', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3191117572}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3191117572}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3191117572}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3191117572}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3191117572}]}, 'public_addr': '172.21.15.98:6801/3191117572', 'cluster_addr': '172.21.15.98:6803/3191117572', 'heartbeat_back_addr': '172.21.15.98:6807/3191117572', 'heartbeat_front_addr': '172.21.15.98:6805/3191117572', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5a5a5a07-1fcd-4160-a4b1-e8431052e44c', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 43, 'down_at': 52, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 495067980}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 495067980}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 495067980}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 495067980}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 495067980}]}, 'public_addr': '172.21.15.154:6801/495067980', 'cluster_addr': '172.21.15.154:6803/495067980', 'heartbeat_back_addr': '172.21.15.154:6807/495067980', 'heartbeat_front_addr': '172.21.15.154:6805/495067980', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.631084+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.623706+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T01:54:29.711322+0000', 'dead_epoch': 51}], 'pg_upmap': [{'pgid': '3.2', 'osds': [2, 1]}, {'pgid': '4.2d', 'osds': [1, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T01:56:29.119 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.2d 2024-09-17T01:56:29.119 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 4.2d 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:3/571: mknod df/d28/cc5 0 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:1/705: truncate d0/f20 3420470 0 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:4/688: link de/d17/d1b/dc7/la4 de/d17/d1b/dc7/d28/d98/lda 0 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:5/609: dwrite d6/fd [4194304,4194304] 0 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:4/689: readlink de/d17/d1b/dc7/la0 0 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:1/706: rename d0/d2d/d35/d3f/d81/d50/d6c/c85 to d0/d2d/d35/d3f/d81/d50/d8b/cf7 0 2024-09-17T01:56:29.123 INFO:tasks.workunit.client.0.smithi063.stdout:5/610: creat d6/d23/d29/da3/fbf x:0 0 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:4/690: rename de/fb2 to de/d2d/fdb 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/611: dread - d6/d37/d19/d68/f78 zero size 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/516: dwrite d1/d7/d1d/f3e [0,4194304] 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/612: chown d6/d23/d29/d2b/da4 50519 1 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:4/691: link de/d17/d1b/dc7/d28/d30/l45 de/d17/d36/dbe/da6/ldc 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/613: write d6/d9/f45 [3619306,73891] 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/614: readlink d6/d23/d3a/l70 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/517: symlink d1/d7/d28/d2a/d37/d3a/d75/la1 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/615: write d6/d23/d69/f7a [4393574,100940] 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:4/692: stat de/d2d/d52/d9c/la8 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:4/693: chown de/d17/d36/c7e 52137002 1 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/616: write d6/d37/d19/d68/fad [914250,72846] 0 2024-09-17T01:56:29.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/518: getdents d1/d7/d28/d2a/d37/d3a/d75/d9a/d62 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/519: chown d1/d27/d81 15 1 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/707: read d0/f20 [3362388,32671] 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/708: chown d0/d2d/d35/d3f/d81/d50 3810 1 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/709: write d0/d2d/d35/d3f/d81/d50/f9c [65602,55014] 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/552: dread d1/d3/d32/f51 [0,4194304] 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/710: getdents d0/d2d/d35/d3f/d81/d50/d6c/d74 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/553: link d1/d1d/d74/d9a/c9c d1/d3/d1b/d50/cc1 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:4/694: dread de/f3b [4194304,4194304] 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/554: chown d1/d1d/f99 718045507 1 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:4/695: chown de/d2d 23831813 1 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/555: stat d1/d3/d1b/c8d 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/556: rmdir d1/d1d/da5 39 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/564: dread dc/d14/d2f/f5b [0,4194304] 0 2024-09-17T01:56:29.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/557: truncate d1/d1f/f77 583326 0 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/565: dread - dc/d14/d19/d20/d32/d52/d5a/f89 zero size 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/566: symlink dc/d14/d19/d20/d32/d68/db4/lba 0 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:1/711: dwrite d0/d93/d9e/dca/fd5 [0,4194304] 0 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/572: dread df/f63 [0,4194304] 0 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/567: creat dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/da1/fbb x:0 0 0 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/573: dread - df/d12/d3a/f9e zero size 2024-09-17T01:56:29.126 INFO:tasks.workunit.client.0.smithi063.stdout:0/558: dwrite d1/d3/db/d6e/d86/fb1 [0,4194304] 0 2024-09-17T01:56:29.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/712: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ff3 [0,4194304] 0 2024-09-17T01:56:29.127 INFO:tasks.workunit.client.0.smithi063.stdout:3/574: read df/f1c [1256440,84028] 0 2024-09-17T01:56:29.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/713: chown d0/d2d/d5e/l6d 7 1 2024-09-17T01:56:29.127 INFO:tasks.workunit.client.0.smithi063.stdout:6/568: dwrite dc/fa8 [0,4194304] 0 2024-09-17T01:56:29.128 INFO:tasks.workunit.client.0.smithi063.stdout:1/714: rmdir d0/d2d/d35/d3f/d81/d50/d6c/d90 39 2024-09-17T01:56:29.128 INFO:tasks.workunit.client.0.smithi063.stdout:6/569: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/dbc 0 2024-09-17T01:56:29.128 INFO:tasks.workunit.client.0.smithi063.stdout:3/575: creat df/d12/d2d/fc6 x:0 0 0 2024-09-17T01:56:29.133 INFO:tasks.workunit.client.0.smithi063.stdout:3/576: symlink df/d12/lc7 0 2024-09-17T01:56:29.133 INFO:tasks.workunit.client.0.smithi063.stdout:3/577: stat df/d12/c88 0 2024-09-17T01:56:29.133 INFO:tasks.workunit.client.0.smithi063.stdout:0/559: dwrite d1/f19 [4194304,4194304] 0 2024-09-17T01:56:29.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/560: dread - d1/d1d/d6d/f94 zero size 2024-09-17T01:56:29.135 INFO:tasks.workunit.client.0.smithi063.stdout:3/578: mknod df/d12/d43/cc8 0 2024-09-17T01:56:29.136 INFO:tasks.workunit.client.0.smithi063.stdout:3/579: unlink df/d28/c59 0 2024-09-17T01:56:29.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/561: rmdir d1/d3/db/d4b/d2f/d56 39 2024-09-17T01:56:29.136 INFO:tasks.workunit.client.0.smithi063.stdout:6/570: dread dc/d14/d19/d20/d32/d68/f78 [0,4194304] 0 2024-09-17T01:56:29.137 INFO:tasks.workunit.client.0.smithi063.stdout:1/715: dwrite d0/f8 [0,4194304] 0 2024-09-17T01:56:29.137 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:29.141+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:29.138 INFO:tasks.workunit.client.0.smithi063.stdout:6/571: write dc/d14/d19/d20/d32/d52/f80 [2797426,85545] 0 2024-09-17T01:56:29.138 INFO:tasks.workunit.client.0.smithi063.stdout:1/716: symlink d0/d2d/d35/d8c/lf8 0 2024-09-17T01:56:29.139 INFO:tasks.workunit.client.0.smithi063.stdout:6/572: unlink dc/d14/d19/d20/d32/d68/l93 0 2024-09-17T01:56:29.139 INFO:tasks.workunit.client.0.smithi063.stdout:1/717: getdents d0/d2d/d35/d9d 0 2024-09-17T01:56:29.140 INFO:tasks.workunit.client.0.smithi063.stdout:6/573: write dc/d14/d65/f7d [1056974,35979] 0 2024-09-17T01:56:29.141 INFO:tasks.workunit.client.0.smithi063.stdout:1/718: write d0/d2d/d35/d3f/d4e/f5f [7566331,92835] 0 2024-09-17T01:56:29.142 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:29.142 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:29.142 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:29.142 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:29.142 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:29.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/574: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/dbc/dbd 0 2024-09-17T01:56:29.143 INFO:tasks.workunit.client.0.smithi063.stdout:1/719: rename d0/d2d/d35/d3f/d81/l88 to d0/d2d/d35/d9d/de2/lf9 0 2024-09-17T01:56:29.143 INFO:tasks.workunit.client.0.smithi063.stdout:3/580: dwrite df/d12/d43/d50/d58/f9f [0,4194304] 0 2024-09-17T01:56:29.144 INFO:tasks.workunit.client.0.smithi063.stdout:6/575: write dc/d14/d18/f94 [1074201,106051] 0 2024-09-17T01:56:29.144 INFO:tasks.workunit.client.0.smithi063.stdout:3/581: dread - df/d12/d1e/f6e zero size 2024-09-17T01:56:29.145 INFO:tasks.workunit.client.0.smithi063.stdout:6/576: chown dc/d14/d19/d20 233966 1 2024-09-17T01:56:29.146 INFO:tasks.workunit.client.0.smithi063.stdout:6/577: chown dc/d14/d19/d20/d32/d52/d5a/d43/c90 3927185 1 2024-09-17T01:56:29.146 INFO:tasks.workunit.client.0.smithi063.stdout:0/562: dread d1/d3/d1b/f4f [0,4194304] 0 2024-09-17T01:56:29.147 INFO:tasks.workunit.client.0.smithi063.stdout:0/563: readlink d1/d1d/l20 0 2024-09-17T01:56:29.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/578: rename dc/d14/d19/d20/f83 to dc/d14/fbe 0 2024-09-17T01:56:29.148 INFO:tasks.workunit.client.0.smithi063.stdout:0/564: write d1/f3d [604298,111088] 0 2024-09-17T01:56:29.149 INFO:tasks.workunit.client.0.smithi063.stdout:6/579: readlink dc/d14/l17 0 2024-09-17T01:56:29.150 INFO:tasks.workunit.client.0.smithi063.stdout:7/561: dread d2/d3/d27/d39/d40/f6a [0,4194304] 0 2024-09-17T01:56:29.150 INFO:tasks.workunit.client.0.smithi063.stdout:6/580: mknod dc/d14/d19/d20/d32/d52/d5a/cbf 0 2024-09-17T01:56:29.151 INFO:tasks.workunit.client.0.smithi063.stdout:6/581: stat dc/d14/d19/d20/d32/d52/d5a/c7f 0 2024-09-17T01:56:29.152 INFO:tasks.workunit.client.0.smithi063.stdout:6/582: rename dc/d14/d18/f16 to dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/dbc/fc0 0 2024-09-17T01:56:29.153 INFO:tasks.workunit.client.0.smithi063.stdout:6/583: truncate dc/f38 2322495 0 2024-09-17T01:56:29.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/562: dwrite d2/d3/d27/d39/d40/f50 [0,4194304] 0 2024-09-17T01:56:29.158 INFO:tasks.workunit.client.0.smithi063.stdout:1/720: truncate d0/f4 3802879 0 2024-09-17T01:56:29.160 INFO:tasks.workunit.client.0.smithi063.stdout:7/563: write d2/d3/d27/d33/d7b/fa3 [400065,23005] 0 2024-09-17T01:56:29.163 INFO:tasks.workunit.client.0.smithi063.stdout:6/584: dwrite dc/d14/d19/d20/f71 [0,4194304] 0 2024-09-17T01:56:29.164 INFO:tasks.workunit.client.0.smithi063.stdout:3/582: dread df/d12/d30/f32 [0,4194304] 0 2024-09-17T01:56:29.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/721: truncate d0/d2d/fc2 2410914 0 2024-09-17T01:56:29.166 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:29.167 INFO:tasks.workunit.client.0.smithi063.stdout:3/583: creat df/d12/d30/db8/fc9 x:0 0 0 2024-09-17T01:56:29.167 INFO:tasks.workunit.client.0.smithi063.stdout:6/585: chown dc/d14/d19/d20/d32/l67 268101302 1 2024-09-17T01:56:29.168 INFO:tasks.workunit.client.0.smithi063.stdout:7/564: dwrite d2/d3/d17/f79 [0,4194304] 0 2024-09-17T01:56:29.168 INFO:tasks.workunit.client.0.smithi063.stdout:3/584: mkdir df/d12/d1e/d53/dca 0 2024-09-17T01:56:29.171 INFO:tasks.workunit.client.0.smithi063.stdout:6/586: creat dc/d14/d19/d20/d32/d52/d5a/d62/fc1 x:0 0 0 2024-09-17T01:56:29.171 INFO:tasks.workunit.client.0.smithi063.stdout:3/585: symlink df/d12/d43/d50/d58/d97/daa/lcb 0 2024-09-17T01:56:29.171 INFO:tasks.workunit.client.0.smithi063.stdout:1/722: write d0/f20 [1655378,40370] 0 2024-09-17T01:56:29.171 INFO:tasks.workunit.client.0.smithi063.stdout:0/565: dread d1/d3/db/f42 [4194304,4194304] 0 2024-09-17T01:56:29.171 INFO:tasks.workunit.client.0.smithi063.stdout:3/586: chown df/d12/d3a/f51 15055162 1 2024-09-17T01:56:29.172 INFO:tasks.workunit.client.0.smithi063.stdout:0/566: dread - d1/d3/db/d6e/fa4 zero size 2024-09-17T01:56:29.172 INFO:tasks.workunit.client.0.smithi063.stdout:6/587: fdatasync dc/d14/d19/d20/d32/d52/d5a/d43/f86 0 2024-09-17T01:56:29.172 INFO:tasks.workunit.client.0.smithi063.stdout:1/723: read d0/d2d/d35/d6f/fc0 [363299,40594] 0 2024-09-17T01:56:29.173 INFO:tasks.workunit.client.0.smithi063.stdout:0/567: fsync d1/f19 0 2024-09-17T01:56:29.173 INFO:tasks.workunit.client.0.smithi063.stdout:2/489: sync 2024-09-17T01:56:29.173 INFO:tasks.workunit.client.0.smithi063.stdout:9/531: sync 2024-09-17T01:56:29.173 INFO:tasks.workunit.client.0.smithi063.stdout:1/724: stat d0/d2d/d35/leb 0 2024-09-17T01:56:29.174 INFO:tasks.workunit.client.0.smithi063.stdout:3/587: mkdir df/d12/d43/d50/d58/d97/daa/db1/dcc 0 2024-09-17T01:56:29.174 INFO:tasks.workunit.client.0.smithi063.stdout:0/568: readlink d1/d3/db/d18/d85/da8/lba 0 2024-09-17T01:56:29.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/532: mkdir d9/de/d20/d37/d42/dbe 0 2024-09-17T01:56:29.175 INFO:tasks.workunit.client.0.smithi063.stdout:6/588: mknod dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/da1/cc2 0 2024-09-17T01:56:29.176 INFO:tasks.workunit.client.0.smithi063.stdout:1/725: write d0/d93/d9e/dca/fee [490923,130674] 0 2024-09-17T01:56:29.176 INFO:tasks.workunit.client.0.smithi063.stdout:0/569: creat d1/d3/db/d18/d85/fc2 x:0 0 0 2024-09-17T01:56:29.177 INFO:tasks.workunit.client.0.smithi063.stdout:2/490: read d3/d7/df/d68/f51 [4009854,13643] 0 2024-09-17T01:56:29.177 INFO:tasks.workunit.client.0.smithi063.stdout:7/565: dwrite d2/d3/d67/f7c [0,4194304] 0 2024-09-17T01:56:29.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/588: write fe [1402663,10266] 0 2024-09-17T01:56:29.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/570: unlink d1/d3/fa9 0 2024-09-17T01:56:29.180 INFO:tasks.workunit.client.0.smithi063.stdout:9/533: truncate d9/de/d20/d1b/d25/f4e 5119979 0 2024-09-17T01:56:29.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/589: chown df/d83/cb6 7655 1 2024-09-17T01:56:29.181 INFO:tasks.workunit.client.0.smithi063.stdout:0/571: rmdir d1/d3/db/d18/d43 39 2024-09-17T01:56:29.181 INFO:tasks.workunit.client.0.smithi063.stdout:9/534: mkdir d9/dbf 0 2024-09-17T01:56:29.181 INFO:tasks.workunit.client.0.smithi063.stdout:7/566: write d2/d3/d67/f75 [347905,72076] 0 2024-09-17T01:56:29.182 INFO:tasks.workunit.client.0.smithi063.stdout:0/572: symlink d1/d44/lc3 0 2024-09-17T01:56:29.182 INFO:tasks.workunit.client.0.smithi063.stdout:3/590: chown df/d12/c65 346638796 1 2024-09-17T01:56:29.183 INFO:tasks.workunit.client.0.smithi063.stdout:7/567: write d2/d15/d2f/d45/f69 [510856,72912] 0 2024-09-17T01:56:29.183 INFO:tasks.workunit.client.0.smithi063.stdout:9/535: symlink d9/de/d20/d37/lc0 0 2024-09-17T01:56:29.184 INFO:tasks.workunit.client.0.smithi063.stdout:3/591: creat df/d12/d43/d50/d87/dbb/dbe/fcd x:0 0 0 2024-09-17T01:56:29.184 INFO:tasks.workunit.client.0.smithi063.stdout:1/726: dwrite d0/d93/fd6 [0,4194304] 0 2024-09-17T01:56:29.184 INFO:tasks.workunit.client.0.smithi063.stdout:0/573: fsync d1/d3/db/d18/f5b 0 2024-09-17T01:56:29.184 INFO:tasks.workunit.client.0.smithi063.stdout:7/568: mkdir d2/d3/d17/d25/db0 0 2024-09-17T01:56:29.186 INFO:tasks.workunit.client.0.smithi063.stdout:3/592: dread - df/d12/d2d/f36 zero size 2024-09-17T01:56:29.186 INFO:tasks.workunit.client.0.smithi063.stdout:9/536: link d9/de/d33/f88 d9/d8d/d2a/d40/fc1 0 2024-09-17T01:56:29.186 INFO:tasks.workunit.client.0.smithi063.stdout:3/593: write df/d12/d1e/f6e [444110,112803] 0 2024-09-17T01:56:29.187 INFO:tasks.workunit.client.0.smithi063.stdout:2/491: truncate d3/d7/df/d43/f3b 3444677 0 2024-09-17T01:56:29.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/492: chown d3/d7/d76/l7f 1 1 2024-09-17T01:56:29.189 INFO:tasks.workunit.client.0.smithi063.stdout:3/594: link df/c22 df/d12/d1e/d5e/cce 0 2024-09-17T01:56:29.189 INFO:tasks.workunit.client.0.smithi063.stdout:2/493: mknod d3/d7/d76/c8f 0 2024-09-17T01:56:29.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/595: dread - df/d12/d2d/fc6 zero size 2024-09-17T01:56:29.191 INFO:tasks.workunit.client.0.smithi063.stdout:2/494: creat d3/d7/df/d30/f90 x:0 0 0 2024-09-17T01:56:29.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/596: creat df/d12/d1e/d5e/fcf x:0 0 0 2024-09-17T01:56:29.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/597: write f3 [3564840,104790] 0 2024-09-17T01:56:29.194 INFO:tasks.workunit.client.0.smithi063.stdout:7/569: dwrite d2/d3/d67/f75 [0,4194304] 0 2024-09-17T01:56:29.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/537: dwrite d9/de/d20/d37/f8e [0,4194304] 0 2024-09-17T01:56:29.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/570: write d2/f7d [4294282,4324] 0 2024-09-17T01:56:29.200 INFO:tasks.workunit.client.0.smithi063.stdout:2/495: dwrite d3/d7/df/f71 [0,4194304] 0 2024-09-17T01:56:29.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/727: dread d0/d2d/d35/d9d/fa8 [0,4194304] 0 2024-09-17T01:56:29.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/598: dwrite df/d12/d2d/f4a [0,4194304] 0 2024-09-17T01:56:29.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/538: dwrite d9/fc [0,4194304] 0 2024-09-17T01:56:29.207 INFO:tasks.workunit.client.0.smithi063.stdout:3/599: unlink df/d12/d1e/c29 0 2024-09-17T01:56:29.207 INFO:tasks.workunit.client.0.smithi063.stdout:9/539: fsync d9/de/d20/d37/d42/d4c/f90 0 2024-09-17T01:56:29.208 INFO:tasks.workunit.client.0.smithi063.stdout:1/728: getdents d0/d2d/d35/d3f/d81/d50/d6c/de8/de9 0 2024-09-17T01:56:29.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/589: dread dc/f38 [0,4194304] 0 2024-09-17T01:56:29.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/590: write dc/f1e [5029497,107329] 0 2024-09-17T01:56:29.209 INFO:tasks.workunit.client.0.smithi063.stdout:2/496: read d3/d7/df/f18 [668358,27080] 0 2024-09-17T01:56:29.211 INFO:tasks.workunit.client.0.smithi063.stdout:9/540: write d9/de/d20/fb8 [268371,19110] 0 2024-09-17T01:56:29.213 INFO:tasks.workunit.client.0.smithi063.stdout:3/600: rename df/d12/d43/d50/d58/f81 to df/fd0 0 2024-09-17T01:56:29.213 INFO:tasks.workunit.client.0.smithi063.stdout:2/497: creat d3/f91 x:0 0 0 2024-09-17T01:56:29.214 INFO:tasks.workunit.client.0.smithi063.stdout:3/601: mkdir df/d12/d30/dd1 0 2024-09-17T01:56:29.215 INFO:tasks.workunit.client.0.smithi063.stdout:1/729: rename d0/d2d/d35/d6f/l79 to d0/d1c/db1/dde/lfa 0 2024-09-17T01:56:29.216 INFO:tasks.workunit.client.0.smithi063.stdout:2/498: rmdir d3/d7/df/d43/d70 0 2024-09-17T01:56:29.216 INFO:tasks.workunit.client.0.smithi063.stdout:2/499: creat d3/d7/df/d30/f92 x:0 0 0 2024-09-17T01:56:29.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/602: write df/d12/d1e/f57 [623775,82904] 0 2024-09-17T01:56:29.217 INFO:tasks.workunit.client.0.smithi063.stdout:1/730: mknod d0/d2d/d35/d3f/d81/d50/d6c/de8/de9/cfb 0 2024-09-17T01:56:29.218 INFO:tasks.workunit.client.0.smithi063.stdout:2/500: chown d3/d7/d76/c8f 15562 1 2024-09-17T01:56:29.219 INFO:tasks.workunit.client.0.smithi063.stdout:6/591: dread dc/d14/d18/f94 [0,4194304] 0 2024-09-17T01:56:29.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/501: write d3/f44 [249157,70268] 0 2024-09-17T01:56:29.219 INFO:tasks.workunit.client.0.smithi063.stdout:3/603: rename df/d12/d30/f45 to df/d12/d30/d8a/fd2 0 2024-09-17T01:56:29.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/541: dwrite d9/de/d20/d37/f50 [0,4194304] 0 2024-09-17T01:56:29.220 INFO:tasks.workunit.client.0.smithi063.stdout:3/604: mknod df/d12/d43/d50/d87/cd3 0 2024-09-17T01:56:29.221 INFO:tasks.workunit.client.0.smithi063.stdout:6/592: creat dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/fc3 x:0 0 0 2024-09-17T01:56:29.221 INFO:tasks.workunit.client.0.smithi063.stdout:3/605: creat df/d12/d30/db8/fd4 x:0 0 0 2024-09-17T01:56:29.222 INFO:tasks.workunit.client.0.smithi063.stdout:6/593: write dc/d14/d19/d20/f8b [752001,97107] 0 2024-09-17T01:56:29.224 INFO:tasks.workunit.client.0.smithi063.stdout:3/606: truncate df/d12/d43/d50/d58/f75 4698418 0 2024-09-17T01:56:29.227 INFO:tasks.workunit.client.0.smithi063.stdout:3/607: unlink df/d12/d1e/d5e/l70 0 2024-09-17T01:56:29.227 INFO:tasks.workunit.client.0.smithi063.stdout:1/731: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a [0,4194304] 0 2024-09-17T01:56:29.228 INFO:tasks.workunit.client.0.smithi063.stdout:7/571: dread d2/d15/d2f/f3d [0,4194304] 0 2024-09-17T01:56:29.228 INFO:tasks.workunit.client.0.smithi063.stdout:3/608: fsync df/d12/d1e/d5e/f8d 0 2024-09-17T01:56:29.229 INFO:tasks.workunit.client.0.smithi063.stdout:0/574: dread d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:29.229 INFO:tasks.workunit.client.0.smithi063.stdout:7/572: write d2/d3/d17/d25/f9f [2327967,12683] 0 2024-09-17T01:56:29.229 INFO:tasks.workunit.client.0.smithi063.stdout:9/542: dwrite d9/de/d20/d1b/f2d [0,4194304] 0 2024-09-17T01:56:29.233 INFO:tasks.workunit.client.0.smithi063.stdout:2/502: dread d3/d7/df/d68/f74 [0,4194304] 0 2024-09-17T01:56:29.233 INFO:tasks.workunit.client.0.smithi063.stdout:3/609: truncate df/d12/d1e/f27 66878 0 2024-09-17T01:56:29.233 INFO:tasks.workunit.client.0.smithi063.stdout:7/573: mknod d2/d3/d67/cb1 0 2024-09-17T01:56:29.234 INFO:tasks.workunit.client.0.smithi063.stdout:7/574: fdatasync d2/d15/d2f/d45/f69 0 2024-09-17T01:56:29.234 INFO:tasks.workunit.client.0.smithi063.stdout:7/575: stat d2/d15/d2f/d45/d84 0 2024-09-17T01:56:29.235 INFO:tasks.workunit.client.0.smithi063.stdout:9/543: getdents d9/de/d20/d1b 0 2024-09-17T01:56:29.235 INFO:tasks.workunit.client.0.smithi063.stdout:7/576: fsync d2/d15/d2f/d45/f69 0 2024-09-17T01:56:29.235 INFO:tasks.workunit.client.0.smithi063.stdout:9/544: mkdir d9/d8d/d2a/d40/dac/dc2 0 2024-09-17T01:56:29.235 INFO:tasks.workunit.client.0.smithi063.stdout:7/577: creat d2/d3/d17/d25/db0/fb2 x:0 0 0 2024-09-17T01:56:29.236 INFO:tasks.workunit.client.0.smithi063.stdout:9/545: mknod d9/de/d20/d32/cc3 0 2024-09-17T01:56:29.236 INFO:tasks.workunit.client.0.smithi063.stdout:7/578: write d2/d3/d27/d39/d40/f50 [3197057,127460] 0 2024-09-17T01:56:29.236 INFO:tasks.workunit.client.0.smithi063.stdout:9/546: symlink d9/de/d20/d1b/lc4 0 2024-09-17T01:56:29.237 INFO:tasks.workunit.client.0.smithi063.stdout:7/579: rmdir d2/d15/d2f/d47 39 2024-09-17T01:56:29.237 INFO:tasks.workunit.client.0.smithi063.stdout:7/580: truncate d2/d15/f6b 976663 0 2024-09-17T01:56:29.238 INFO:tasks.workunit.client.0.smithi063.stdout:7/581: write d2/d3/d22/f77 [721176,104440] 0 2024-09-17T01:56:29.239 INFO:tasks.workunit.client.0.smithi063.stdout:7/582: creat d2/d15/d2f/d45/d48/fb3 x:0 0 0 2024-09-17T01:56:29.240 INFO:tasks.workunit.client.0.smithi063.stdout:7/583: symlink d2/d15/d2f/d45/d82/lb4 0 2024-09-17T01:56:29.240 INFO:tasks.workunit.client.0.smithi063.stdout:7/584: chown d2/d3/d27/d33/l6e 498 1 2024-09-17T01:56:29.241 INFO:tasks.workunit.client.0.smithi063.stdout:6/594: dread dc/d14/d18/f64 [0,4194304] 0 2024-09-17T01:56:29.244 INFO:tasks.workunit.client.0.smithi063.stdout:6/595: read dc/d14/d19/f2d [3150498,44650] 0 2024-09-17T01:56:29.245 INFO:tasks.workunit.client.0.smithi063.stdout:6/596: getdents dc/d14/d19/d20/d32/d68 0 2024-09-17T01:56:29.246 INFO:tasks.workunit.client.0.smithi063.stdout:6/597: creat dc/d14/fc4 x:0 0 0 2024-09-17T01:56:29.246 INFO:tasks.workunit.client.0.smithi063.stdout:9/547: truncate d9/de/fa6 873628 0 2024-09-17T01:56:29.247 INFO:tasks.workunit.client.0.smithi063.stdout:6/598: chown dc/d14/d19/d20/d32/d52/d5a/d43/c90 3 1 2024-09-17T01:56:29.247 INFO:tasks.workunit.client.0.smithi063.stdout:6/599: readlink l2 0 2024-09-17T01:56:29.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/548: creat d9/de/d20/d37/d42/fc5 x:0 0 0 2024-09-17T01:56:29.249 INFO:tasks.workunit.client.0.smithi063.stdout:6/600: mkdir dc/d14/d19/d20/d32/d52/d5a/d43/dc5 0 2024-09-17T01:56:29.250 INFO:tasks.workunit.client.0.smithi063.stdout:6/601: mkdir dc/d14/d19/d20/d32/d68/db4/dc6 0 2024-09-17T01:56:29.251 INFO:tasks.workunit.client.0.smithi063.stdout:6/602: mknod dc/d14/d19/d20/d32/d52/d5a/d62/d7e/cc7 0 2024-09-17T01:56:29.252 INFO:tasks.workunit.client.0.smithi063.stdout:6/603: mkdir dc/d14/d18/d74/dc8 0 2024-09-17T01:56:29.254 INFO:tasks.workunit.client.0.smithi063.stdout:6/604: getdents dc/d14/d19/d20 0 2024-09-17T01:56:29.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/549: dread d9/d8d/d2a/d40/f6c [0,4194304] 0 2024-09-17T01:56:29.255 INFO:tasks.workunit.client.0.smithi063.stdout:0/575: dread d1/d3/d10/f5a [0,4194304] 0 2024-09-17T01:56:29.255 INFO:tasks.workunit.client.0.smithi063.stdout:0/576: fsync d1/d3/d1b/f38 0 2024-09-17T01:56:29.255 INFO:tasks.workunit.client.0.smithi063.stdout:0/577: dread - d1/d1d/d6d/f94 zero size 2024-09-17T01:56:29.257 INFO:tasks.workunit.client.0.smithi063.stdout:0/578: getdents d1/d3/d10 0 2024-09-17T01:56:29.257 INFO:tasks.workunit.client.0.smithi063.stdout:7/585: dread d2/d15/d2f/d52/f68 [0,4194304] 0 2024-09-17T01:56:29.257 INFO:tasks.workunit.client.0.smithi063.stdout:7/586: mknod d2/d3/d27/d33/cb5 0 2024-09-17T01:56:29.258 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:29.261+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:29.258 INFO:tasks.workunit.client.0.smithi063.stdout:7/587: getdents d2/d15 0 2024-09-17T01:56:29.261 INFO:tasks.workunit.client.0.smithi063.stdout:9/550: truncate d9/de/d20/d37/d42/f6b 284090 0 2024-09-17T01:56:29.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/579: truncate d1/d3/db/d4b/d7d/f91 3034332 0 2024-09-17T01:56:29.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/580: rmdir d1/d3/db/d18 39 2024-09-17T01:56:29.263 INFO:tasks.workunit.client.0.smithi063.stdout:7/588: truncate d2/d15/d2f/d45/d48/f78 3362747 0 2024-09-17T01:56:29.263 INFO:tasks.workunit.client.0.smithi063.stdout:0/581: unlink d1/d3/db/d18/d33/l52 0 2024-09-17T01:56:29.264 INFO:tasks.workunit.client.0.smithi063.stdout:7/589: write d2/d15/d2f/d45/fab [647395,99353] 0 2024-09-17T01:56:29.265 INFO:tasks.workunit.client.0.smithi063.stdout:0/582: truncate d1/d44/d53/f8b 1090003 0 2024-09-17T01:56:29.265 INFO:tasks.workunit.client.0.smithi063.stdout:7/590: mkdir d2/d3/d22/db6 0 2024-09-17T01:56:29.266 INFO:tasks.workunit.client.0.smithi063.stdout:0/583: fdatasync d1/d3/db/d18/d33/f71 0 2024-09-17T01:56:29.266 INFO:tasks.workunit.client.0.smithi063.stdout:7/591: symlink d2/d3/d17/d25/db0/lb7 0 2024-09-17T01:56:29.267 INFO:tasks.workunit.client.0.smithi063.stdout:9/551: dwrite d9/de/d20/d1b/f6e [0,4194304] 0 2024-09-17T01:56:29.269 INFO:tasks.workunit.client.0.smithi063.stdout:7/592: creat d2/d3/fb8 x:0 0 0 2024-09-17T01:56:29.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/696: sync 2024-09-17T01:56:29.273 INFO:tasks.workunit.client.0.smithi063.stdout:5/617: sync 2024-09-17T01:56:29.273 INFO:tasks.workunit.client.0.smithi063.stdout:8/520: sync 2024-09-17T01:56:29.274 INFO:tasks.workunit.client.0.smithi063.stdout:8/521: fsync d1/d7/d28/d2a/d37/f7a 0 2024-09-17T01:56:29.275 INFO:tasks.workunit.client.0.smithi063.stdout:5/618: write d6/d9/d32/f71 [1478036,100153] 0 2024-09-17T01:56:29.275 INFO:tasks.workunit.client.0.smithi063.stdout:0/584: dwrite d1/d3/db/d18/d85/d92/f8c [0,4194304] 0 2024-09-17T01:56:29.277 INFO:tasks.workunit.client.0.smithi063.stdout:5/619: write d6/d37/d19/d50/d98/fba [857864,120738] 0 2024-09-17T01:56:29.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/593: dwrite d2/d3/d17/f79 [0,4194304] 0 2024-09-17T01:56:29.278 INFO:tasks.workunit.client.0.smithi063.stdout:5/620: rename d6/d23/f77 to d6/d37/d19/d50/d98/fc0 0 2024-09-17T01:56:29.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/585: creat d1/d3/db/d4b/d2f/fc4 x:0 0 0 2024-09-17T01:56:29.280 INFO:tasks.workunit.client.0.smithi063.stdout:7/594: rename d2/d3/d27/d39/d40/d92 to d2/d15/d2f/db9 0 2024-09-17T01:56:29.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/621: truncate d6/f74 701111 0 2024-09-17T01:56:29.280 INFO:tasks.workunit.client.0.smithi063.stdout:0/586: rmdir d1/d3/db/d4b/d82 39 2024-09-17T01:56:29.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/622: read - d6/d23/d29/d36/fb6 zero size 2024-09-17T01:56:29.281 INFO:tasks.workunit.client.0.smithi063.stdout:5/623: chown d6/f44 416069 1 2024-09-17T01:56:29.281 INFO:tasks.workunit.client.0.smithi063.stdout:0/587: symlink d1/d1d/da5/lc5 0 2024-09-17T01:56:29.282 INFO:tasks.workunit.client.0.smithi063.stdout:0/588: chown d1/d3/d1b/c48 3195 1 2024-09-17T01:56:29.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/589: unlink d1/d1d/da5/fc0 0 2024-09-17T01:56:29.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/552: dwrite d9/d8d/d2a/f35 [0,4194304] 0 2024-09-17T01:56:29.288 INFO:tasks.workunit.client.0.smithi063.stdout:9/553: link d9/de/d20/d1b/db7/l87 d9/lc6 0 2024-09-17T01:56:29.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/554: write d9/de/d20/fa3 [68750,26247] 0 2024-09-17T01:56:29.291 INFO:tasks.workunit.client.0.smithi063.stdout:5/624: rename d6/d23 to d6/d35/dc1 0 2024-09-17T01:56:29.292 INFO:tasks.workunit.client.0.smithi063.stdout:9/555: getdents d9/de/d20/d37/d42/d7f 0 2024-09-17T01:56:29.292 INFO:tasks.workunit.client.0.smithi063.stdout:9/556: readlink d9/de/d20/d1b/db7/l8a 0 2024-09-17T01:56:29.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/590: rename d1/d3/db/d18/d43 to d1/d3/dc6 0 2024-09-17T01:56:29.294 INFO:tasks.workunit.client.0.smithi063.stdout:0/591: creat d1/d3/d1b/fc7 x:0 0 0 2024-09-17T01:56:29.294 INFO:tasks.workunit.client.0.smithi063.stdout:9/557: link d9/de/d20/d32/la7 d9/de/d20/d37/d42/d4c/lc7 0 2024-09-17T01:56:29.295 INFO:tasks.workunit.client.0.smithi063.stdout:8/522: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f23 [0,4194304] 0 2024-09-17T01:56:29.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/558: creat d9/fc8 x:0 0 0 2024-09-17T01:56:29.295 INFO:tasks.workunit.client.0.smithi063.stdout:0/592: write d1/d3/d10/f4e [3339240,27909] 0 2024-09-17T01:56:29.297 INFO:tasks.workunit.client.0.smithi063.stdout:8/523: unlink d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/c99 0 2024-09-17T01:56:29.302 INFO:tasks.workunit.client.0.smithi063.stdout:4/697: dread de/d17/d1b/dc7/d28/d30/f7b [0,4194304] 0 2024-09-17T01:56:29.305 INFO:tasks.workunit.client.0.smithi063.stdout:9/559: dwrite d9/de/d20/d1b/d25/d73/f7c [0,4194304] 0 2024-09-17T01:56:29.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/698: chown de/d17/d36/dbe/dbc/fd8 336 1 2024-09-17T01:56:29.305 INFO:tasks.workunit.client.0.smithi063.stdout:0/593: dwrite d1/d3/d10/f4e [0,4194304] 0 2024-09-17T01:56:29.309 INFO:tasks.workunit.client.0.smithi063.stdout:9/560: dread d9/f6a [0,4194304] 0 2024-09-17T01:56:29.312 INFO:tasks.workunit.client.0.smithi063.stdout:7/595: dread d2/d3/d27/d39/f3c [4194304,4194304] 0 2024-09-17T01:56:29.312 INFO:tasks.workunit.client.0.smithi063.stdout:9/561: rename d9/de/d20/fb8 to d9/de/d20/d1b/fc9 0 2024-09-17T01:56:29.312 INFO:tasks.workunit.client.0.smithi063.stdout:7/596: dread - d2/d3/fb8 zero size 2024-09-17T01:56:29.314 INFO:tasks.workunit.client.0.smithi063.stdout:7/597: write d2/d3/d27/d39/f8a [623709,16560] 0 2024-09-17T01:56:29.314 INFO:tasks.workunit.client.0.smithi063.stdout:8/524: truncate d1/f2e 167683 0 2024-09-17T01:56:29.314 INFO:tasks.workunit.client.0.smithi063.stdout:0/594: dwrite d1/d44/d53/d62/f9d [0,4194304] 0 2024-09-17T01:56:29.316 INFO:tasks.workunit.client.0.smithi063.stdout:7/598: fdatasync d2/d3/d27/d39/f3c 0 2024-09-17T01:56:29.316 INFO:tasks.workunit.client.0.smithi063.stdout:7/599: stat d2/d3/d17/c5f 0 2024-09-17T01:56:29.317 INFO:tasks.workunit.client.0.smithi063.stdout:0/595: write d1/d3/d10/f5a [4248921,77992] 0 2024-09-17T01:56:29.317 INFO:tasks.workunit.client.0.smithi063.stdout:8/525: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/fa2 x:0 0 0 2024-09-17T01:56:29.317 INFO:tasks.workunit.client.0.smithi063.stdout:8/526: mknod d1/d7/d1d/ca3 0 2024-09-17T01:56:29.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/600: creat d2/d3/d17/fba x:0 0 0 2024-09-17T01:56:29.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/601: creat d2/d98/fbb x:0 0 0 2024-09-17T01:56:29.319 INFO:tasks.workunit.client.0.smithi063.stdout:8/527: unlink d1/d7/d28/d2a/d37/d3a/d75/d9a/f30 0 2024-09-17T01:56:29.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/602: readlink d2/l6 0 2024-09-17T01:56:29.320 INFO:tasks.workunit.client.0.smithi063.stdout:7/603: readlink d2/d15/d2f/d45/d48/l4d 0 2024-09-17T01:56:29.320 INFO:tasks.workunit.client.0.smithi063.stdout:8/528: mkdir d1/d27/d81/da4 0 2024-09-17T01:56:29.321 INFO:tasks.workunit.client.0.smithi063.stdout:7/604: link d2/d3/d27/d65/f6d d2/d15/d2f/d45/d48/fbc 0 2024-09-17T01:56:29.330 INFO:tasks.workunit.client.0.smithi063.stdout:8/529: write d1/d7/d1d/f77 [30344,9483] 0 2024-09-17T01:56:29.331 INFO:tasks.workunit.client.0.smithi063.stdout:8/530: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f1b 2 1 2024-09-17T01:56:29.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/596: dwrite d1/d3/db/d4b/d7d/f91 [0,4194304] 0 2024-09-17T01:56:29.334 INFO:tasks.workunit.client.0.smithi063.stdout:8/531: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/fa2 814870 0 2024-09-17T01:56:29.336 INFO:tasks.workunit.client.0.smithi063.stdout:0/597: creat d1/d44/d7c/fc8 x:0 0 0 2024-09-17T01:56:29.336 INFO:tasks.workunit.client.0.smithi063.stdout:8/532: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/fa5 x:0 0 0 2024-09-17T01:56:29.338 INFO:tasks.workunit.client.0.smithi063.stdout:0/598: unlink d1/d3/db/fa7 0 2024-09-17T01:56:29.338 INFO:tasks.workunit.client.0.smithi063.stdout:7/605: dread d2/d3/d22/d3a/f62 [0,4194304] 0 2024-09-17T01:56:29.338 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:29.341+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:29.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/606: dread - d2/d3/d27/d8f/faf zero size 2024-09-17T01:56:29.339 INFO:tasks.workunit.client.0.smithi063.stdout:0/599: rename d1/d3/db/d18/d33/c55 to d1/d44/d7c/d88/cc9 0 2024-09-17T01:56:29.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/607: write d2/f23 [2658298,108798] 0 2024-09-17T01:56:29.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/562: dread d9/d8d/d2a/f3f [0,4194304] 0 2024-09-17T01:56:29.340 INFO:tasks.workunit.client.0.smithi063.stdout:7/608: mkdir d2/d3/d27/d65/dbd 0 2024-09-17T01:56:29.340 INFO:tasks.workunit.client.0.smithi063.stdout:9/563: rmdir d9/de/d20/d1b/db7 39 2024-09-17T01:56:29.341 INFO:tasks.workunit.client.0.smithi063.stdout:7/609: unlink d2/d15/l3b 0 2024-09-17T01:56:29.341 INFO:tasks.workunit.client.0.smithi063.stdout:9/564: write d9/de/d20/d37/d42/fc5 [296465,92007] 0 2024-09-17T01:56:29.342 INFO:tasks.workunit.client.0.smithi063.stdout:9/565: symlink d9/de/d33/lca 0 2024-09-17T01:56:29.342 INFO:tasks.workunit.client.0.smithi063.stdout:7/610: truncate d2/d3/d27/d39/d40/f50 5119500 0 2024-09-17T01:56:29.343 INFO:tasks.workunit.client.0.smithi063.stdout:0/600: dread d1/d3/db/f3e [0,4194304] 0 2024-09-17T01:56:29.343 INFO:tasks.workunit.client.0.smithi063.stdout:7/611: readlink d2/d3/d17/l2c 0 2024-09-17T01:56:29.343 INFO:tasks.workunit.client.0.smithi063.stdout:9/566: write d9/de/d20/d1b/fc9 [872330,118381] 0 2024-09-17T01:56:29.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/612: fdatasync d2/d3/d67/f10 0 2024-09-17T01:56:29.344 INFO:tasks.workunit.client.0.smithi063.stdout:0/601: write d1/d3/d32/f7b [1837983,51633] 0 2024-09-17T01:56:29.344 INFO:tasks.workunit.client.0.smithi063.stdout:9/567: rmdir d9/d8d/d2a 39 2024-09-17T01:56:29.345 INFO:tasks.workunit.client.0.smithi063.stdout:9/568: truncate d9/f5b 4971835 0 2024-09-17T01:56:29.345 INFO:tasks.workunit.client.0.smithi063.stdout:0/602: creat d1/d44/fca x:0 0 0 2024-09-17T01:56:29.346 INFO:tasks.workunit.client.0.smithi063.stdout:9/569: rmdir d9/de/d20/d1b/d25/d73/da4 39 2024-09-17T01:56:29.349 INFO:tasks.workunit.client.0.smithi063.stdout:1/732: sync 2024-09-17T01:56:29.349 INFO:tasks.workunit.client.0.smithi063.stdout:6/605: sync 2024-09-17T01:56:29.349 INFO:tasks.workunit.client.0.smithi063.stdout:3/610: sync 2024-09-17T01:56:29.349 INFO:tasks.workunit.client.0.smithi063.stdout:2/503: sync 2024-09-17T01:56:29.350 INFO:tasks.workunit.client.0.smithi063.stdout:5/625: sync 2024-09-17T01:56:29.351 INFO:tasks.workunit.client.0.smithi063.stdout:2/504: chown d3/c48 461 1 2024-09-17T01:56:29.351 INFO:tasks.workunit.client.0.smithi063.stdout:6/606: creat dc/d14/d19/d20/d66/fc9 x:0 0 0 2024-09-17T01:56:29.352 INFO:tasks.workunit.client.0.smithi063.stdout:1/733: mknod d0/d2d/d35/d3f/d81/cfc 0 2024-09-17T01:56:29.352 INFO:tasks.workunit.client.0.smithi063.stdout:8/533: dread d1/d7/f13 [0,4194304] 0 2024-09-17T01:56:29.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/626: write d6/d35/dc1/d29/f96 [366375,48671] 0 2024-09-17T01:56:29.353 INFO:tasks.workunit.client.0.smithi063.stdout:0/603: dwrite d1/d44/d53/d62/f9d [0,4194304] 0 2024-09-17T01:56:29.354 INFO:tasks.workunit.client.0.smithi063.stdout:2/505: fdatasync d3/d7/df/f2f 0 2024-09-17T01:56:29.356 INFO:tasks.workunit.client.0.smithi063.stdout:9/570: dwrite d9/de/d20/d37/f58 [0,4194304] 0 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.985969442999998, 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:29.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:29.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:29.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7879733620000007, 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:29.365 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:29.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:29.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:29.371 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7870901089999993, 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:29.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:29.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.377 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7850905899999994, 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:29.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:29.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:29.383 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7840338799999991, 2024-09-17T01:56:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.390 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7809555479999997, 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:29.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:29.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7790500310000006, 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:29.398 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:29.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:29.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7768163339999994, 2024-09-17T01:56:29.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:29.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:29.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:29.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:29.413 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.414 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7758801979999994, 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:29.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7539277000000002, 2024-09-17T01:56:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:29.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:29.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:29.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7508816920000001, 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:29.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:29.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7456892849999992, 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.740329741, 2024-09-17T01:56:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:29.445 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:29.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7358571660000006, 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.453 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:29.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:29.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:29.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:29.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7243449569999996, 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:29.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:29.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:29.466 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7163937669999996, 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:29.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:29.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:29.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.712075316, 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:29.473 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:29.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:29.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.479 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7073350699999992, 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:29.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7048533819999996, 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:29.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:29.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7038581589999993, 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:29.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:29.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:29.502 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:29.502 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:29.505 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:29.505+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:29.506 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:29.527 INFO:tasks.workunit.client.0.smithi063.stdout:3/611: dread df/d12/d1e/f57 [0,4194304] 0 2024-09-17T01:56:29.527 INFO:tasks.workunit.client.0.smithi063.stdout:2/506: write d3/d7/df/f19 [94079,8033] 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/571: write d9/f6a [3904132,103643] 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/734: link d0/d2d/d35/d3f/d81/f42 d0/d2d/d35/d6f/db7/ffd 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:8/534: rmdir d1/d7/d28/d2a/d44 39 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:6/607: link dc/c24 dc/d1b/cca 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:8/535: fdatasync d1/f70 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:0/604: dread d1/d3/d10/f4e [0,4194304] 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:7/613: dwrite d2/d15/d2f/d45/d48/fb3 [0,4194304] 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:2/507: rmdir d3/d28/d84 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:3/612: fdatasync df/d12/d2d/f7d 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:8/536: stat d1/d7/d28/d87 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/572: creat d9/d8d/d2a/fcb x:0 0 0 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/735: chown d0/d2d/d35/d3f/d81/d50/c7d 611946395 1 2024-09-17T01:56:29.528 INFO:tasks.workunit.client.0.smithi063.stdout:3/613: write df/d12/d2d/f4a [2099574,62877] 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:1/736: rmdir d0/d1c 39 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:8/537: readlink d1/d7/d28/d2a/d37/d3a/d75/l9d 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:2/508: creat d3/d7/df/d30/f93 x:0 0 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:6/608: truncate dc/d14/d19/d20/d32/d68/f78 429604 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:6/609: write dc/d14/d2f/f5b [2108296,98459] 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/573: getdents d9/d8d/d2a/d40/dac 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/614: getdents df/d12/d43 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:6/610: truncate dc/d14/fc4 739545 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/574: symlink d9/de/d20/d37/d42/lcc 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/615: getdents df/d12/d2d 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:6/611: dread dc/d14/d18/f94 [0,4194304] 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:1/737: dwrite d0/d2d/d35/d6f/db7/ffd [0,4194304] 0 2024-09-17T01:56:29.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/575: rmdir d9/de/d20/d32 39 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:1/738: write d0/d93/fd6 [122946,15922] 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:9/576: write d9/de/d20/d37/d42/f93 [1378546,34441] 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:3/616: write df/d12/d43/d50/d58/fbd [630410,31502] 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:3/617: dwrite df/d12/f80 [4194304,4194304] 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/699: sync 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:9/577: dwrite d9/de/d20/d37/d42/d7f/f83 [4194304,4194304] 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:0/605: truncate d1/d3/db/d18/d33/f67 7801502 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:8/538: write d1/d27/d82/f88 [1519674,30199] 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:3/618: rmdir df/d12/d30/d8a 39 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:0/606: unlink d1/d3/d1b/c5d 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:3/619: mknod df/d12/d43/cd5 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/700: unlink de/d17/d1b/dc7/la4 0 2024-09-17T01:56:29.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/701: rmdir de/d17/d1b/dc7/d28/d8d 39 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/620: write df/d12/d30/d8a/fc1 [239023,42083] 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/739: dwrite d0/d2d/d35/d9d/fb2 [0,4194304] 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/607: truncate d1/d3/d32/f69 941384 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/621: readlink df/d12/d1e/d53/lb0 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/702: unlink de/d2d/d52/l82 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/608: fdatasync d1/d3/db/d6e/d86/fb1 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/622: creat df/d12/d1e/d53/dca/fd6 x:0 0 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/609: creat d1/d3/d32/fcb x:0 0 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/623: dread - df/d12/d1e/d53/fc0 zero size 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/610: fsync d1/d3/d10/f4e 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/624: mkdir df/d12/d43/d50/d58/d97/daa/db1/dd7 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/625: symlink df/d12/ld8 0 2024-09-17T01:56:29.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/626: symlink df/d12/d30/db8/ld9 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/578: write d9/de/d20/f24 [4655008,38635] 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/579: mknod d9/de/d33/ccd 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/580: unlink d9/d27/c3d 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:6/612: dread dc/d14/d19/d20/d32/d52/d5a/f40 [0,4194304] 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/581: getdents d9/d8d/d2a 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/582: mknod d9/d27/cce 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/583: mkdir d9/de/dcf 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:7/614: dread d2/d3/d17/d25/f1b [0,4194304] 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:0/611: truncate d1/f4d 1717003 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:7/615: chown d2/d3/l8 146806 1 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:6/613: dwrite dc/d14/fbe [0,4194304] 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:3/627: dread f3 [0,4194304] 0 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:6/614: chown dc/d14/d19/d20/d32/d52 8026 1 2024-09-17T01:56:29.532 INFO:tasks.workunit.client.0.smithi063.stdout:2/509: dread d3/d7/d38/f56 [0,4194304] 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:9/584: dwrite d9/d8d/d2a/f53 [0,4194304] 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/740: fsync d0/d2d/d35/d9d/fb2 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/612: getdents d1/d44/d7c/db6 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/615: symlink dc/d14/d19/d20/lcb 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/616: unlink d2/d3/d27/l4c 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/510: symlink d3/d7/df/l94 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:3/628: write df/d12/d30/f47 [1045785,49256] 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/617: chown d2/d98 0 1 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/616: fsync dc/d14/fc4 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/617: fsync dc/d14/d19/f82 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/741: mknod d0/d2d/d35/d3f/d81/d50/d6c/d90/cfe 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/613: rename d1/d44 to d1/d3/db/d6e/d86/dcc 0 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/511: rmdir d3/d7/df/d43 39 2024-09-17T01:56:29.533 INFO:tasks.workunit.client.0.smithi063.stdout:3/629: chown df/d12/d3a/d7a 488 1 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:7/618: symlink d2/d3/d67/lbe 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:1/742: readlink d0/d93/l9f 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:3/630: stat df/d12/d30/dd1 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:0/614: chown d1/d3/db/d18/d85/d92/f8c 54023648 1 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/539: dread d1/f5e [0,4194304] 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:1/743: chown d0/d2d/d35/d3f/d81/d50/d6c/d74/def 571 1 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:2/512: truncate d3/d2a/f4c 615503 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:3/631: unlink df/d12/d1e/f8b 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:7/619: mknod d2/d15/d2f/cbf 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:3/632: dread - df/d12/d3a/f73 zero size 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:7/620: mkdir d2/d3/d27/d33/dc0 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/540: unlink d1/d7/l25 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/585: dwrite d9/de/fa6 [0,4194304] 0 2024-09-17T01:56:29.534 INFO:tasks.workunit.client.0.smithi063.stdout:0/615: mkdir d1/d3/db/d6e/d86/dcc/d53/d62/dcd 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/744: truncate d0/d2d/d35/d3f/d81/fa4 439147 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:3/633: chown df/d12/d43/d50/d87/dbb/dbe/fcd 36944 1 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:9/586: chown d9/de/d33/f38 54332 1 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:2/513: getdents d3/d7/df/d43 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/703: dread de/f16 [0,4194304] 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:6/618: dwrite dc/d14/d19/d20/d32/f87 [0,4194304] 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/745: unlink d0/d2d/d35/d3f/d81/d50/d6c/d90/cfe 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:2/514: rename d3/d7/df/d30/f93 to d3/d7/df/d5a/f95 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/704: symlink de/d17/d36/dbe/dbc/ldd 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:9/587: fsync d9/de/f2f 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:3/634: truncate df/d12/d43/f69 339098 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:5/627: sync 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:0/616: dread d1/d3/d10/f5a [0,4194304] 0 2024-09-17T01:56:29.535 INFO:tasks.workunit.client.0.smithi063.stdout:3/635: unlink df/d12/d1e/f55 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:9/588: rmdir d9/de/d20/d37/d42/d4c 39 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:3/636: symlink df/d12/lda 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/617: rename d1/d3/d1b/c8d to d1/d3/db/d18/d33/d83/db7/cce 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:6/619: dwrite dc/d14/d19/d20/d32/f54 [0,4194304] 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:3/637: creat df/d12/d43/d50/d58/d97/fdb x:0 0 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/618: truncate d1/f4d 2083822 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/619: truncate d1/d1d/d74/f7f 294550 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:3/638: getdents df/d12/d43/d50/d58/d97/daa 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:9/589: dwrite d9/de/d20/d37/d42/d7f/f92 [0,4194304] 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/620: rename d1/d3/db/d4b/f45 to d1/d3/db/d18/d85/da8/fcf 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:9/590: chown d9/d27/c98 14370103 1 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:1/746: dwrite d0/d2d/d35/d3f/d81/d50/f54 [0,4194304] 0 2024-09-17T01:56:29.536 INFO:tasks.workunit.client.0.smithi063.stdout:1/747: mkdir d0/d93/dc4/dff 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/591: rmdir d9/de/d20/d1b/db7 39 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/639: dwrite df/d12/d1e/d5e/f8d [0,4194304] 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/621: dwrite d1/d3/d1b/f65 [0,4194304] 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/640: write df/d12/d43/d50/f86 [261925,101212] 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/641: truncate df/d12/d3a/f9e 224089 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/622: rename d1/d3/db/d6e/d86/dcc/lc3 to d1/d3/db/d4b/ld0 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/642: mkdir df/d12/d2d/ddc 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/623: rmdir d1/d3/db/d18 39 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:2/515: write d3/d7/df/d68/f74 [1071731,29525] 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:6/620: write dc/d14/d18/f42 [661143,38193] 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/624: stat d1/d3/db/d6e/d86/dcc/d53 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/643: write df/d12/d43/d50/d87/dbb/dbe/fcd [259640,127525] 0 2024-09-17T01:56:29.537 INFO:tasks.workunit.client.0.smithi063.stdout:2/516: write d3/f79 [1363082,122905] 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:2/517: read - d3/f91 zero size 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:3/644: fsync df/d12/d3a/f51 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:1/748: truncate d0/d2d/d35/d3f/d81/d50/f54 1894832 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:6/621: rmdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/dbc 39 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:3/645: write df/d12/d1e/d39/f7b [3283005,53002] 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:7/621: dread d2/f7d [0,4194304] 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/625: dwrite d1/d1f/f41 [0,4194304] 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:2/518: write d3/d7/df/d30/f8e [553888,118331] 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:3/646: unlink df/d12/d43/d50/f5d 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:6/622: truncate dc/d14/d19/d20/d32/d52/d5a/d43/f6d 754814 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:2/519: getdents d3/d28 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:3/647: creat df/d12/d43/d50/d87/dbb/fdd x:0 0 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/626: truncate d1/d3/db/f42 5100308 0 2024-09-17T01:56:29.538 INFO:tasks.workunit.client.0.smithi063.stdout:2/520: symlink d3/d7/l96 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/627: unlink d1/d3/db/d18/d85/fc2 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/648: chown df/d12/d2d/l38 112224 1 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/623: creat dc/d14/d19/d20/d32/d52/d5a/fcc x:0 0 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/649: dread - df/d12/d1e/d53/f7f zero size 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/624: fsync f1 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/628: symlink d1/d3/db/d4b/d7d/ld1 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/629: mknod d1/d3/d1b/cd2 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:1/749: dwrite d0/d2d/d35/d3f/d81/f42 [4194304,4194304] 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/630: fsync d1/d3/db/d6e/fa4 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:1/750: read - d0/d2d/d35/d3f/d81/d50/d6c/d90/ff5 zero size 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:7/622: dread d2/d15/d2f/d45/fab [0,4194304] 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/631: write d1/d3/db/d4b/d98/fbe [574277,111751] 0 2024-09-17T01:56:29.539 INFO:tasks.workunit.client.0.smithi063.stdout:7/623: symlink d2/d3/d27/d33/d7b/lc1 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/751: chown d0/d2d/d35/d3f/d81/d50/f70 236 1 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:3/650: dwrite df/d12/f16 [0,4194304] 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/752: chown d0/d1c/f41 2451700 1 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:0/632: mkdir d1/d3/db/d4b/d98/dd3 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:3/651: creat df/d12/d43/d50/d58/d97/daa/fde x:0 0 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:0/633: mkdir d1/d3/db/d18/d85/d92/dd4 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/753: dread d0/d2d/d35/d3f/d81/d50/f54 [0,4194304] 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/624: link d2/d3/d27/c44 d2/d15/d2f/d45/d84/cc2 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/625: creat d2/d15/d2f/d3e/fc3 x:0 0 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/754: creat d0/d2d/f100 x:0 0 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/626: stat d2/d15/d2f/l6c 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:0/634: rename d1/d3/d10/c79 to d1/d3/d1b/cd5 0 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/755: read - d0/d2d/d35/d3f/d81/d50/d6c/fd3 zero size 2024-09-17T01:56:29.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/627: creat d2/d3/d27/d65/fc4 x:0 0 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:9/592: dread d9/de/d33/f38 [0,4194304] 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:2/521: read d3/d7/df/f2f [1347443,79272] 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/756: dread - d0/d2d/d35/d3f/d81/d50/d6c/fd3 zero size 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/652: dwrite fe [0,4194304] 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/653: fsync df/d12/d30/db8/fd4 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/757: dread d0/d2d/d35/d3f/d4e/f6a [0,4194304] 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:9/593: symlink d9/de/d20/d37/d42/d7f/ld0 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/758: readlink d0/d2d/d35/d8c/le3 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:2/522: link d3/d7/df/d68/f35 d3/d28/f97 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/654: rename df/d12/d3a/d7a/c7e to df/d12/d30/cdf 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:2/523: readlink d3/d7/df/l87 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:7/628: write d2/d15/d2f/d52/f94 [3309976,16599] 0 2024-09-17T01:56:29.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/759: getdents d0/d2d/d35/d3f/d94/da6 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/760: rename d0/d2d/d35/d3f/d81/d50/d6c/d74/cb5 to d0/d2d/d35/d3f/d81/d50/d8b/db3/c101 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:2/524: truncate d3/d7/df/f71 2371966 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/761: getdents d0/d93/dc4/dff 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:7/629: dwrite d2/d3/d17/d25/f8b [0,4194304] 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:3/655: truncate df/d12/d43/d50/d58/fbd 288780 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:9/594: dwrite d9/d8d/d2a/d36/f78 [0,4194304] 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:9/595: chown d9/de/d20/f24 19 1 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:3/656: symlink df/d83/le0 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:0/635: dread d1/d3/d1b/f29 [0,4194304] 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/762: mkdir d0/d2d/d35/d3f/d81/d50/d6c/d102 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/763: chown d0/d2d/d35/d3f 1 1 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:0/636: write d1/d1d/f3b [5283285,72795] 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:9/596: write d9/d8d/d2a/d40/fc1 [692425,54760] 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:9/597: creat d9/de/d20/d32/fd1 x:0 0 0 2024-09-17T01:56:29.542 INFO:tasks.workunit.client.0.smithi063.stdout:9/598: creat d9/de/dcf/fd2 x:0 0 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:9/599: symlink d9/d8d/d2a/d40/dac/dc2/ld3 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:8/541: sync 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:4/705: sync 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:5/628: sync 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:7/630: dread d2/d3/d27/d39/f4e [0,4194304] 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:1/764: dread d0/d2d/d35/d8c/fb4 [0,4194304] 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:3/657: dwrite df/d12/d30/f32 [4194304,4194304] 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:5/629: creat d6/d37/d19/d50/fc2 x:0 0 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:4/706: write de/d17/d36/d70/f8f [157646,44878] 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:1/765: chown d0/d1c/c2f 5854 1 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:0/637: dwrite d1/d3/db/d4b/d7d/f91 [0,4194304] 0 2024-09-17T01:56:29.543 INFO:tasks.workunit.client.0.smithi063.stdout:8/542: dread - d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f52 zero size 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:0/638: stat d1/d3/db/d4b/d98/fbe 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:0/639: dread - d1/d3/db/d6e/fa4 zero size 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:1/766: creat d0/d1c/db1/f103 x:0 0 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:7/631: chown d2/d15/d2f/d45/d84/cc2 98789 1 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:4/707: mknod de/d17/d1b/dc7/d28/d30/cde 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:2/525: dread d3/d7/d38/f65 [0,4194304] 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:0/640: mknod d1/d3/db/d6e/d86/cd6 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:5/630: creat d6/d9/d13/d1d/d8a/fc3 x:0 0 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:4/708: readlink de/d17/d36/l3f 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/600: getdents d9/de/d20/d1b/d25/d73/da4 0 2024-09-17T01:56:29.544 INFO:tasks.workunit.client.0.smithi063.stdout:2/526: symlink d3/d7/d38/l98 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:4/709: readlink de/d17/d1b/dc7/d28/d30/l7d 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:7/632: rename d2/d15/d2f/d45/d48/f78 to d2/d3/d27/d65/fc5 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:9/601: creat d9/de/d20/d1b/fd4 x:0 0 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:8/543: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f2d [0,4194304] 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:4/710: rename de/d17/d36/dbe/d9a/fb8 to de/d17/d36/dbe/fdf 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:1/767: dwrite d0/d2d/d5e/d7e/fc6 [0,4194304] 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:9/602: symlink d9/d8d/d2a/d40/dac/ld5 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/641: dread d1/d3/d32/f69 [0,4194304] 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:7/633: creat d2/d3/d27/d33/d7b/d9b/fc6 x:0 0 0 2024-09-17T01:56:29.545 INFO:tasks.workunit.client.0.smithi063.stdout:1/768: dread - d0/d2d/d5e/dd8/fdd zero size 2024-09-17T01:56:29.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/527: write d3/d7/df/f71 [783606,9882] 0 2024-09-17T01:56:29.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/769: chown d0/d93/cf1 3 1 2024-09-17T01:56:29.546 INFO:tasks.workunit.client.0.smithi063.stdout:0/642: symlink d1/d3/ld7 0 2024-09-17T01:56:29.546 INFO:tasks.workunit.client.0.smithi063.stdout:0/643: fdatasync d1/d3/db/f39 0 2024-09-17T01:56:29.549 INFO:tasks.workunit.client.0.smithi063.stdout:5/631: dread d6/d37/d19/d50/d98/fba [0,4194304] 0 2024-09-17T01:56:29.549 INFO:tasks.workunit.client.0.smithi063.stdout:2/528: write d3/d7/df/f18 [603913,39758] 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/529: creat d3/d7/d76/f99 x:0 0 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/644: mkdir d1/d3/db/d18/d33/d83/db7/dd8 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:5/632: creat d6/d9/d13/d1d/fc4 x:0 0 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/530: stat d3/d28/f97 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:7/634: dwrite d2/fd [4194304,4194304] 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/711: dwrite de/d17/d36/f5b [4194304,4194304] 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/531: write d3/d2a/f82 [368372,4468] 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/645: creat d1/d3/db/d6e/d86/dcc/d53/d62/dcd/fd9 x:0 0 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:1/770: write d0/d1c/f5c [1635422,115149] 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/712: mknod de/d17/d1b/dc7/d28/d98/ce0 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:5/633: link d6/d37/l61 d6/d37/d19/d50/d98/da0/lc5 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/532: link d3/c27 d3/d7/df/d30/c9a 0 2024-09-17T01:56:29.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/713: write de/d2d/d52/f5f [2326972,91201] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/714: readlink de/d2d/d3c/l75 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:1/771: mkdir d0/d2d/d35/d3f/d81/d50/d104 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:8/544: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f61 [0,4194304] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:5/634: readlink d6/d35/dc1/d29/d36/l60 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/715: unlink de/cca 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:2/533: link d3/d7/df/d30/l75 d3/d7/l9b 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/716: write de/d2d/fdb [3713435,107099] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:5/635: mkdir d6/d9/d13/dc6 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:7/635: dwrite d2/d3/d27/d65/f6d [0,4194304] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:1/772: write d0/d2d/d35/d3f/d81/fa4 [1054039,53617] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/717: write de/d17/d1b/f83 [1009479,103190] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:0/646: dwrite d1/d3/db/d18/d85/da8/fad [0,4194304] 0 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/718: chown de/l15 2 1 2024-09-17T01:56:29.551 INFO:tasks.workunit.client.0.smithi063.stdout:6/625: sync 2024-09-17T01:56:29.552 INFO:tasks.workunit.client.0.smithi063.stdout:3/658: dread df/d12/d2d/faf [0,4194304] 0 2024-09-17T01:56:29.552 INFO:tasks.workunit.client.0.smithi063.stdout:8/545: dwrite d1/d7/d1d/f1f [0,4194304] 0 2024-09-17T01:56:29.553 INFO:tasks.workunit.client.0.smithi063.stdout:2/534: dwrite d3/d7/d38/f45 [0,4194304] 0 2024-09-17T01:56:29.553 INFO:tasks.workunit.client.0.smithi063.stdout:4/719: creat de/d17/d36/dbe/fe1 x:0 0 0 2024-09-17T01:56:29.557 INFO:tasks.workunit.client.0.smithi063.stdout:9/603: dread d9/de/d20/d1b/d25/f2b [0,4194304] 0 2024-09-17T01:56:29.558 INFO:tasks.workunit.client.0.smithi063.stdout:8/546: stat d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66 0 2024-09-17T01:56:29.558 INFO:tasks.workunit.client.0.smithi063.stdout:5/636: link d6/d9/l34 d6/d35/dc1/d3f/lc7 0 2024-09-17T01:56:29.558 INFO:tasks.workunit.client.0.smithi063.stdout:1/773: mknod d0/d2d/d35/d3f/d81/d50/c105 0 2024-09-17T01:56:29.558 INFO:tasks.workunit.client.0.smithi063.stdout:3/659: rmdir df/d12/d1e/d39/dbf 0 2024-09-17T01:56:29.558 INFO:tasks.workunit.client.0.smithi063.stdout:9/604: rmdir d9/de/dcf 39 2024-09-17T01:56:29.559 INFO:tasks.workunit.client.0.smithi063.stdout:2/535: mknod d3/c9c 0 2024-09-17T01:56:29.560 INFO:tasks.workunit.client.0.smithi063.stdout:3/660: stat df/d12/d1e/d5e/f8f 0 2024-09-17T01:56:29.561 INFO:tasks.workunit.client.0.smithi063.stdout:8/547: mknod d1/d7/d28/d2a/ca6 0 2024-09-17T01:56:29.562 INFO:tasks.workunit.client.0.smithi063.stdout:5/637: truncate d6/d37/d79/f7e 214612 0 2024-09-17T01:56:29.562 INFO:tasks.workunit.client.0.smithi063.stdout:7/636: dwrite d2/d3/d22/d3a/f70 [0,4194304] 0 2024-09-17T01:56:29.563 INFO:tasks.workunit.client.0.smithi063.stdout:0/647: dwrite d1/d3/db/d18/f95 [0,4194304] 0 2024-09-17T01:56:29.564 INFO:tasks.workunit.client.0.smithi063.stdout:3/661: creat df/d12/d43/d50/d87/dbb/fe1 x:0 0 0 2024-09-17T01:56:29.564 INFO:tasks.workunit.client.0.smithi063.stdout:5/638: mkdir d6/d35/dc1/d29/da3/dc8 0 2024-09-17T01:56:29.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/637: mknod d2/d15/d2f/cc7 0 2024-09-17T01:56:29.565 INFO:tasks.workunit.client.0.smithi063.stdout:8/548: fdatasync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f4a 0 2024-09-17T01:56:29.565 INFO:tasks.workunit.client.0.smithi063.stdout:2/536: link d3/d7/df/d5a/c66 d3/d7/df/d43/c9d 0 2024-09-17T01:56:29.565 INFO:tasks.workunit.client.0.smithi063.stdout:9/605: link d9/de/d20/fa3 d9/de/d20/d1b/d25/d73/fd6 0 2024-09-17T01:56:29.565 INFO:tasks.workunit.client.0.smithi063.stdout:0/648: rmdir d1/d3/d32/d63 39 2024-09-17T01:56:29.566 INFO:tasks.workunit.client.0.smithi063.stdout:3/662: readlink df/d12/d30/db8/ld9 0 2024-09-17T01:56:29.566 INFO:tasks.workunit.client.0.smithi063.stdout:3/663: chown df/d83 4 1 2024-09-17T01:56:29.566 INFO:tasks.workunit.client.0.smithi063.stdout:6/626: dwrite dc/d14/d19/d20/d32/d68/f6c [4194304,4194304] 0 2024-09-17T01:56:29.567 INFO:tasks.workunit.client.0.smithi063.stdout:9/606: write d9/d8d/f79 [1827,106240] 0 2024-09-17T01:56:29.567 INFO:tasks.workunit.client.0.smithi063.stdout:2/537: write d3/d7/d76/f77 [1425271,53655] 0 2024-09-17T01:56:29.568 INFO:tasks.workunit.client.0.smithi063.stdout:9/607: stat d9/de/d20/d37/f91 0 2024-09-17T01:56:29.568 INFO:tasks.workunit.client.0.smithi063.stdout:8/549: rmdir d1/d7/d28/d2a/d37/d3a/d75/d9a 39 2024-09-17T01:56:29.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/649: mkdir d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda 0 2024-09-17T01:56:29.569 INFO:tasks.workunit.client.0.smithi063.stdout:9/608: dread - d9/de/dcf/fd2 zero size 2024-09-17T01:56:29.569 INFO:tasks.workunit.client.0.smithi063.stdout:8/550: unlink d1/d7/d28/f96 0 2024-09-17T01:56:29.570 INFO:tasks.workunit.client.0.smithi063.stdout:6/627: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/dbc/dcd 0 2024-09-17T01:56:29.571 INFO:tasks.workunit.client.0.smithi063.stdout:2/538: link d3/d2a/l4e d3/d7/d76/l9e 0 2024-09-17T01:56:29.572 INFO:tasks.workunit.client.0.smithi063.stdout:6/628: creat dc/d14/d19/d20/d32/d68/fce x:0 0 0 2024-09-17T01:56:29.572 INFO:tasks.workunit.client.0.smithi063.stdout:2/539: dread - d3/d7/d76/f99 zero size 2024-09-17T01:56:29.575 INFO:tasks.workunit.client.0.smithi063.stdout:6/629: write dc/d1b/d5e/f79 [2822268,126357] 0 2024-09-17T01:56:29.575 INFO:tasks.workunit.client.0.smithi063.stdout:1/774: chown d0/d2d/d35/d3f/d81/d50/c73 44113 1 2024-09-17T01:56:29.577 INFO:tasks.workunit.client.0.smithi063.stdout:2/540: dread d3/d7/df/f19 [0,4194304] 0 2024-09-17T01:56:29.577 INFO:tasks.workunit.client.0.smithi063.stdout:7/638: dwrite d2/d15/d2f/d52/f63 [0,4194304] 0 2024-09-17T01:56:29.577 INFO:tasks.workunit.client.0.smithi063.stdout:6/630: write dc/d14/d18/fad [22483,34379] 0 2024-09-17T01:56:29.580 INFO:tasks.workunit.client.0.smithi063.stdout:8/551: dwrite d1/d7/d28/f9f [0,4194304] 0 2024-09-17T01:56:29.580 INFO:tasks.workunit.client.0.smithi063.stdout:8/552: sync 2024-09-17T01:56:29.582 INFO:tasks.workunit.client.0.smithi063.stdout:9/609: dwrite d9/de/d20/d37/d42/d4c/faa [0,4194304] 0 2024-09-17T01:56:29.582 INFO:tasks.workunit.client.0.smithi063.stdout:5/639: read d6/d9/d13/d1d/f21 [83836,77321] 0 2024-09-17T01:56:29.583 INFO:tasks.workunit.client.0.smithi063.stdout:0/650: truncate d1/d3/db/d6e/d86/dcc/d53/f8b 307221 0 2024-09-17T01:56:29.584 INFO:tasks.workunit.client.0.smithi063.stdout:6/631: rename dc/d14/d19/d20/d32/d68/lac to dc/d14/d19/d20/d32/d52/lcf 0 2024-09-17T01:56:29.585 INFO:tasks.workunit.client.0.smithi063.stdout:5/640: stat d6/d9/d13/d1d/f55 0 2024-09-17T01:56:29.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/541: creat d3/d7/d38/f9f x:0 0 0 2024-09-17T01:56:29.585 INFO:tasks.workunit.client.0.smithi063.stdout:7/639: creat d2/d3/d67/fc8 x:0 0 0 2024-09-17T01:56:29.587 INFO:tasks.workunit.client.0.smithi063.stdout:6/632: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0 0 2024-09-17T01:56:29.587 INFO:tasks.workunit.client.0.smithi063.stdout:9/610: write d9/de/d20/d1b/db7/fb9 [962637,9123] 0 2024-09-17T01:56:29.587 INFO:tasks.workunit.client.0.smithi063.stdout:5/641: stat d6/d9/d13/d1d/l83 0 2024-09-17T01:56:29.587 INFO:tasks.workunit.client.0.smithi063.stdout:7/640: creat d2/d3/d17/d25/db0/fc9 x:0 0 0 2024-09-17T01:56:29.588 INFO:tasks.workunit.client.0.smithi063.stdout:2/542: creat d3/d2a/fa0 x:0 0 0 2024-09-17T01:56:29.588 INFO:tasks.workunit.client.0.smithi063.stdout:0/651: rename d1/d3/d32/f93 to d1/d3/db/d6e/d86/dcc/d7c/fdb 0 2024-09-17T01:56:29.589 INFO:tasks.workunit.client.0.smithi063.stdout:9/611: symlink d9/d8d/d2a/d40/ld7 0 2024-09-17T01:56:29.589 INFO:tasks.workunit.client.0.smithi063.stdout:7/641: write d2/d15/d2f/d3e/fc3 [1008605,74228] 0 2024-09-17T01:56:29.589 INFO:tasks.workunit.client.0.smithi063.stdout:5/642: stat d6/d37/d19/d76/d8f/lb4 0 2024-09-17T01:56:29.589 INFO:tasks.workunit.client.0.smithi063.stdout:2/543: write d3/d7/f26 [779148,119000] 0 2024-09-17T01:56:29.591 INFO:tasks.workunit.client.0.smithi063.stdout:2/544: mknod d3/d2a/ca1 0 2024-09-17T01:56:29.591 INFO:tasks.workunit.client.0.smithi063.stdout:0/652: dread d1/d3/d1b/f4f [0,4194304] 0 2024-09-17T01:56:29.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/653: sync 2024-09-17T01:56:29.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/643: getdents d6/d35/dc1/d29/da3 0 2024-09-17T01:56:29.594 INFO:tasks.workunit.client.0.smithi063.stdout:2/545: truncate d3/d2a/f82 411731 0 2024-09-17T01:56:29.594 INFO:tasks.workunit.client.0.smithi063.stdout:5/644: chown d6/d35/dc1/d29/d36/f5e 27004169 1 2024-09-17T01:56:29.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/654: creat d1/d3/db/d18/d85/d92/fdc x:0 0 0 2024-09-17T01:56:29.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/775: dread d0/d2d/d35/d6f/db7/fc7 [0,4194304] 0 2024-09-17T01:56:29.595 INFO:tasks.workunit.client.0.smithi063.stdout:0/655: readlink d1/d3/db/d4b/d7d/ld1 0 2024-09-17T01:56:29.596 INFO:tasks.workunit.client.0.smithi063.stdout:5/645: creat d6/d9/d32/d8c/fc9 x:0 0 0 2024-09-17T01:56:29.597 INFO:tasks.workunit.client.0.smithi063.stdout:2/546: rename d3/d7/df/f19 to d3/fa2 0 2024-09-17T01:56:29.597 INFO:tasks.workunit.client.0.smithi063.stdout:0/656: getdents d1/d3/db/d18 0 2024-09-17T01:56:29.599 INFO:tasks.workunit.client.0.smithi063.stdout:5/646: mknod d6/d35/dc1/d29/d2b/d4f/cca 0 2024-09-17T01:56:29.599 INFO:tasks.workunit.client.0.smithi063.stdout:2/547: mknod d3/d28/d72/ca3 0 2024-09-17T01:56:29.599 INFO:tasks.workunit.client.0.smithi063.stdout:6/633: dread dc/d14/d65/f7d [0,4194304] 0 2024-09-17T01:56:29.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/642: dwrite d2/d3/d17/d25/f9f [0,4194304] 0 2024-09-17T01:56:29.600 INFO:tasks.workunit.client.0.smithi063.stdout:0/657: write d1/d3/db/d18/d33/f71 [4437286,98382] 0 2024-09-17T01:56:29.602 INFO:tasks.workunit.client.0.smithi063.stdout:5/647: rmdir d6/d35/dc1/d54 39 2024-09-17T01:56:29.602 INFO:tasks.workunit.client.0.smithi063.stdout:2/548: unlink d3/d7/df/d68/l5d 0 2024-09-17T01:56:29.604 INFO:tasks.workunit.client.0.smithi063.stdout:7/643: stat d2/d3/d67/d8d 0 2024-09-17T01:56:29.604 INFO:tasks.workunit.client.0.smithi063.stdout:4/720: dread de/f2f [0,4194304] 0 2024-09-17T01:56:29.604 INFO:tasks.workunit.client.0.smithi063.stdout:9/612: write d9/de/d20/d1b/f1f [2058173,60524] 0 2024-09-17T01:56:29.604 INFO:tasks.workunit.client.0.smithi063.stdout:0/658: readlink d1/d3/db/d4b/d7d/ld1 0 2024-09-17T01:56:29.604 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:29.605+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:29.605 INFO:tasks.workunit.client.0.smithi063.stdout:3/664: dread df/d12/d1e/d5e/f76 [0,4194304] 0 2024-09-17T01:56:29.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/634: dread - dc/d14/d18/d74/fb1 zero size 2024-09-17T01:56:29.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/776: dwrite d0/d2d/d35/d6f/db7/ffd [0,4194304] 0 2024-09-17T01:56:29.606 INFO:tasks.workunit.client.0.smithi063.stdout:5/648: rename d6/d35/dc1/f2a to d6/d37/d19/fcb 0 2024-09-17T01:56:29.608 INFO:tasks.workunit.client.0.smithi063.stdout:8/553: dwrite d1/f16 [4194304,4194304] 0 2024-09-17T01:56:29.608 INFO:tasks.workunit.client.0.smithi063.stdout:6/635: fsync dc/d14/d19/d20/d32/d52/d5a/d43/f50 0 2024-09-17T01:56:29.608 INFO:tasks.workunit.client.0.smithi063.stdout:9/613: getdents d9/d8d 0 2024-09-17T01:56:29.608 INFO:tasks.workunit.client.0.smithi063.stdout:7/644: write d2/d3/d67/fc8 [218944,27519] 0 2024-09-17T01:56:29.611 INFO:tasks.workunit.client.0.smithi063.stdout:0/659: rename d1/d3/db/d4b/d98/dd3 to d1/d3/db/d4b/d98/ddd 0 2024-09-17T01:56:29.611 INFO:tasks.workunit.client.0.smithi063.stdout:4/721: rename de/f10 to de/d17/d1b/dc7/fe2 0 2024-09-17T01:56:29.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/636: mknod dc/d14/d19/d20/d32/d52/d5a/d43/cd1 0 2024-09-17T01:56:29.613 INFO:tasks.workunit.client.0.smithi063.stdout:8/554: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f67 [7048,19568] 0 2024-09-17T01:56:29.614 INFO:tasks.workunit.client.0.smithi063.stdout:3/665: creat df/d12/d43/d50/d58/dc3/fe2 x:0 0 0 2024-09-17T01:56:29.614 INFO:tasks.workunit.client.0.smithi063.stdout:4/722: mkdir de/de3 0 2024-09-17T01:56:29.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/549: dwrite d3/d7/df/d30/f92 [0,4194304] 0 2024-09-17T01:56:29.616 INFO:tasks.workunit.client.0.smithi063.stdout:6/637: write dc/d14/d19/d20/d32/d68/d9c/fa4 [586759,117569] 0 2024-09-17T01:56:29.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/614: link d9/de/d20/d1b/db7/fb9 d9/de/d20/d1b/fd8 0 2024-09-17T01:56:29.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/666: chown df/d12/d1e/d53/f7f 9765 1 2024-09-17T01:56:29.617 INFO:tasks.workunit.client.0.smithi063.stdout:8/555: dread - d1/d7/d28/d2a/d53/f94 zero size 2024-09-17T01:56:29.618 INFO:tasks.workunit.client.0.smithi063.stdout:9/615: readlink d9/d8d/d2a/d40/dac/ld5 0 2024-09-17T01:56:29.619 INFO:tasks.workunit.client.0.smithi063.stdout:4/723: mknod de/d17/d1b/dc7/d28/d30/ce4 0 2024-09-17T01:56:29.619 INFO:tasks.workunit.client.0.smithi063.stdout:5/649: dwrite d6/d37/d19/d68/f81 [4194304,4194304] 0 2024-09-17T01:56:29.619 INFO:tasks.workunit.client.0.smithi063.stdout:3/667: mknod df/d12/d1e/d5e/ce3 0 2024-09-17T01:56:29.620 INFO:tasks.workunit.client.0.smithi063.stdout:2/550: truncate d3/d2a/f82 995297 0 2024-09-17T01:56:29.621 INFO:tasks.workunit.client.0.smithi063.stdout:8/556: chown d1/d7/d28/d2a/d37/d3a/d85 11102 1 2024-09-17T01:56:29.621 INFO:tasks.workunit.client.0.smithi063.stdout:3/668: fsync df/d12/d43/fb4 0 2024-09-17T01:56:29.621 INFO:tasks.workunit.client.0.smithi063.stdout:9/616: write d9/de/d20/d37/d42/fc5 [642063,90121] 0 2024-09-17T01:56:29.623 INFO:tasks.workunit.client.0.smithi063.stdout:1/777: rename d0/d2d/d35/d3f/d81/d50/d8b/cf7 to d0/d2d/d35/d3f/d81/d50/d6c/d90/c106 0 2024-09-17T01:56:29.623 INFO:tasks.workunit.client.0.smithi063.stdout:7/645: dwrite d2/d3/d67/fc8 [0,4194304] 0 2024-09-17T01:56:29.623 INFO:tasks.workunit.client.0.smithi063.stdout:0/660: rename d1/d3 to d1/d3/db/d4b/d2f/d56/dde 22 2024-09-17T01:56:29.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/551: write d3/f10 [1811216,125056] 0 2024-09-17T01:56:29.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/724: creat de/d17/d1b/d9e/fe5 x:0 0 0 2024-09-17T01:56:29.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/638: link dc/d14/d18/d74/f88 dc/d14/d18/d74/fd2 0 2024-09-17T01:56:29.624 INFO:tasks.workunit.client.0.smithi063.stdout:3/669: fsync df/d12/d43/f69 0 2024-09-17T01:56:29.625 INFO:tasks.workunit.client.0.smithi063.stdout:5/650: rename d6/d35/dc1/d29/d2b/fa2 to d6/d9/d32/d8c/da7/fcc 0 2024-09-17T01:56:29.625 INFO:tasks.workunit.client.0.smithi063.stdout:9/617: creat d9/de/d20/d1b/d25/fd9 x:0 0 0 2024-09-17T01:56:29.625 INFO:tasks.workunit.client.0.smithi063.stdout:8/557: read - d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/fa5 zero size 2024-09-17T01:56:29.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/639: write dc/f38 [1635324,971] 0 2024-09-17T01:56:29.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/670: creat df/d12/d43/d50/d58/d97/fe4 x:0 0 0 2024-09-17T01:56:29.628 INFO:tasks.workunit.client.0.smithi063.stdout:5/651: rmdir d6/d35/dc1/d3a 39 2024-09-17T01:56:29.628 INFO:tasks.workunit.client.0.smithi063.stdout:6/640: mkdir dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/da1/dd3 0 2024-09-17T01:56:29.628 INFO:tasks.workunit.client.0.smithi063.stdout:2/552: mkdir d3/d7/d8d/da4 0 2024-09-17T01:56:29.630 INFO:tasks.workunit.client.0.smithi063.stdout:8/558: write d1/d7/d28/d2a/d4d/f6b [934711,48319] 0 2024-09-17T01:56:29.631 INFO:tasks.workunit.client.0.smithi063.stdout:1/778: dwrite d0/d2d/d5e/d7e/fa9 [0,4194304] 0 2024-09-17T01:56:29.631 INFO:tasks.workunit.client.0.smithi063.stdout:4/725: rename de/d17/d36/dbe/ccf to de/d17/d1b/ce6 0 2024-09-17T01:56:29.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/553: rmdir d3/d7/d76 39 2024-09-17T01:56:29.631 INFO:tasks.workunit.client.0.smithi063.stdout:3/671: read df/d12/d1e/d5e/f8d [3969036,120478] 0 2024-09-17T01:56:29.632 INFO:tasks.workunit.client.0.smithi063.stdout:4/726: stat de/d2d/d52/c7c 0 2024-09-17T01:56:29.632 INFO:tasks.workunit.client.0.smithi063.stdout:7/646: dwrite d2/d3/d27/d39/f8a [0,4194304] 0 2024-09-17T01:56:29.633 INFO:tasks.workunit.client.0.smithi063.stdout:5/652: readlink d6/d9/d13/d1d/l30 0 2024-09-17T01:56:29.633 INFO:tasks.workunit.client.0.smithi063.stdout:9/618: getdents d9 0 2024-09-17T01:56:29.635 INFO:tasks.workunit.client.0.smithi063.stdout:5/653: mknod d6/d35/dc1/d3f/dac/ccd 0 2024-09-17T01:56:29.635 INFO:tasks.workunit.client.0.smithi063.stdout:2/554: dread d3/d2a/f47 [0,4194304] 0 2024-09-17T01:56:29.635 INFO:tasks.workunit.client.0.smithi063.stdout:3/672: link df/d12/d43/f69 df/d12/d43/d50/d58/fe5 0 2024-09-17T01:56:29.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/654: dread - d6/d35/dc1/d29/da3/fbf zero size 2024-09-17T01:56:29.637 INFO:tasks.workunit.client.0.smithi063.stdout:8/559: unlink d1/d7/d28/d2a/d37/d3a/d75/l9d 0 2024-09-17T01:56:29.637 INFO:tasks.workunit.client.0.smithi063.stdout:7/647: mkdir d2/d3/d67/d8d/dca 0 2024-09-17T01:56:29.637 INFO:tasks.workunit.client.0.smithi063.stdout:3/673: mkdir df/d12/d43/d50/de6 0 2024-09-17T01:56:29.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/655: stat d6/d35/dc1/d29/d2b/c4e 0 2024-09-17T01:56:29.638 INFO:tasks.workunit.client.0.smithi063.stdout:0/661: dwrite d1/d3/db/d4b/f1c [0,4194304] 0 2024-09-17T01:56:29.639 INFO:tasks.workunit.client.0.smithi063.stdout:3/674: chown df/f49 196380598 1 2024-09-17T01:56:29.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/555: mknod d3/d7/d76/ca5 0 2024-09-17T01:56:29.640 INFO:tasks.workunit.client.0.smithi063.stdout:9/619: link d9/de/d20/d1b/fd8 d9/de/d20/d37/d42/dbe/fda 0 2024-09-17T01:56:29.640 INFO:tasks.workunit.client.0.smithi063.stdout:8/560: mknod d1/d7/d28/d2a/ca7 0 2024-09-17T01:56:29.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/648: creat d2/d15/d2f/d52/fcb x:0 0 0 2024-09-17T01:56:29.643 INFO:tasks.workunit.client.0.smithi063.stdout:3/675: creat df/d12/d30/fe7 x:0 0 0 2024-09-17T01:56:29.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/676: mknod df/d12/d30/db8/ce8 0 2024-09-17T01:56:29.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/779: dwrite d0/d2d/d35/d6f/db7/fd9 [0,4194304] 0 2024-09-17T01:56:29.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/662: getdents d1/d3/db/d18/d85/da8 0 2024-09-17T01:56:29.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/677: chown df/d12/d3a 977038 1 2024-09-17T01:56:29.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/663: chown d1/d3/d10/f4e 41 1 2024-09-17T01:56:29.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/656: dread d6/d35/dc1/d29/d36/f7d [0,4194304] 0 2024-09-17T01:56:29.649 INFO:tasks.workunit.client.0.smithi063.stdout:2/556: dread d3/d7/d76/f7a [0,4194304] 0 2024-09-17T01:56:29.649 INFO:tasks.workunit.client.0.smithi063.stdout:4/727: dread de/d17/d1b/dc7/f1d [0,4194304] 0 2024-09-17T01:56:29.649 INFO:tasks.workunit.client.0.smithi063.stdout:7/649: rename d2/d15/d2f/d45/d48/l5a to d2/d15/d2f/d45/d48/lcc 0 2024-09-17T01:56:29.649 INFO:tasks.workunit.client.0.smithi063.stdout:3/678: readlink df/d12/d1e/l2c 0 2024-09-17T01:56:29.650 INFO:tasks.workunit.client.0.smithi063.stdout:9/620: dwrite d9/de/d20/d37/d42/d4c/f90 [0,4194304] 0 2024-09-17T01:56:29.651 INFO:tasks.workunit.client.0.smithi063.stdout:4/728: write de/d17/d1b/d9e/fae [2150523,64824] 0 2024-09-17T01:56:29.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/780: dwrite d0/f1b [0,4194304] 0 2024-09-17T01:56:29.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/650: mkdir d2/d15/d2f/d3e/d73/dcd 0 2024-09-17T01:56:29.654 INFO:tasks.workunit.client.0.smithi063.stdout:4/729: mkdir de/d17/d36/de7 0 2024-09-17T01:56:29.654 INFO:tasks.workunit.client.0.smithi063.stdout:2/557: write d3/d7/df/d68/f35 [3768570,109320] 0 2024-09-17T01:56:29.655 INFO:tasks.workunit.client.0.smithi063.stdout:0/664: read d1/d3/d1b/f38 [4519510,45359] 0 2024-09-17T01:56:29.655 INFO:tasks.workunit.client.0.smithi063.stdout:0/665: read d1/d3/db/d4b/d7d/f91 [2830108,43594] 0 2024-09-17T01:56:29.656 INFO:tasks.workunit.client.0.smithi063.stdout:2/558: unlink d3/d7/f26 0 2024-09-17T01:56:29.657 INFO:tasks.workunit.client.0.smithi063.stdout:7/651: creat d2/d3/fce x:0 0 0 2024-09-17T01:56:29.657 INFO:tasks.workunit.client.0.smithi063.stdout:0/666: getdents d1/d3/db/d18/d85/da8 0 2024-09-17T01:56:29.658 INFO:tasks.workunit.client.0.smithi063.stdout:2/559: creat d3/d7/d76/fa6 x:0 0 0 2024-09-17T01:56:29.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/652: write d2/d3/d67/f75 [662346,126640] 0 2024-09-17T01:56:29.659 INFO:tasks.workunit.client.0.smithi063.stdout:4/730: dread de/d17/d36/f94 [0,4194304] 0 2024-09-17T01:56:29.660 INFO:tasks.workunit.client.0.smithi063.stdout:7/653: mknod d2/d3/d27/d39/ccf 0 2024-09-17T01:56:29.661 INFO:tasks.workunit.client.0.smithi063.stdout:0/667: rename d1/d1f/f41 to d1/d3/db/d6e/d86/dcc/d7c/db6/fdf 0 2024-09-17T01:56:29.661 INFO:tasks.workunit.client.0.smithi063.stdout:4/731: write de/d17/d36/d70/d77/fb7 [404054,96013] 0 2024-09-17T01:56:29.661 INFO:tasks.workunit.client.0.smithi063.stdout:1/781: write d0/d1c/f96 [3167116,95389] 0 2024-09-17T01:56:29.662 INFO:tasks.workunit.client.0.smithi063.stdout:0/668: stat d1/d3/db/f3e 0 2024-09-17T01:56:29.663 INFO:tasks.workunit.client.0.smithi063.stdout:7/654: symlink d2/d3/d17/d25/db0/ld0 0 2024-09-17T01:56:29.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/732: creat de/d2d/d52/d9c/fe8 x:0 0 0 2024-09-17T01:56:29.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/669: dread - d1/d3/db/d4b/fbb zero size 2024-09-17T01:56:29.664 INFO:tasks.workunit.client.0.smithi063.stdout:7/655: creat d2/d3/d67/d8d/dca/fd1 x:0 0 0 2024-09-17T01:56:29.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/670: mkdir d1/d3/db/d4b/de0 0 2024-09-17T01:56:29.665 INFO:tasks.workunit.client.0.smithi063.stdout:1/782: link d0/d2d/fc2 d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc/f107 0 2024-09-17T01:56:29.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/621: dread d9/d8d/d2a/d36/f6f [0,4194304] 0 2024-09-17T01:56:29.672 INFO:tasks.workunit.client.0.smithi063.stdout:2/560: read d3/d7/df/d68/f51 [2800460,23835] 0 2024-09-17T01:56:29.673 INFO:tasks.workunit.client.0.smithi063.stdout:8/561: dread d1/d7/f13 [0,4194304] 0 2024-09-17T01:56:29.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/733: write de/d17/d1b/dc7/f4e [1164339,113545] 0 2024-09-17T01:56:29.673 INFO:tasks.workunit.client.0.smithi063.stdout:2/561: stat d3/l1d 0 2024-09-17T01:56:29.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/622: write d9/de/d20/d1b/d25/d73/fd6 [554998,4329] 0 2024-09-17T01:56:29.674 INFO:tasks.workunit.client.0.smithi063.stdout:0/671: write d1/d3/db/f13 [785801,68529] 0 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:13792 4.17 4:e8b8248c:::100000033dc.00000000:head [read 2097152~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:29.679371+0000", 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0012649269999999999, 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0012852689999999999, 2024-09-17T01:56:29.675 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 13792 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679371+0000", 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:29.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679371+0000", 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679372+0000", 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.052e-06 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679377+0000", 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1080000000000001e-06 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679388+0000", 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0752e-05 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679394+0000", 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.2890000000000003e-06 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679438+0000", 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.3775e-05 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679492+0000", 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4171e-05 2024-09-17T01:56:29.679 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:13793 4.3c 4:3c1589f2:::100000032ca.00000000:head [write 1164339~113545 in=113545b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:29.679905+0000", 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.00073065399999999996, 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00079569199999999997, 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:29.680 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 13793 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679905+0000", 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679905+0000", 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.679906+0000", 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.51e-07 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680021+0000", 2024-09-17T01:56:29.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000115592 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680033+0000", 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1377e-05 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680039+0000", 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.0909999999999998e-06 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:29.683 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680098+0000", 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.9471e-05 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680261+0000", 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016291 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:13794 4.2f 4:f52d3c0b:::10000003200.00000000:head [read 2097152~2097152 [2@2875023]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-17T01:56:29.684 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:29.680403+0000", 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.000232511, 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00033622399999999998, 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 13794 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680403+0000", 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680403+0000", 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680404+0000", 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.9900000000000001e-07 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680406+0000", 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1390000000000002e-06 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680411+0000", 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.0320000000000003e-06 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680414+0000", 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1310000000000002e-06 2024-09-17T01:56:29.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680468+0000", 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.3235000000000001e-05 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:29.680538+0000", 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.0588999999999998e-05 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.688 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:29.689 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:29.689 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 3 2024-09-17T01:56:29.689 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:29.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/562: mknod d3/d28/d72/ca7 0 2024-09-17T01:56:29.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/623: rmdir d9/de 39 2024-09-17T01:56:29.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/672: chown d1/d3/d1b/cb8 80471 1 2024-09-17T01:56:29.692 INFO:tasks.workunit.client.0.smithi063.stdout:4/734: truncate de/d17/d1b/d9e/fae 4705726 0 2024-09-17T01:56:29.692 INFO:tasks.workunit.client.0.smithi063.stdout:2/563: write d3/d7/d38/f45 [1144725,126571] 0 2024-09-17T01:56:29.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/673: fdatasync d1/d1d/f2d 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:4/735: creat de/fe9 x:0 0 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/564: creat d3/d28/fa8 x:0 0 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:9/624: truncate d9/de/d20/d32/fbc 86345 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:0/674: symlink d1/d3/db/d6e/le1 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/565: dread - d3/f91 zero size 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:4/736: readlink de/d17/d1b/dc7/d28/d30/l48 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/566: read - d3/d2a/f8b zero size 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:6/641: dread dc/d14/d19/d20/f71 [0,4194304] 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/567: dread - d3/d2a/fa0 zero size 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:5/657: dread d6/d37/d19/f2c [0,4194304] 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/568: write d3/d7/d38/f56 [1364715,62824] 0 2024-09-17T01:56:29.693 INFO:tasks.workunit.client.0.smithi063.stdout:8/562: dread d1/d7/f39 [0,4194304] 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/658: write d6/d37/d19/f75 [2111867,91472] 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:3/679: dread df/f26 [0,4194304] 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:2/569: write d3/f4 [580802,53757] 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/563: creat d1/d7/d28/d87/fa8 x:0 0 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:3/680: chown df/d28/l99 5758974 1 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/659: creat d6/d35/dc1/d3f/fce x:0 0 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/625: dwrite d9/d8d/f79 [0,4194304] 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/675: dwrite d1/d3/db/d4b/d2f/d56/f57 [0,4194304] 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/564: getdents d1/d7/d1d/d9c 0 2024-09-17T01:56:29.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/626: symlink d9/d8d/d75/ldb 0 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:3/681: rename df/f49 to df/d12/d43/d50/d58/d97/daa/fe9 0 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:0/676: chown d1/d1f/c80 5449 1 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:5/660: mknod d6/d35/dc1/d29/d2b/ccf 0 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:6/642: dwrite dc/d14/d19/d20/d32/d52/d5a/f40 [0,4194304] 0 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:9/627: rename d9/de/d20/d1b/fd4 to d9/d8d/d75/fdc 0 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:2/570: dwrite d3/d7/df/d68/f51 [0,4194304] 0 2024-09-17T01:56:29.696 INFO:tasks.workunit.client.0.smithi063.stdout:3/682: creat df/d12/d43/d50/d58/d97/daa/db1/dcc/fea x:0 0 0 2024-09-17T01:56:29.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:29.697 INFO:tasks.workunit.client.0.smithi063.stdout:0/677: fdatasync d1/d3/db/d6e/d86/fb1 0 2024-09-17T01:56:29.700 INFO:tasks.workunit.client.0.smithi063.stdout:5/661: rmdir d6/d35/dc1/d29/d2b/d31/da8 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:6/643: creat dc/d14/d19/d20/d32/d52/d5a/fd4 x:0 0 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:1/783: sync 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:7/656: sync 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/683: mknod df/d12/d43/d50/d58/d97/daa/ceb 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/678: fsync d1/d3/db/d6e/d86/dcc/d7c/fdb 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:2/571: write d3/d7/df/f1a [6927053,107174] 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:8/565: dwrite d1/d7/d1d/f3e [0,4194304] 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:9/628: creat d9/de/d20/d1b/d25/d73/fdd x:0 0 0 2024-09-17T01:56:29.701 INFO:tasks.workunit.client.0.smithi063.stdout:1/784: chown d0/d2d/d5e/c89 38 1 2024-09-17T01:56:29.702 INFO:tasks.workunit.client.0.smithi063.stdout:5/662: write d6/d35/dc1/d29/d36/f5b [8214431,75309] 0 2024-09-17T01:56:29.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/572: fsync d3/d2a/fa0 0 2024-09-17T01:56:29.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/573: chown d3/l1d 20171 1 2024-09-17T01:56:29.703 INFO:tasks.workunit.client.0.smithi063.stdout:5/663: chown d6/d35/dc1/d29/c6e 241532 1 2024-09-17T01:56:29.703 INFO:tasks.workunit.client.0.smithi063.stdout:7/657: mkdir d2/d3/d27/d65/dd2 0 2024-09-17T01:56:29.703 INFO:tasks.workunit.client.0.smithi063.stdout:9/629: chown d9/de/d20/d37/d42/d4c/l62 662367 1 2024-09-17T01:56:29.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/684: symlink df/d12/d30/db8/lec 0 2024-09-17T01:56:29.704 INFO:tasks.workunit.client.0.smithi063.stdout:8/566: creat d1/d27/d82/fa9 x:0 0 0 2024-09-17T01:56:29.704 INFO:tasks.workunit.client.0.smithi063.stdout:2/574: mkdir d3/d7/d38/da9 0 2024-09-17T01:56:29.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/658: write d2/d15/d2f/d52/f63 [252649,64550] 0 2024-09-17T01:56:29.705 INFO:tasks.workunit.client.0.smithi063.stdout:2/575: chown d3/d7/d38/da9 865908573 1 2024-09-17T01:56:29.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/630: write d9/de/d20/fa3 [494643,58190] 0 2024-09-17T01:56:29.705 INFO:tasks.workunit.client.0.smithi063.stdout:3/685: fdatasync df/d12/d43/f69 0 2024-09-17T01:56:29.705 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:29.705+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:29.706 INFO:tasks.workunit.client.0.smithi063.stdout:1/785: write d0/d93/d9e/dca/fcc [509545,124102] 0 2024-09-17T01:56:29.707 INFO:tasks.workunit.client.0.smithi063.stdout:7/659: write d2/d3/d27/d39/d40/f50 [437460,69093] 0 2024-09-17T01:56:29.707 INFO:tasks.workunit.client.0.smithi063.stdout:2/576: rename d3/d7/df/l17 to d3/d7/d8d/laa 0 2024-09-17T01:56:29.707 INFO:tasks.workunit.client.0.smithi063.stdout:9/631: mkdir d9/d8d/d2a/d40/dac/dc2/dde 0 2024-09-17T01:56:29.708 INFO:tasks.workunit.client.0.smithi063.stdout:4/737: dread de/d2d/f64 [0,4194304] 0 2024-09-17T01:56:29.708 INFO:tasks.workunit.client.0.smithi063.stdout:1/786: truncate d0/f2 411484 0 2024-09-17T01:56:29.710 INFO:tasks.workunit.client.0.smithi063.stdout:4/738: mkdir de/d2d/d3c/dea 0 2024-09-17T01:56:29.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/567: dwrite d1/d7/d1d/f5f [0,4194304] 0 2024-09-17T01:56:29.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/644: dwrite dc/d14/d19/d20/d32/d52/d5a/f9b [0,4194304] 0 2024-09-17T01:56:29.714 INFO:tasks.workunit.client.0.smithi063.stdout:4/739: mknod de/d17/dc6/ceb 0 2024-09-17T01:56:29.714 INFO:tasks.workunit.client.0.smithi063.stdout:0/679: dwrite d1/d3/db/d4b/d2f/d56/f57 [0,4194304] 0 2024-09-17T01:56:29.715 INFO:tasks.workunit.client.0.smithi063.stdout:0/680: rmdir d1/d3/d1b/d50 39 2024-09-17T01:56:29.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/686: dwrite df/d12/d43/d50/d58/d97/daa/fde [0,4194304] 0 2024-09-17T01:56:29.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/740: creat de/d17/d1b/dc7/d28/fec x:0 0 0 2024-09-17T01:56:29.721 INFO:tasks.workunit.client.0.smithi063.stdout:0/681: mkdir d1/d3/db/d18/d85/d92/dd4/de2 0 2024-09-17T01:56:29.721 INFO:tasks.workunit.client.0.smithi063.stdout:3/687: write df/d12/d2d/f36 [974206,40081] 0 2024-09-17T01:56:29.722 INFO:tasks.workunit.client.0.smithi063.stdout:4/741: getdents de/d2d/d52 0 2024-09-17T01:56:29.723 INFO:tasks.workunit.client.0.smithi063.stdout:4/742: mknod de/d2d/d52/ced 0 2024-09-17T01:56:29.723 INFO:tasks.workunit.client.0.smithi063.stdout:0/682: rename d1/d3/db/d6e/fa2 to d1/d3/db/d6e/d86/dcc/d7c/d88/fe3 0 2024-09-17T01:56:29.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/683: write d1/d3/db/d4b/d98/fbe [1217162,97659] 0 2024-09-17T01:56:29.724 INFO:tasks.workunit.client.0.smithi063.stdout:4/743: creat de/d17/d1b/dc7/d28/fee x:0 0 0 2024-09-17T01:56:29.725 INFO:tasks.workunit.client.0.smithi063.stdout:4/744: chown de/d17/d1b/dc7/d28/d30 17732833 1 2024-09-17T01:56:29.729 INFO:tasks.workunit.client.0.smithi063.stdout:8/568: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f61 899581 0 2024-09-17T01:56:29.729 INFO:tasks.workunit.client.0.smithi063.stdout:6/645: sync 2024-09-17T01:56:29.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/688: dwrite df/d12/d1e/f2b [0,4194304] 0 2024-09-17T01:56:29.730 INFO:tasks.workunit.client.0.smithi063.stdout:3/689: readlink df/d12/d43/d50/d58/d97/daa/lcb 0 2024-09-17T01:56:29.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/684: dwrite d1/f1e [0,4194304] 0 2024-09-17T01:56:29.736 INFO:tasks.workunit.client.0.smithi063.stdout:3/690: rename df/d12/d43/d50/d87/dbb/fe1 to df/d12/d3a/fed 0 2024-09-17T01:56:29.740 INFO:tasks.workunit.client.0.smithi063.stdout:7/660: dread d2/d3/d67/f10 [0,4194304] 0 2024-09-17T01:56:29.741 INFO:tasks.workunit.client.0.smithi063.stdout:3/691: dread df/d12/d1e/d5e/f76 [0,4194304] 0 2024-09-17T01:56:29.741 INFO:tasks.workunit.client.0.smithi063.stdout:1/787: dread d0/f20 [0,4194304] 0 2024-09-17T01:56:29.741 INFO:tasks.workunit.client.0.smithi063.stdout:5/664: dread d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:29.742 INFO:tasks.workunit.client.0.smithi063.stdout:1/788: chown d0/d2d/d35/d9d/fa8 1 1 2024-09-17T01:56:29.742 INFO:tasks.workunit.client.0.smithi063.stdout:7/661: mkdir d2/d15/d2f/dd3 0 2024-09-17T01:56:29.742 INFO:tasks.workunit.client.0.smithi063.stdout:6/646: dwrite dc/d14/d19/f35 [0,4194304] 0 2024-09-17T01:56:29.743 INFO:tasks.workunit.client.0.smithi063.stdout:8/569: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f61 [1225715,23053] 0 2024-09-17T01:56:29.745 INFO:tasks.workunit.client.0.smithi063.stdout:3/692: dread df/d12/d1e/f27 [0,4194304] 0 2024-09-17T01:56:29.745 INFO:tasks.workunit.client.0.smithi063.stdout:9/632: dread d9/d8d/f46 [0,4194304] 0 2024-09-17T01:56:29.745 INFO:tasks.workunit.client.0.smithi063.stdout:3/693: chown df/d12/lc7 87 1 2024-09-17T01:56:29.746 INFO:tasks.workunit.client.0.smithi063.stdout:9/633: write d9/d8d/d2a/d36/f78 [1428160,55402] 0 2024-09-17T01:56:29.746 INFO:tasks.workunit.client.0.smithi063.stdout:3/694: fsync df/d28/f48 0 2024-09-17T01:56:29.747 INFO:tasks.workunit.client.0.smithi063.stdout:9/634: mkdir d9/d8d/ddf 0 2024-09-17T01:56:29.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/665: link d6/d37/d19/d68/fad d6/d9/d32/d8c/da7/da9/fd0 0 2024-09-17T01:56:29.747 INFO:tasks.workunit.client.0.smithi063.stdout:7/662: truncate d2/d3/d67/f53 140625 0 2024-09-17T01:56:29.747 INFO:tasks.workunit.client.0.smithi063.stdout:8/570: chown d1/d7/d1d/c22 92385 1 2024-09-17T01:56:29.748 INFO:tasks.workunit.client.0.smithi063.stdout:7/663: chown d2/d15 75855 1 2024-09-17T01:56:29.748 INFO:tasks.workunit.client.0.smithi063.stdout:6/647: getdents dc/d14/d19/d20/d32/d52/d5a/d62/d7e/d8f/dbc 0 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:8/571: creat d1/d7/d28/faa x:0 0 0 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:3/695: write df/d12/d43/d50/d58/d97/fe4 [887853,39595] 0 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:7/664: readlink d2/d3/d27/d39/d40/la7 0 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:5/666: symlink d6/d37/d19/d50/d92/ld1 0 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/648: write dc/f12 [1208248,4683] 0 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:7/665: rmdir d2 39 2024-09-17T01:56:29.749 INFO:tasks.workunit.client.0.smithi063.stdout:8/572: chown d1/d7/d28/d2a/d53 494040 1 2024-09-17T01:56:29.750 INFO:tasks.workunit.client.0.smithi063.stdout:5/667: stat d6/d35/dc1/d3f/dac/ccd 0 2024-09-17T01:56:29.750 INFO:tasks.workunit.client.0.smithi063.stdout:9/635: read d9/f5b [2870594,16285] 0 2024-09-17T01:56:29.750 INFO:tasks.workunit.client.0.smithi063.stdout:6/649: readlink dc/d14/d19/d20/d32/d52/d5a/d62/l95 0 2024-09-17T01:56:29.751 INFO:tasks.workunit.client.0.smithi063.stdout:5/668: write d6/d9/d32/f8e [27877,109385] 0 2024-09-17T01:56:29.751 INFO:tasks.workunit.client.0.smithi063.stdout:6/650: write f3 [968957,89273] 0 2024-09-17T01:56:29.751 INFO:tasks.workunit.client.0.smithi063.stdout:7/666: chown d2/d3/d27/d33/d7b/d9b/da6/lac 2 1 2024-09-17T01:56:29.753 INFO:tasks.workunit.client.0.smithi063.stdout:8/573: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/f7b to d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/fab 0 2024-09-17T01:56:29.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/667: mkdir d2/d3/d67/d8d/dd4 0 2024-09-17T01:56:29.754 INFO:tasks.workunit.client.0.smithi063.stdout:9/636: link d9/d8d/d2a/d40/fc1 d9/d8d/d2a/d40/dac/fe0 0 2024-09-17T01:56:29.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/669: fsync d6/d9/d32/d8c/da7/da9/fd0 0 2024-09-17T01:56:29.754 INFO:tasks.workunit.client.0.smithi063.stdout:8/574: chown d1/d7/d28/f50 88 1 2024-09-17T01:56:29.755 INFO:tasks.workunit.client.0.smithi063.stdout:5/670: sync 2024-09-17T01:56:29.755 INFO:tasks.workunit.client.0.smithi063.stdout:6/651: link dc/fa8 dc/d14/d19/d20/d66/fd5 0 2024-09-17T01:56:29.755 INFO:tasks.workunit.client.0.smithi063.stdout:5/671: dread - d6/f91 zero size 2024-09-17T01:56:29.755 INFO:tasks.workunit.client.0.smithi063.stdout:1/789: dread d0/d93/d9e/dca/fee [0,4194304] 0 2024-09-17T01:56:29.756 INFO:tasks.workunit.client.0.smithi063.stdout:8/575: chown d1/d7/d28/d87/f8e 100 1 2024-09-17T01:56:29.756 INFO:tasks.workunit.client.0.smithi063.stdout:2/577: dread d3/d7/df/d68/f35 [0,4194304] 0 2024-09-17T01:56:29.756 INFO:tasks.workunit.client.0.smithi063.stdout:3/696: truncate df/d12/d43/d50/d58/f5b 3158827 0 2024-09-17T01:56:29.756 INFO:tasks.workunit.client.0.smithi063.stdout:1/790: chown d0/d2d/d5e/dc5 59 1 2024-09-17T01:56:29.757 INFO:tasks.workunit.client.0.smithi063.stdout:9/637: mknod d9/de/d20/d1b/ce1 0 2024-09-17T01:56:29.757 INFO:tasks.workunit.client.0.smithi063.stdout:8/576: symlink d1/d27/d81/lac 0 2024-09-17T01:56:29.757 INFO:tasks.workunit.client.0.smithi063.stdout:6/652: read - dc/d14/d19/d20/d32/d52/d5a/d62/d7e/f8a zero size 2024-09-17T01:56:29.758 INFO:tasks.workunit.client.0.smithi063.stdout:2/578: unlink d3/d7/df/f25 0 2024-09-17T01:56:29.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/653: fsync dc/d1b/f4b 0 2024-09-17T01:56:29.759 INFO:tasks.workunit.client.0.smithi063.stdout:9/638: symlink d9/d8d/d2a/d40/dac/le2 0 2024-09-17T01:56:29.760 INFO:tasks.workunit.client.0.smithi063.stdout:2/579: symlink d3/d7/df/d43/lab 0 2024-09-17T01:56:29.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/654: write dc/d14/d18/f42 [400469,97330] 0 2024-09-17T01:56:29.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/577: chown d1/d7/d28/d2a/d59/l6d 3222 1 2024-09-17T01:56:29.762 INFO:tasks.workunit.client.0.smithi063.stdout:9/639: rmdir d9/de/d20/d1b/d25/d73/da4 39 2024-09-17T01:56:29.763 INFO:tasks.workunit.client.0.smithi063.stdout:2/580: chown d3/d7/d76/f7a 295 1 2024-09-17T01:56:29.763 INFO:tasks.workunit.client.0.smithi063.stdout:6/655: fsync dc/d14/d18/d74/fd2 0 2024-09-17T01:56:29.764 INFO:tasks.workunit.client.0.smithi063.stdout:4/745: dread de/d17/d1b/dc7/f9f [0,4194304] 0 2024-09-17T01:56:29.765 INFO:tasks.workunit.client.0.smithi063.stdout:8/578: write d1/d7/d28/f45 [1527620,62083] 0 2024-09-17T01:56:29.765 INFO:tasks.workunit.client.0.smithi063.stdout:5/672: dwrite d6/d35/dc1/fb5 [0,4194304] 0 2024-09-17T01:56:29.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/581: write d3/d7/df/d30/f92 [184521,20701] 0 2024-09-17T01:56:29.767 INFO:tasks.workunit.client.0.smithi063.stdout:4/746: write de/d2d/d52/d9c/fb9 [1440826,110161] 0 2024-09-17T01:56:29.767 INFO:tasks.workunit.client.0.smithi063.stdout:3/697: dwrite df/d12/d1e/f4f [4194304,4194304] 0 2024-09-17T01:56:29.768 INFO:tasks.workunit.client.0.smithi063.stdout:8/579: write d1/d7/d28/f45 [313907,28353] 0 2024-09-17T01:56:29.770 INFO:tasks.workunit.client.0.smithi063.stdout:5/673: unlink d6/c3b 0 2024-09-17T01:56:29.770 INFO:tasks.workunit.client.0.smithi063.stdout:9/640: creat d9/de/d20/d1b/d25/d73/fe3 x:0 0 0 2024-09-17T01:56:29.770 INFO:tasks.workunit.client.0.smithi063.stdout:2/582: mkdir d3/d2a/dac 0 2024-09-17T01:56:29.771 INFO:tasks.workunit.client.0.smithi063.stdout:0/685: dread d1/d3/db/d6e/d86/dcc/d7c/db6/fdf [0,4194304] 0 2024-09-17T01:56:29.771 INFO:tasks.workunit.client.0.smithi063.stdout:5/674: creat d6/d35/dc1/fd2 x:0 0 0 2024-09-17T01:56:29.772 INFO:tasks.workunit.client.0.smithi063.stdout:0/686: write d1/d3/d32/fcb [555130,16079] 0 2024-09-17T01:56:29.772 INFO:tasks.workunit.client.0.smithi063.stdout:8/580: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f4a 783249 0 2024-09-17T01:56:29.773 INFO:tasks.workunit.client.0.smithi063.stdout:5/675: fsync d6/d35/dc1/d29/d36/f5b 0 2024-09-17T01:56:29.773 INFO:tasks.workunit.client.0.smithi063.stdout:2/583: getdents d3/d7 0 2024-09-17T01:56:29.774 INFO:tasks.workunit.client.0.smithi063.stdout:3/698: write df/d12/d43/d50/d58/d97/fe4 [1847119,55707] 0 2024-09-17T01:56:29.774 INFO:tasks.workunit.client.0.smithi063.stdout:6/656: dwrite dc/d14/d19/d20/d32/d52/f80 [0,4194304] 0 2024-09-17T01:56:29.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/657: write dc/d14/fc4 [542253,127616] 0 2024-09-17T01:56:29.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/699: mknod df/d12/d1e/d53/dca/cee 0 2024-09-17T01:56:29.777 INFO:tasks.workunit.client.0.smithi063.stdout:5/676: mkdir d6/d35/dc1/d29/da3/dc8/dd3 0 2024-09-17T01:56:29.777 INFO:tasks.workunit.client.0.smithi063.stdout:8/581: write d1/d7/f39 [1220983,125019] 0 2024-09-17T01:56:29.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/700: unlink df/c9b 0 2024-09-17T01:56:29.778 INFO:tasks.workunit.client.0.smithi063.stdout:5/677: creat d6/d35/dc1/d3f/fd4 x:0 0 0 2024-09-17T01:56:29.780 INFO:tasks.workunit.client.0.smithi063.stdout:8/582: symlink d1/d7/d28/d2a/lad 0 2024-09-17T01:56:29.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/658: rename dc/d14/d19/d20/d32/d52/d5a/d62/d7e to dc/d14/d19/d20/d32/d52/d5a/dd0/dd6 0 2024-09-17T01:56:29.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/701: creat df/d12/d43/d50/de6/fef x:0 0 0 2024-09-17T01:56:29.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/659: fsync dc/d14/d19/d20/d32/d52/f60 0 2024-09-17T01:56:29.781 INFO:tasks.workunit.client.0.smithi063.stdout:0/687: dwrite d1/d3/db/d6e/d86/dcc/d7c/fdb [0,4194304] 0 2024-09-17T01:56:29.782 INFO:tasks.workunit.client.0.smithi063.stdout:8/583: stat d1/d7/d28/d2a/d4d/l65 0 2024-09-17T01:56:29.783 INFO:tasks.workunit.client.0.smithi063.stdout:3/702: mknod df/d12/d43/d50/d87/dbb/cf0 0 2024-09-17T01:56:29.784 INFO:tasks.workunit.client.0.smithi063.stdout:1/791: dread d0/d93/d9e/dca/fd5 [0,4194304] 0 2024-09-17T01:56:29.784 INFO:tasks.workunit.client.0.smithi063.stdout:8/584: creat d1/d7/d28/d2a/d4d/fae x:0 0 0 2024-09-17T01:56:29.784 INFO:tasks.workunit.client.0.smithi063.stdout:9/641: truncate d9/d27/f3b 7808668 0 2024-09-17T01:56:29.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/747: read de/d2d/d52/f84 [2228460,94578] 0 2024-09-17T01:56:29.785 INFO:tasks.workunit.client.0.smithi063.stdout:3/703: creat df/d12/d43/d50/d58/db5/ff1 x:0 0 0 2024-09-17T01:56:29.785 INFO:tasks.workunit.client.0.smithi063.stdout:0/688: getdents d1/d3/db/d6e/d86/dcc/d53 0 2024-09-17T01:56:29.786 INFO:tasks.workunit.client.0.smithi063.stdout:5/678: dwrite d6/fd [0,4194304] 0 2024-09-17T01:56:29.787 INFO:tasks.workunit.client.0.smithi063.stdout:8/585: mkdir d1/d7/d28/d2a/d37/d3a/daf 0 2024-09-17T01:56:29.788 INFO:tasks.workunit.client.0.smithi063.stdout:7/668: dread d2/d15/d2f/d45/d48/fbc [0,4194304] 0 2024-09-17T01:56:29.788 INFO:tasks.workunit.client.0.smithi063.stdout:9/642: mknod d9/de/d20/d37/d42/dbe/ce4 0 2024-09-17T01:56:29.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/748: read de/d17/d36/dbe/f91 [1739994,31015] 0 2024-09-17T01:56:29.788 INFO:tasks.workunit.client.0.smithi063.stdout:0/689: write d1/d3/db/d4b/d2f/d56/f57 [2503280,64535] 0 2024-09-17T01:56:29.789 INFO:tasks.workunit.client.0.smithi063.stdout:4/749: chown de/d17/d1b/dc7/d28/d30/f61 0 1 2024-09-17T01:56:29.790 INFO:tasks.workunit.client.0.smithi063.stdout:8/586: symlink d1/d7/d28/d2a/d53/lb0 0 2024-09-17T01:56:29.790 INFO:tasks.workunit.client.0.smithi063.stdout:3/704: rename df/d12/d30/d8a/fc1 to df/d12/d43/d50/d87/dbb/ff2 0 2024-09-17T01:56:29.791 INFO:tasks.workunit.client.0.smithi063.stdout:1/792: link d0/d93/d9e/la3 d0/d2d/d35/d3f/d81/d50/d6c/d102/l108 0 2024-09-17T01:56:29.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/679: dread d6/d9/d13/d1d/f56 [4194304,4194304] 0 2024-09-17T01:56:29.793 INFO:tasks.workunit.client.0.smithi063.stdout:9/643: getdents d9/de/d20/d1b/d25/d73 0 2024-09-17T01:56:29.793 INFO:tasks.workunit.client.0.smithi063.stdout:8/587: symlink d1/d7/d28/d2a/d37/d3a/d75/d9a/lb1 0 2024-09-17T01:56:29.793 INFO:tasks.workunit.client.0.smithi063.stdout:5/680: creat d6/d9/d13/fd5 x:0 0 0 2024-09-17T01:56:29.795 INFO:tasks.workunit.client.0.smithi063.stdout:8/588: mkdir d1/d7/d1d/d9c/db2 0 2024-09-17T01:56:29.795 INFO:tasks.workunit.client.0.smithi063.stdout:9/644: write d9/de/d20/d37/f8e [4510419,82246] 0 2024-09-17T01:56:29.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/669: dwrite d2/d15/f59 [0,4194304] 0 2024-09-17T01:56:29.799 INFO:tasks.workunit.client.0.smithi063.stdout:3/705: dwrite df/d12/d1e/f6e [0,4194304] 0 2024-09-17T01:56:29.799 INFO:tasks.workunit.client.0.smithi063.stdout:4/750: dwrite de/f4c [0,4194304] 0 2024-09-17T01:56:29.800 INFO:tasks.workunit.client.0.smithi063.stdout:9/645: write d9/de/d20/d1b/d25/f2b [3471727,18760] 0 2024-09-17T01:56:29.802 INFO:tasks.workunit.client.0.smithi063.stdout:0/690: truncate d1/d3/d1b/f29 3434547 0 2024-09-17T01:56:29.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/706: creat df/d12/d1e/d39/ff3 x:0 0 0 2024-09-17T01:56:29.805 INFO:tasks.workunit.client.0.smithi063.stdout:3/707: readlink df/d12/d43/d50/d58/d97/daa/lcb 0 2024-09-17T01:56:29.805 INFO:tasks.workunit.client.0.smithi063.stdout:7/670: symlink d2/d15/d2f/d52/d97/ld5 0 2024-09-17T01:56:29.805 INFO:tasks.workunit.client.0.smithi063.stdout:9/646: creat d9/de/d20/d1b/d25/d73/fe5 x:0 0 0 2024-09-17T01:56:29.805 INFO:tasks.workunit.client.0.smithi063.stdout:8/589: rename d1/d7/f14 to d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/fb3 0 2024-09-17T01:56:29.805 INFO:tasks.workunit.client.0.smithi063.stdout:2/584: dread d3/d7/d38/f65 [0,4194304] 0 2024-09-17T01:56:29.806 INFO:tasks.workunit.client.0.smithi063.stdout:7/671: readlink d2/d15/d2f/l6c 0 2024-09-17T01:56:29.806 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:29.809+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:29.806 INFO:tasks.workunit.client.0.smithi063.stdout:6/660: sync 2024-09-17T01:56:29.806 INFO:tasks.workunit.client.0.smithi063.stdout:5/681: sync 2024-09-17T01:56:29.807 INFO:tasks.workunit.client.0.smithi063.stdout:2/585: read d3/d7/d38/f65 [3052186,129092] 0 2024-09-17T01:56:29.807 INFO:tasks.workunit.client.0.smithi063.stdout:9/647: creat d9/d8d/d2a/d40/dac/fe6 x:0 0 0 2024-09-17T01:56:29.808 INFO:tasks.workunit.client.0.smithi063.stdout:3/708: getdents df/d12/d3a 0 2024-09-17T01:56:29.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/586: creat d3/d2a/fad x:0 0 0 2024-09-17T01:56:29.808 INFO:tasks.workunit.client.0.smithi063.stdout:3/709: creat df/d83/ff4 x:0 0 0 2024-09-17T01:56:29.810 INFO:tasks.workunit.client.0.smithi063.stdout:3/710: mkdir df/d12/d2d/ddc/df5 0 2024-09-17T01:56:29.810 INFO:tasks.workunit.client.0.smithi063.stdout:5/682: dread d6/d35/dc1/d29/d36/f7d [0,4194304] 0 2024-09-17T01:56:29.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/590: dwrite d1/d7/d28/d2a/f8d [0,4194304] 0 2024-09-17T01:56:29.813 INFO:tasks.workunit.client.0.smithi063.stdout:9/648: write d9/de/d20/d1b/f95 [1617837,14767] 0 2024-09-17T01:56:29.813 INFO:tasks.workunit.client.0.smithi063.stdout:5/683: creat d6/d9/fd6 x:0 0 0 2024-09-17T01:56:29.813 INFO:tasks.workunit.client.0.smithi063.stdout:4/751: write de/d17/d36/dbe/f91 [792884,27827] 0 2024-09-17T01:56:29.814 INFO:tasks.workunit.client.0.smithi063.stdout:9/649: chown l5 17 1 2024-09-17T01:56:29.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/591: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f58 [5844241,19626] 0 2024-09-17T01:56:29.817 INFO:tasks.workunit.client.0.smithi063.stdout:4/752: mknod de/d17/d1b/dc7/d28/d98/cef 0 2024-09-17T01:56:29.817 INFO:tasks.workunit.client.0.smithi063.stdout:7/672: dwrite d2/d15/f6b [0,4194304] 0 2024-09-17T01:56:29.817 INFO:tasks.workunit.client.0.smithi063.stdout:1/793: sync 2024-09-17T01:56:29.819 INFO:tasks.workunit.client.0.smithi063.stdout:0/691: dwrite d1/d3/db/f39 [0,4194304] 0 2024-09-17T01:56:29.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/673: fdatasync d2/d3/d27/f32 0 2024-09-17T01:56:29.820 INFO:tasks.workunit.client.0.smithi063.stdout:3/711: dwrite df/d12/d43/d50/d58/d97/fe4 [0,4194304] 0 2024-09-17T01:56:29.822 INFO:tasks.workunit.client.0.smithi063.stdout:3/712: truncate df/d83/ff4 938465 0 2024-09-17T01:56:29.823 INFO:tasks.workunit.client.0.smithi063.stdout:5/684: dwrite d6/d37/d19/f26 [0,4194304] 0 2024-09-17T01:56:29.824 INFO:tasks.workunit.client.0.smithi063.stdout:3/713: readlink df/d12/d1e/l2c 0 2024-09-17T01:56:29.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/692: truncate d1/d3/d32/f69 736403 0 2024-09-17T01:56:29.824 INFO:tasks.workunit.client.0.smithi063.stdout:3/714: chown df/d12/d1e/d53 48674721 1 2024-09-17T01:56:29.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/685: unlink d6/d35/dc1/f58 0 2024-09-17T01:56:29.826 INFO:tasks.workunit.client.0.smithi063.stdout:2/587: dwrite d3/d7/df/d30/f67 [0,4194304] 0 2024-09-17T01:56:29.827 INFO:tasks.workunit.client.0.smithi063.stdout:3/715: symlink df/d12/d2d/ddc/lf6 0 2024-09-17T01:56:29.829 INFO:tasks.workunit.client.0.smithi063.stdout:2/588: link d3/d2a/fa0 d3/d7/df/d68/fae 0 2024-09-17T01:56:29.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/686: symlink d6/d35/dc1/d29/d2b/da4/ld7 0 2024-09-17T01:56:29.829 INFO:tasks.workunit.client.0.smithi063.stdout:2/589: stat d3/d7/c4a 0 2024-09-17T01:56:29.829 INFO:tasks.workunit.client.0.smithi063.stdout:8/592: dwrite d1/f5e [0,4194304] 0 2024-09-17T01:56:29.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/687: creat d6/d9/d32/fd8 x:0 0 0 2024-09-17T01:56:29.831 INFO:tasks.workunit.client.0.smithi063.stdout:5/688: truncate d6/f74 661967 0 2024-09-17T01:56:29.831 INFO:tasks.workunit.client.0.smithi063.stdout:2/590: getdents d3/d7/df 0 2024-09-17T01:56:29.832 INFO:tasks.workunit.client.0.smithi063.stdout:2/591: rmdir d3/d28/d72 39 2024-09-17T01:56:29.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/689: creat d6/d35/dc1/d54/fd9 x:0 0 0 2024-09-17T01:56:29.833 INFO:tasks.workunit.client.0.smithi063.stdout:2/592: unlink d3/f9 0 2024-09-17T01:56:29.833 INFO:tasks.workunit.client.0.smithi063.stdout:5/690: symlink d6/d37/d19/d76/lda 0 2024-09-17T01:56:29.833 INFO:tasks.workunit.client.0.smithi063.stdout:2/593: write d3/d2a/fad [32147,43297] 0 2024-09-17T01:56:29.834 INFO:tasks.workunit.client.0.smithi063.stdout:5/691: symlink d6/d35/dc1/d29/da3/dc8/ldb 0 2024-09-17T01:56:29.834 INFO:tasks.workunit.client.0.smithi063.stdout:2/594: read d3/d2a/f47 [274626,128479] 0 2024-09-17T01:56:29.835 INFO:tasks.workunit.client.0.smithi063.stdout:2/595: write d3/f10 [9268092,124641] 0 2024-09-17T01:56:29.835 INFO:tasks.workunit.client.0.smithi063.stdout:5/692: write d6/f12 [8072233,75974] 0 2024-09-17T01:56:29.836 INFO:tasks.workunit.client.0.smithi063.stdout:2/596: mknod d3/d7/d76/caf 0 2024-09-17T01:56:29.836 INFO:tasks.workunit.client.0.smithi063.stdout:5/693: chown d6/d35/dc1/d3f 423 1 2024-09-17T01:56:29.837 INFO:tasks.workunit.client.0.smithi063.stdout:2/597: dread - d3/d7/d38/f61 zero size 2024-09-17T01:56:29.838 INFO:tasks.workunit.client.0.smithi063.stdout:4/753: dread de/d17/d1b/f6b [0,4194304] 0 2024-09-17T01:56:29.838 INFO:tasks.workunit.client.0.smithi063.stdout:5/694: read d6/d37/d19/fcb [424195,83006] 0 2024-09-17T01:56:29.839 INFO:tasks.workunit.client.0.smithi063.stdout:5/695: chown d6/d35/dc1/d29/d36/fb6 7 1 2024-09-17T01:56:29.839 INFO:tasks.workunit.client.0.smithi063.stdout:4/754: link de/d2d/d52/d9c/fe8 de/d2d/d3c/dea/ff0 0 2024-09-17T01:56:29.840 INFO:tasks.workunit.client.0.smithi063.stdout:5/696: creat d6/d35/dc1/d29/da3/fdc x:0 0 0 2024-09-17T01:56:29.840 INFO:tasks.workunit.client.0.smithi063.stdout:4/755: dread - de/d2d/d52/d9c/fe8 zero size 2024-09-17T01:56:29.841 INFO:tasks.workunit.client.0.smithi063.stdout:4/756: fsync de/d17/d1b/f6b 0 2024-09-17T01:56:29.841 INFO:tasks.workunit.client.0.smithi063.stdout:5/697: mkdir d6/d35/dc1/d29/d2b/d4f/ddd 0 2024-09-17T01:56:29.842 INFO:tasks.workunit.client.0.smithi063.stdout:4/757: dread - de/d2d/d3c/dea/ff0 zero size 2024-09-17T01:56:29.842 INFO:tasks.workunit.client.0.smithi063.stdout:9/650: dread d9/de/d20/d1b/fd8 [0,4194304] 0 2024-09-17T01:56:29.843 INFO:tasks.workunit.client.0.smithi063.stdout:5/698: rename d6/d37/d19/d68/f81 to d6/d37/d19/d76/d8f/fde 0 2024-09-17T01:56:29.843 INFO:tasks.workunit.client.0.smithi063.stdout:4/758: link de/d17/f68 de/d17/d36/dbe/da6/ff1 0 2024-09-17T01:56:29.843 INFO:tasks.workunit.client.0.smithi063.stdout:7/674: dread d2/d15/d2f/d45/d48/f6f [0,4194304] 0 2024-09-17T01:56:29.844 INFO:tasks.workunit.client.0.smithi063.stdout:7/675: unlink d2/d3/d27/d33/cb5 0 2024-09-17T01:56:29.844 INFO:tasks.workunit.client.0.smithi063.stdout:4/759: write de/d17/d36/f5b [9360685,37740] 0 2024-09-17T01:56:29.844 INFO:tasks.workunit.client.0.smithi063.stdout:5/699: creat d6/d35/dc1/d29/da3/dc8/fdf x:0 0 0 2024-09-17T01:56:29.845 INFO:tasks.workunit.client.0.smithi063.stdout:7/676: truncate d2/d3/d67/f53 111703 0 2024-09-17T01:56:29.846 INFO:tasks.workunit.client.0.smithi063.stdout:7/677: rmdir d2/d3/d17/d25/db0 39 2024-09-17T01:56:29.846 INFO:tasks.workunit.client.0.smithi063.stdout:2/598: dread d3/d2a/f54 [0,4194304] 0 2024-09-17T01:56:29.848 INFO:tasks.workunit.client.0.smithi063.stdout:7/678: symlink d2/d3/d22/d3a/ld6 0 2024-09-17T01:56:29.848 INFO:tasks.workunit.client.0.smithi063.stdout:1/794: dwrite d0/f4 [0,4194304] 0 2024-09-17T01:56:29.848 INFO:tasks.workunit.client.0.smithi063.stdout:2/599: creat d3/d7/df/d68/fb0 x:0 0 0 2024-09-17T01:56:29.849 INFO:tasks.workunit.client.0.smithi063.stdout:7/679: chown d2/d15/d2f/db9 7 1 2024-09-17T01:56:29.850 INFO:tasks.workunit.client.0.smithi063.stdout:6/661: dread dc/f44 [0,4194304] 0 2024-09-17T01:56:29.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/700: dwrite d6/d35/dc1/d29/d36/f97 [0,4194304] 0 2024-09-17T01:56:29.852 INFO:tasks.workunit.client.0.smithi063.stdout:5/701: read - d6/d35/dc1/d29/d36/fb6 zero size 2024-09-17T01:56:29.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/680: symlink d2/d3/d17/d25/ld7 0 2024-09-17T01:56:29.853 INFO:tasks.workunit.client.0.smithi063.stdout:0/693: write d1/d3/d10/f81 [1963713,79888] 0 2024-09-17T01:56:29.854 INFO:tasks.workunit.client.0.smithi063.stdout:0/694: stat d1/d3/db/d6e/d86/dcc/d7c 0 2024-09-17T01:56:29.854 INFO:tasks.workunit.client.0.smithi063.stdout:6/662: mknod dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/cd7 0 2024-09-17T01:56:29.855 INFO:tasks.workunit.client.0.smithi063.stdout:5/702: unlink d6/d9/f45 0 2024-09-17T01:56:29.856 INFO:tasks.workunit.client.0.smithi063.stdout:0/695: mkdir d1/d1d/de4 0 2024-09-17T01:56:29.857 INFO:tasks.workunit.client.0.smithi063.stdout:9/651: write d9/de/d20/d1b/db7/fb9 [564038,10759] 0 2024-09-17T01:56:29.857 INFO:tasks.workunit.client.0.smithi063.stdout:7/681: link d2/d3/d67/l72 d2/d15/d2f/d45/d82/ld8 0 2024-09-17T01:56:29.858 INFO:tasks.workunit.client.0.smithi063.stdout:0/696: chown d1/d3/d1b/c40 10054458 1 2024-09-17T01:56:29.859 INFO:tasks.workunit.client.0.smithi063.stdout:1/795: dwrite d0/d2d/d35/d3f/d81/d50/f70 [4194304,4194304] 0 2024-09-17T01:56:29.859 INFO:tasks.workunit.client.0.smithi063.stdout:7/682: write d2/d3/d27/f2d [3873571,45274] 0 2024-09-17T01:56:29.860 INFO:tasks.workunit.client.0.smithi063.stdout:0/697: dread - d1/d3/db/d18/d85/da8/fcf zero size 2024-09-17T01:56:29.861 INFO:tasks.workunit.client.0.smithi063.stdout:9/652: read d9/d8d/d2a/f53 [772835,123956] 0 2024-09-17T01:56:29.862 INFO:tasks.workunit.client.0.smithi063.stdout:6/663: dwrite dc/d14/d18/d91/fb3 [0,4194304] 0 2024-09-17T01:56:29.862 INFO:tasks.workunit.client.0.smithi063.stdout:9/653: dread - d9/d8d/d2a/d36/f84 zero size 2024-09-17T01:56:29.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/683: symlink d2/d3/d27/d65/ld9 0 2024-09-17T01:56:29.863 INFO:tasks.workunit.client.0.smithi063.stdout:9/654: unlink d9/de/fa9 0 2024-09-17T01:56:29.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/796: getdents d0/d1c/db1/dde 0 2024-09-17T01:56:29.865 INFO:tasks.workunit.client.0.smithi063.stdout:8/593: sync 2024-09-17T01:56:29.865 INFO:tasks.workunit.client.0.smithi063.stdout:5/703: sync 2024-09-17T01:56:29.866 INFO:tasks.workunit.client.0.smithi063.stdout:6/664: dread - dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/fbb zero size 2024-09-17T01:56:29.867 INFO:tasks.workunit.client.0.smithi063.stdout:9/655: symlink d9/dbf/le7 0 2024-09-17T01:56:29.867 INFO:tasks.workunit.client.0.smithi063.stdout:7/684: symlink d2/d3/d27/lda 0 2024-09-17T01:56:29.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/698: dwrite d1/d3/db/d6e/d86/fb1 [0,4194304] 0 2024-09-17T01:56:29.868 INFO:tasks.workunit.client.0.smithi063.stdout:6/665: write dc/d14/d65/fa5 [56581,53380] 0 2024-09-17T01:56:29.870 INFO:tasks.workunit.client.0.smithi063.stdout:9/656: rmdir d9/d8d/d75 39 2024-09-17T01:56:29.870 INFO:tasks.workunit.client.0.smithi063.stdout:5/704: mkdir d6/d37/d19/d76/d8f/de0 0 2024-09-17T01:56:29.870 INFO:tasks.workunit.client.0.smithi063.stdout:7/685: symlink d2/d3/d27/d65/ldb 0 2024-09-17T01:56:29.870 INFO:tasks.workunit.client.0.smithi063.stdout:0/699: creat d1/d3/db/d6e/d86/dcc/d7c/d88/fe5 x:0 0 0 2024-09-17T01:56:29.871 INFO:tasks.workunit.client.0.smithi063.stdout:6/666: rename dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/dbd to dc/d14/d18/d74/dd8 0 2024-09-17T01:56:29.871 INFO:tasks.workunit.client.0.smithi063.stdout:9/657: dread - d9/de/d20/d32/fd1 zero size 2024-09-17T01:56:29.872 INFO:tasks.workunit.client.0.smithi063.stdout:7/686: write d2/d15/d2f/f3d [1322237,25488] 0 2024-09-17T01:56:29.872 INFO:tasks.workunit.client.0.smithi063.stdout:6/667: stat dc/d14/d19/d20/d32/d68/fce 0 2024-09-17T01:56:29.872 INFO:tasks.workunit.client.0.smithi063.stdout:0/700: symlink d1/d3/d1b/d50/d6c/le6 0 2024-09-17T01:56:29.873 INFO:tasks.workunit.client.0.smithi063.stdout:9/658: rmdir d9/de/d20/d1b/d25/d73 39 2024-09-17T01:56:29.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/594: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f4a [718220,75160] 0 2024-09-17T01:56:29.873 INFO:tasks.workunit.client.0.smithi063.stdout:3/716: dread df/d12/d1e/f21 [0,4194304] 0 2024-09-17T01:56:29.874 INFO:tasks.workunit.client.0.smithi063.stdout:3/717: dread - df/d12/d1e/d53/dca/fd6 zero size 2024-09-17T01:56:29.876 INFO:tasks.workunit.client.0.smithi063.stdout:9/659: creat d9/d8d/d2a/d40/dac/dc2/dde/fe8 x:0 0 0 2024-09-17T01:56:29.876 INFO:tasks.workunit.client.0.smithi063.stdout:3/718: mkdir df/d12/d3a/df7 0 2024-09-17T01:56:29.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/668: write dc/d14/d18/d74/fb1 [1041740,58634] 0 2024-09-17T01:56:29.876 INFO:tasks.workunit.client.0.smithi063.stdout:2/600: dread d3/d7/df/d68/f53 [0,4194304] 0 2024-09-17T01:56:29.876 INFO:tasks.workunit.client.0.smithi063.stdout:0/701: creat d1/d1d/d6d/fe7 x:0 0 0 2024-09-17T01:56:29.877 INFO:tasks.workunit.client.0.smithi063.stdout:8/595: truncate d1/d7/d28/d2a/d37/d3a/d85/f93 122752 0 2024-09-17T01:56:29.877 INFO:tasks.workunit.client.0.smithi063.stdout:2/601: chown d3/fa2 2924631 1 2024-09-17T01:56:29.878 INFO:tasks.workunit.client.0.smithi063.stdout:3/719: write df/d28/f48 [1580155,107907] 0 2024-09-17T01:56:29.878 INFO:tasks.workunit.client.0.smithi063.stdout:9/660: creat d9/d8d/d75/fe9 x:0 0 0 2024-09-17T01:56:29.878 INFO:tasks.workunit.client.0.smithi063.stdout:2/602: stat d3/d2a/dac 0 2024-09-17T01:56:29.879 INFO:tasks.workunit.client.0.smithi063.stdout:9/661: creat d9/d8d/d2a/d40/fea x:0 0 0 2024-09-17T01:56:29.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/702: write d1/d3/db/d6e/d86/dcc/d7c/db6/fdf [5159217,33085] 0 2024-09-17T01:56:29.880 INFO:tasks.workunit.client.0.smithi063.stdout:2/603: creat d3/d7/d8d/da4/fb1 x:0 0 0 2024-09-17T01:56:29.881 INFO:tasks.workunit.client.0.smithi063.stdout:8/596: getdents d1/d7/d28 0 2024-09-17T01:56:29.881 INFO:tasks.workunit.client.0.smithi063.stdout:7/687: dwrite d2/d3/d27/d33/f81 [0,4194304] 0 2024-09-17T01:56:29.882 INFO:tasks.workunit.client.0.smithi063.stdout:6/669: rename dc/d14/d19/d20/d32/d52/d5a/f89 to dc/d14/d19/d20/d32/d68/db4/dc6/fd9 0 2024-09-17T01:56:29.882 INFO:tasks.workunit.client.0.smithi063.stdout:2/604: creat d3/d7/df/d30/fb2 x:0 0 0 2024-09-17T01:56:29.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/688: creat d2/d15/d2f/dd3/fdc x:0 0 0 2024-09-17T01:56:29.885 INFO:tasks.workunit.client.0.smithi063.stdout:0/703: creat d1/d3/d32/fe8 x:0 0 0 2024-09-17T01:56:29.885 INFO:tasks.workunit.client.0.smithi063.stdout:3/720: creat df/d12/d3a/df7/ff8 x:0 0 0 2024-09-17T01:56:29.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/670: unlink dc/d14/d19/d20/d32/d68/db4/lba 0 2024-09-17T01:56:29.886 INFO:tasks.workunit.client.0.smithi063.stdout:3/721: mknod df/d83/cf9 0 2024-09-17T01:56:29.886 INFO:tasks.workunit.client.0.smithi063.stdout:2/605: link d3/d7/d38/l78 d3/d7/df/d5a/lb3 0 2024-09-17T01:56:29.886 INFO:tasks.workunit.client.0.smithi063.stdout:6/671: rmdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1 39 2024-09-17T01:56:29.886 INFO:tasks.workunit.client.0.smithi063.stdout:3/722: symlink df/d12/d43/d50/d58/lfa 0 2024-09-17T01:56:29.887 INFO:tasks.workunit.client.0.smithi063.stdout:1/797: dread d0/d2d/d5e/d7e/fc6 [0,4194304] 0 2024-09-17T01:56:29.887 INFO:tasks.workunit.client.0.smithi063.stdout:0/704: getdents d1/d1d/da5 0 2024-09-17T01:56:29.887 INFO:tasks.workunit.client.0.smithi063.stdout:4/760: sync 2024-09-17T01:56:29.887 INFO:tasks.workunit.client.0.smithi063.stdout:9/662: sync 2024-09-17T01:56:29.888 INFO:tasks.workunit.client.0.smithi063.stdout:6/672: chown dc/d14/d19/d20/d32/d52/d5a/laf 258997 1 2024-09-17T01:56:29.889 INFO:tasks.workunit.client.0.smithi063.stdout:1/798: chown d0/d2d/d35/d3f/d81/fa4 9626967 1 2024-09-17T01:56:29.889 INFO:tasks.workunit.client.0.smithi063.stdout:3/723: rename df/d12/d43/d50/d87 to df/d12/d43/d50/dfb 0 2024-09-17T01:56:29.890 INFO:tasks.workunit.client.0.smithi063.stdout:0/705: dread d1/d1d/d74/f7f [0,4194304] 0 2024-09-17T01:56:29.890 INFO:tasks.workunit.client.0.smithi063.stdout:6/673: mkdir dc/d14/d19/dda 0 2024-09-17T01:56:29.890 INFO:tasks.workunit.client.0.smithi063.stdout:5/705: dread d6/d9/d32/d8c/da7/fcc [0,4194304] 0 2024-09-17T01:56:29.890 INFO:tasks.workunit.client.0.smithi063.stdout:3/724: stat df/d83/cb6 0 2024-09-17T01:56:29.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/674: creat dc/d14/d18/fdb x:0 0 0 2024-09-17T01:56:29.891 INFO:tasks.workunit.client.0.smithi063.stdout:0/706: creat d1/d1f/fe9 x:0 0 0 2024-09-17T01:56:29.891 INFO:tasks.workunit.client.0.smithi063.stdout:1/799: creat d0/d2d/d35/d3f/d81/d50/d6c/d90/f109 x:0 0 0 2024-09-17T01:56:29.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/663: rename d9/de/d20/d1b/c28 to d9/de/d20/d37/ceb 0 2024-09-17T01:56:29.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/706: mkdir d6/d35/dc1/d29/d36/de1 0 2024-09-17T01:56:29.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/675: dread - dc/d14/d65/f9a zero size 2024-09-17T01:56:29.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/707: chown d6/d35 1 1 2024-09-17T01:56:29.893 INFO:tasks.workunit.client.0.smithi063.stdout:6/676: truncate dc/d14/d19/f7b 953592 0 2024-09-17T01:56:29.894 INFO:tasks.workunit.client.0.smithi063.stdout:6/677: readlink dc/d14/d19/d20/d66/l96 0 2024-09-17T01:56:29.896 INFO:tasks.workunit.client.0.smithi063.stdout:0/707: symlink d1/d1d/d74/d9a/lea 0 2024-09-17T01:56:29.896 INFO:tasks.workunit.client.0.smithi063.stdout:5/708: readlink d6/d35/dc1/d3a/l70 0 2024-09-17T01:56:29.897 INFO:tasks.workunit.client.0.smithi063.stdout:6/678: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/fdc x:0 0 0 2024-09-17T01:56:29.898 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:29.898 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:29.898 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:29.898 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:29.898 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:29.899 INFO:tasks.workunit.client.0.smithi063.stdout:1/800: write d0/d1c/f28 [1335499,66774] 0 2024-09-17T01:56:29.899 INFO:tasks.workunit.client.0.smithi063.stdout:6/679: fsync dc/d14/fc4 0 2024-09-17T01:56:29.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/801: chown d0/d2d/d35/d3f/d81/d50/d6c/d74/c7c 105111 1 2024-09-17T01:56:29.902 INFO:tasks.workunit.client.0.smithi063.stdout:9/664: dwrite d9/de/d20/d37/f9e [0,4194304] 0 2024-09-17T01:56:29.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/680: dread - dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/fbb zero size 2024-09-17T01:56:29.903 INFO:tasks.workunit.client.0.smithi063.stdout:9/665: truncate d9/fc 4821641 0 2024-09-17T01:56:29.904 INFO:tasks.workunit.client.0.smithi063.stdout:7/689: dread d2/d3/d17/d25/f8b [0,4194304] 0 2024-09-17T01:56:29.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/708: truncate d1/d3/db/d18/f30 3248092 0 2024-09-17T01:56:29.906 INFO:tasks.workunit.client.0.smithi063.stdout:4/761: dread de/d17/d36/dbe/f91 [0,4194304] 0 2024-09-17T01:56:29.906 INFO:tasks.workunit.client.0.smithi063.stdout:6/681: mkdir dc/d14/d65/ddd 0 2024-09-17T01:56:29.907 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:29.909+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:29.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/802: symlink d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc/l10a 0 2024-09-17T01:56:29.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/690: mknod d2/d15/d2f/d45/d82/cdd 0 2024-09-17T01:56:29.909 INFO:tasks.workunit.client.0.smithi063.stdout:4/762: mkdir de/d17/df2 0 2024-09-17T01:56:29.909 INFO:tasks.workunit.client.0.smithi063.stdout:9/666: creat d9/de/d20/d1b/d25/d73/fec x:0 0 0 2024-09-17T01:56:29.909 INFO:tasks.workunit.client.0.smithi063.stdout:5/709: dwrite d6/d35/dc1/d29/d2b/d4f/fb9 [0,4194304] 0 2024-09-17T01:56:29.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/691: readlink d2/d15/la9 0 2024-09-17T01:56:29.909 INFO:tasks.workunit.client.0.smithi063.stdout:6/682: write dc/d14/d19/d20/d32/d52/d5a/d43/f86 [253076,58133] 0 2024-09-17T01:56:29.910 INFO:tasks.workunit.client.0.smithi063.stdout:2/606: dread d3/d7/d38/f6c [0,4194304] 0 2024-09-17T01:56:29.910 INFO:tasks.workunit.client.0.smithi063.stdout:9/667: stat d9/de/d20/d37/d42/fc5 0 2024-09-17T01:56:29.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/803: creat d0/d2d/d35/d3f/d94/f10b x:0 0 0 2024-09-17T01:56:29.910 INFO:tasks.workunit.client.0.smithi063.stdout:8/597: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f58 [0,4194304] 0 2024-09-17T01:56:29.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/710: rmdir d6/d35/dc1/d29/d2b 39 2024-09-17T01:56:29.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/692: creat d2/d15/d2f/d52/d97/fde x:0 0 0 2024-09-17T01:56:29.911 INFO:tasks.workunit.client.0.smithi063.stdout:6/683: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dde 0 2024-09-17T01:56:29.911 INFO:tasks.workunit.client.0.smithi063.stdout:0/709: getdents d1/d3/db/d18/d85/dae 0 2024-09-17T01:56:29.913 INFO:tasks.workunit.client.0.smithi063.stdout:0/710: chown d1/d3/db/d18/d85/d92/dd4 4460 1 2024-09-17T01:56:29.913 INFO:tasks.workunit.client.0.smithi063.stdout:7/693: mknod d2/d3/d27/d8f/cdf 0 2024-09-17T01:56:29.913 INFO:tasks.workunit.client.0.smithi063.stdout:6/684: unlink dc/d14/d18/d91/fb3 0 2024-09-17T01:56:29.914 INFO:tasks.workunit.client.0.smithi063.stdout:9/668: getdents d9/de/d20/d37 0 2024-09-17T01:56:29.914 INFO:tasks.workunit.client.0.smithi063.stdout:0/711: chown d1/d3/d1b/c40 11 1 2024-09-17T01:56:29.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/694: truncate d2/d15/d2f/d45/f69 4998705 0 2024-09-17T01:56:29.918 INFO:tasks.workunit.client.0.smithi063.stdout:4/763: mkdir de/d17/df3 0 2024-09-17T01:56:29.918 INFO:tasks.workunit.client.0.smithi063.stdout:3/725: dread df/d28/f48 [0,4194304] 0 2024-09-17T01:56:29.919 INFO:tasks.workunit.client.0.smithi063.stdout:0/712: creat d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/feb x:0 0 0 2024-09-17T01:56:29.922 INFO:tasks.workunit.client.0.smithi063.stdout:8/598: dwrite d1/d7/d28/f45 [0,4194304] 0 2024-09-17T01:56:29.922 INFO:tasks.workunit.client.0.smithi063.stdout:5/711: dwrite d6/d37/d19/d50/fc2 [0,4194304] 0 2024-09-17T01:56:29.922 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:29.923 INFO:tasks.workunit.client.0.smithi063.stdout:4/764: creat de/d2d/d3c/ff4 x:0 0 0 2024-09-17T01:56:29.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/695: fdatasync d2/d15/d2f/d45/d84/fae 0 2024-09-17T01:56:29.923 INFO:tasks.workunit.client.0.smithi063.stdout:8/599: chown d1/c2b 1020 1 2024-09-17T01:56:29.923 INFO:tasks.workunit.client.0.smithi063.stdout:3/726: truncate df/d12/d3a/fa0 332923 0 2024-09-17T01:56:29.924 INFO:tasks.workunit.client.0.smithi063.stdout:9/669: dwrite d9/d27/f7d [0,4194304] 0 2024-09-17T01:56:29.925 INFO:tasks.workunit.client.0.smithi063.stdout:9/670: fdatasync d9/de/d20/d37/d42/f60 0 2024-09-17T01:56:29.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/696: mknod d2/d15/d2f/d45/d48/ce0 0 2024-09-17T01:56:29.929 INFO:tasks.workunit.client.0.smithi063.stdout:8/600: mknod d1/d7/d28/d2a/d37/d3a/daf/cb4 0 2024-09-17T01:56:29.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/671: getdents d9/de/dcf 0 2024-09-17T01:56:29.930 INFO:tasks.workunit.client.0.smithi063.stdout:3/727: write df/d12/d3a/f92 [5929501,95707] 0 2024-09-17T01:56:29.930 INFO:tasks.workunit.client.0.smithi063.stdout:8/601: creat d1/fb5 x:0 0 0 2024-09-17T01:56:29.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/697: write d2/d3/d27/d33/d7b/fa5 [4499890,5034] 0 2024-09-17T01:56:29.931 INFO:tasks.workunit.client.0.smithi063.stdout:8/602: creat d1/d27/d81/da4/fb6 x:0 0 0 2024-09-17T01:56:29.931 INFO:tasks.workunit.client.0.smithi063.stdout:3/728: write df/d12/d1e/f57 [1143091,125912] 0 2024-09-17T01:56:29.932 INFO:tasks.workunit.client.0.smithi063.stdout:3/729: stat df/d12/d1e/d5e/fcf 0 2024-09-17T01:56:29.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/730: creat df/d12/d43/d50/de6/ffc x:0 0 0 2024-09-17T01:56:29.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/731: chown df/d12/d30/db8/fd4 0 1 2024-09-17T01:56:29.936 INFO:tasks.workunit.client.0.smithi063.stdout:3/732: stat df/d12/d43/d50/de6/fef 0 2024-09-17T01:56:29.937 INFO:tasks.workunit.client.0.smithi063.stdout:1/804: dread d0/d2d/d35/d3f/d81/d50/d6c/de8/fd1 [0,4194304] 0 2024-09-17T01:56:29.938 INFO:tasks.workunit.client.0.smithi063.stdout:9/672: dwrite d9/de/d33/f38 [0,4194304] 0 2024-09-17T01:56:29.939 INFO:tasks.workunit.client.0.smithi063.stdout:3/733: truncate df/d12/d3a/df7/ff8 477870 0 2024-09-17T01:56:29.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/673: write d9/de/d20/d1b/d25/d73/f96 [686575,6758] 0 2024-09-17T01:56:29.949 INFO:tasks.workunit.client.0.smithi063.stdout:6/685: dread dc/d14/d2f/f51 [0,4194304] 0 2024-09-17T01:56:29.949 INFO:tasks.workunit.client.0.smithi063.stdout:3/734: sync 2024-09-17T01:56:29.950 INFO:tasks.workunit.client.0.smithi063.stdout:1/805: dwrite d0/f8 [4194304,4194304] 0 2024-09-17T01:56:29.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/607: dread d3/d7/f34 [0,4194304] 0 2024-09-17T01:56:29.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/698: dwrite d2/d3/d22/d3a/f83 [0,4194304] 0 2024-09-17T01:56:29.952 INFO:tasks.workunit.client.0.smithi063.stdout:8/603: dwrite d1/d7/d28/d2a/f5b [0,4194304] 0 2024-09-17T01:56:29.952 INFO:tasks.workunit.client.0.smithi063.stdout:8/604: sync 2024-09-17T01:56:29.952 INFO:tasks.workunit.client.0.smithi063.stdout:1/806: chown d0/c30 10 1 2024-09-17T01:56:29.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/713: dread d1/d3/db/d4b/f66 [0,4194304] 0 2024-09-17T01:56:29.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/807: chown d0/d2d/d35/d3f/d81/d50/d6c/d90/f109 109227 1 2024-09-17T01:56:29.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/808: fdatasync d0/f1a 0 2024-09-17T01:56:29.955 INFO:tasks.workunit.client.0.smithi063.stdout:5/712: dread d6/d35/dc1/d29/d2b/d31/f33 [0,4194304] 0 2024-09-17T01:56:29.956 INFO:tasks.workunit.client.0.smithi063.stdout:1/809: stat d0/d2d/d35/d3f/d81/f42 0 2024-09-17T01:56:29.956 INFO:tasks.workunit.client.0.smithi063.stdout:1/810: readlink d0/d2d/d35/d3f/d81/d50/d8b/lc1 0 2024-09-17T01:56:29.959 INFO:tasks.workunit.client.0.smithi063.stdout:8/605: mkdir d1/d7/d1d/db7 0 2024-09-17T01:56:29.959 INFO:tasks.workunit.client.0.smithi063.stdout:0/714: stat d1/d3/db/d4b/f37 0 2024-09-17T01:56:29.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/713: rmdir d6 39 2024-09-17T01:56:29.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/714: chown d6/d37/d19/d68 1561 1 2024-09-17T01:56:29.959 INFO:tasks.workunit.client.0.smithi063.stdout:0/715: fsync d1/d3/db/d6e/d86/dcc/d7c/d88/fe5 0 2024-09-17T01:56:29.960 INFO:tasks.workunit.client.0.smithi063.stdout:0/716: readlink d1/d3/d1b/d50/d6c/le6 0 2024-09-17T01:56:29.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/686: rename dc/d14/d19/d20/ca2 to dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/cdf 0 2024-09-17T01:56:29.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/687: dread - dc/d14/d19/d20/d32/d68/fce zero size 2024-09-17T01:56:29.961 INFO:tasks.workunit.client.0.smithi063.stdout:3/735: rename df/d12/d43/d50/dfb/dbb/dbe to df/d12/d43/d50/d58/d97/daa/db1/dfd 0 2024-09-17T01:56:29.961 INFO:tasks.workunit.client.0.smithi063.stdout:5/715: symlink d6/le2 0 2024-09-17T01:56:29.961 INFO:tasks.workunit.client.0.smithi063.stdout:7/699: dwrite d2/d3/d27/d39/f3c [4194304,4194304] 0 2024-09-17T01:56:29.962 INFO:tasks.workunit.client.0.smithi063.stdout:8/606: rename d1/d27/d81/da4/fb6 to d1/d7/d28/d2a/d37/d3a/daf/fb8 0 2024-09-17T01:56:29.962 INFO:tasks.workunit.client.0.smithi063.stdout:3/736: chown df/d12/d30 17461 1 2024-09-17T01:56:29.962 INFO:tasks.workunit.client.0.smithi063.stdout:0/717: truncate d1/d3/db/d18/d85/d92/f8c 5234400 0 2024-09-17T01:56:29.963 INFO:tasks.workunit.client.0.smithi063.stdout:5/716: mknod d6/d37/d19/d68/ce3 0 2024-09-17T01:56:29.963 INFO:tasks.workunit.client.0.smithi063.stdout:7/700: readlink d2/le 0 2024-09-17T01:56:29.964 INFO:tasks.workunit.client.0.smithi063.stdout:6/688: rename dc/d14/d19/f35 to dc/d14/d18/d74/fe0 0 2024-09-17T01:56:29.964 INFO:tasks.workunit.client.0.smithi063.stdout:4/765: dread f8 [0,4194304] 0 2024-09-17T01:56:29.965 INFO:tasks.workunit.client.0.smithi063.stdout:0/718: write d1/f19 [3552793,128662] 0 2024-09-17T01:56:29.965 INFO:tasks.workunit.client.0.smithi063.stdout:7/701: creat d2/d15/d2f/d47/fe1 x:0 0 0 2024-09-17T01:56:29.966 INFO:tasks.workunit.client.0.smithi063.stdout:1/811: dwrite d0/d1c/f48 [4194304,4194304] 0 2024-09-17T01:56:29.966 INFO:tasks.workunit.client.0.smithi063.stdout:3/737: creat df/d12/d3a/ffe x:0 0 0 2024-09-17T01:56:29.966 INFO:tasks.workunit.client.0.smithi063.stdout:6/689: chown dc/d14/d19/d20/d32/d68/f7a 87 1 2024-09-17T01:56:29.966 INFO:tasks.workunit.client.0.smithi063.stdout:8/607: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f58 [8327345,95160] 0 2024-09-17T01:56:29.968 INFO:tasks.workunit.client.0.smithi063.stdout:6/690: write dc/d14/d19/d20/d32/d52/d5a/fd4 [150595,5101] 0 2024-09-17T01:56:29.968 INFO:tasks.workunit.client.0.smithi063.stdout:0/719: truncate d1/d3/db/d6e/d86/dcc/d7c/fc8 571041 0 2024-09-17T01:56:29.968 INFO:tasks.workunit.client.0.smithi063.stdout:8/608: symlink d1/d7/d28/d2a/d59/lb9 0 2024-09-17T01:56:29.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/738: truncate df/d12/d43/d50/de6/ffc 443774 0 2024-09-17T01:56:29.968 INFO:tasks.workunit.client.0.smithi063.stdout:7/702: symlink d2/d3/d27/d39/le2 0 2024-09-17T01:56:29.970 INFO:tasks.workunit.client.0.smithi063.stdout:4/766: read de/f16 [2980545,113333] 0 2024-09-17T01:56:29.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/703: creat d2/d3/d22/db6/fe3 x:0 0 0 2024-09-17T01:56:29.973 INFO:tasks.workunit.client.0.smithi063.stdout:2/608: dread d3/f4 [0,4194304] 0 2024-09-17T01:56:29.976 INFO:tasks.workunit.client.0.smithi063.stdout:0/720: dread d1/d3/db/d6e/d86/fb1 [0,4194304] 0 2024-09-17T01:56:29.977 INFO:tasks.workunit.client.0.smithi063.stdout:6/691: dwrite dc/f38 [0,4194304] 0 2024-09-17T01:56:29.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/812: dread d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [0,4194304] 0 2024-09-17T01:56:29.979 INFO:tasks.workunit.client.0.smithi063.stdout:8/609: dwrite d1/d27/d82/f88 [0,4194304] 0 2024-09-17T01:56:29.980 INFO:tasks.workunit.client.0.smithi063.stdout:6/692: readlink dc/d14/d18/d91/la9 0 2024-09-17T01:56:29.982 INFO:tasks.workunit.client.0.smithi063.stdout:1/813: read d0/d1c/f48 [8087393,93545] 0 2024-09-17T01:56:29.982 INFO:tasks.workunit.client.0.smithi063.stdout:0/721: creat d1/d3/db/d18/d33/d83/fec x:0 0 0 2024-09-17T01:56:29.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/739: dwrite df/d12/d43/d50/de6/fef [0,4194304] 0 2024-09-17T01:56:29.982 INFO:tasks.workunit.client.0.smithi063.stdout:8/610: chown d1/d7/d28/d2a/d37/f7a 9337963 1 2024-09-17T01:56:29.984 INFO:tasks.workunit.client.0.smithi063.stdout:7/704: dwrite d2/f23 [0,4194304] 0 2024-09-17T01:56:29.984 INFO:tasks.workunit.client.0.smithi063.stdout:8/611: chown d1/d7/d1d/f1f 372089 1 2024-09-17T01:56:29.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/722: truncate d1/d3/d10/f81 4669642 0 2024-09-17T01:56:29.985 INFO:tasks.workunit.client.0.smithi063.stdout:3/740: truncate df/d12/d1e/d53/fc0 297814 0 2024-09-17T01:56:29.985 INFO:tasks.workunit.client.0.smithi063.stdout:9/674: dread d9/de/ff [0,4194304] 0 2024-09-17T01:56:29.986 INFO:tasks.workunit.client.0.smithi063.stdout:3/741: fsync df/d12/d30/f47 0 2024-09-17T01:56:29.988 INFO:tasks.workunit.client.0.smithi063.stdout:1/814: mknod d0/d93/d9e/c10c 0 2024-09-17T01:56:29.988 INFO:tasks.workunit.client.0.smithi063.stdout:8/612: rmdir d1/d7/d28/d2a 39 2024-09-17T01:56:29.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/693: getdents dc/d14/d18/d74/dc8 0 2024-09-17T01:56:29.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/705: write d2/d3/d17/f79 [3431497,37092] 0 2024-09-17T01:56:29.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/675: chown d9/de/c2c 2693 1 2024-09-17T01:56:29.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/694: readlink dc/d14/d19/d20/lcb 0 2024-09-17T01:56:29.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/695: fsync dc/f44 0 2024-09-17T01:56:29.994 INFO:tasks.workunit.client.0.smithi063.stdout:0/723: dwrite d1/d3/d1b/fc7 [0,4194304] 0 2024-09-17T01:56:29.995 INFO:tasks.workunit.client.0.smithi063.stdout:5/717: dread d6/d35/dc1/d29/d36/f5b [0,4194304] 0 2024-09-17T01:56:29.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/696: write f3 [1423907,80949] 0 2024-09-17T01:56:29.997 INFO:tasks.workunit.client.0.smithi063.stdout:0/724: rename d1/l5 to d1/d3/db/d18/d33/d83/led 0 2024-09-17T01:56:29.998 INFO:tasks.workunit.client.0.smithi063.stdout:8/613: getdents d1/d7/d28/d2a/d44 0 2024-09-17T01:56:29.998 INFO:tasks.workunit.client.0.smithi063.stdout:2/609: dread d3/f6e [0,4194304] 0 2024-09-17T01:56:29.998 INFO:tasks.workunit.client.0.smithi063.stdout:2/610: dread - d3/d2a/f8b zero size 2024-09-17T01:56:29.999 INFO:tasks.workunit.client.0.smithi063.stdout:0/725: symlink d1/d3/db/d4b/de0/lee 0 2024-09-17T01:56:29.999 INFO:tasks.workunit.client.0.smithi063.stdout:2/611: dread - d3/d7/df/d68/f59 zero size 2024-09-17T01:56:30.000 INFO:tasks.workunit.client.0.smithi063.stdout:0/726: rename d1/d3/db/d6e/d86/dcc/lb2 to d1/d3/lef 0 2024-09-17T01:56:30.001 INFO:tasks.workunit.client.0.smithi063.stdout:2/612: rmdir d3/d7/df/d5a/d8c 0 2024-09-17T01:56:30.002 INFO:tasks.workunit.client.0.smithi063.stdout:0/727: symlink d1/d3/d32/d63/lf0 0 2024-09-17T01:56:30.002 INFO:tasks.workunit.client.0.smithi063.stdout:2/613: creat d3/d7/df/d30/fb4 x:0 0 0 2024-09-17T01:56:30.002 INFO:tasks.workunit.client.0.smithi063.stdout:3/742: write df/d12/d43/f69 [259706,60200] 0 2024-09-17T01:56:30.002 INFO:tasks.workunit.client.0.smithi063.stdout:2/614: write d3/d2a/f8b [592136,18980] 0 2024-09-17T01:56:30.003 INFO:tasks.workunit.client.0.smithi063.stdout:3/743: mknod df/d28/cff 0 2024-09-17T01:56:30.004 INFO:tasks.workunit.client.0.smithi063.stdout:2/615: creat d3/d7/df/d68/fb5 x:0 0 0 2024-09-17T01:56:30.004 INFO:tasks.workunit.client.0.smithi063.stdout:5/718: write d6/d35/f57 [895885,37403] 0 2024-09-17T01:56:30.004 INFO:tasks.workunit.client.0.smithi063.stdout:2/616: write d3/f4 [1609133,68486] 0 2024-09-17T01:56:30.005 INFO:tasks.workunit.client.0.smithi063.stdout:5/719: mkdir d6/d37/d19/de4 0 2024-09-17T01:56:30.005 INFO:tasks.workunit.client.0.smithi063.stdout:8/614: read d1/f10 [6518116,127496] 0 2024-09-17T01:56:30.006 INFO:tasks.workunit.client.0.smithi063.stdout:2/617: write d3/d7/df/d30/f58 [587299,54958] 0 2024-09-17T01:56:30.007 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:30.009+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:30.007 INFO:tasks.workunit.client.0.smithi063.stdout:3/744: link df/d12/d1e/d5e/f8d df/d12/d2d/ddc/f100 0 2024-09-17T01:56:30.008 INFO:tasks.workunit.client.0.smithi063.stdout:4/767: dread de/d17/d1b/dc7/d28/d30/f7b [0,4194304] 0 2024-09-17T01:56:30.008 INFO:tasks.workunit.client.0.smithi063.stdout:2/618: creat d3/d7/df/fb6 x:0 0 0 2024-09-17T01:56:30.008 INFO:tasks.workunit.client.0.smithi063.stdout:5/720: rename d6/d35/dc1/d29/d2b to d6/d37/d19/d76/d8f/de0/de5 0 2024-09-17T01:56:30.009 INFO:tasks.workunit.client.0.smithi063.stdout:2/619: mknod d3/d2a/cb7 0 2024-09-17T01:56:30.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/615: getdents d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66 0 2024-09-17T01:56:30.009 INFO:tasks.workunit.client.0.smithi063.stdout:5/721: readlink d6/d35/dc1/d29/d36/l60 0 2024-09-17T01:56:30.010 INFO:tasks.workunit.client.0.smithi063.stdout:6/697: dread dc/d14/d19/f53 [0,4194304] 0 2024-09-17T01:56:30.010 INFO:tasks.workunit.client.0.smithi063.stdout:2/620: chown d3/d7/d8d/da4/fb1 0 1 2024-09-17T01:56:30.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/621: creat d3/d7/fb8 x:0 0 0 2024-09-17T01:56:30.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/722: rename d6/d9/d13/d1d/l20 to d6/d35/dc1/d29/da3/dc8/le6 0 2024-09-17T01:56:30.013 INFO:tasks.workunit.client.0.smithi063.stdout:3/745: dread df/d12/d43/d50/dfb/dbb/ff2 [0,4194304] 0 2024-09-17T01:56:30.014 INFO:tasks.workunit.client.0.smithi063.stdout:9/676: dread d9/de/f2f [4194304,4194304] 0 2024-09-17T01:56:30.014 INFO:tasks.workunit.client.0.smithi063.stdout:1/815: dread d0/f1b [0,4194304] 0 2024-09-17T01:56:30.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/677: write d9/de/fa6 [4195078,12887] 0 2024-09-17T01:56:30.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/746: read df/d12/d1e/d5e/f8f [1149788,80372] 0 2024-09-17T01:56:30.016 INFO:tasks.workunit.client.0.smithi063.stdout:0/728: truncate d1/d3/db/d4b/d7d/f91 4530120 0 2024-09-17T01:56:30.017 INFO:tasks.workunit.client.0.smithi063.stdout:9/678: mkdir d9/d8d/d2a/d36/ded 0 2024-09-17T01:56:30.018 INFO:tasks.workunit.client.0.smithi063.stdout:4/768: truncate de/d17/d1b/dc7/f37 1278677 0 2024-09-17T01:56:30.020 INFO:tasks.workunit.client.0.smithi063.stdout:3/747: write df/d12/d43/d50/dfb/dbb/ff2 [557480,24406] 0 2024-09-17T01:56:30.020 INFO:tasks.workunit.client.0.smithi063.stdout:6/698: dwrite dc/d14/d19/d20/d32/f87 [0,4194304] 0 2024-09-17T01:56:30.020 INFO:tasks.workunit.client.0.smithi063.stdout:1/816: link d0/d2d/d35/d3f/d81/d50/c7d d0/d93/d9e/dca/c10d 0 2024-09-17T01:56:30.021 INFO:tasks.workunit.client.0.smithi063.stdout:2/622: chown d3/d7/df/d68/fb5 0 1 2024-09-17T01:56:30.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/679: write d9/de/d20/d1b/f2d [1471590,38431] 0 2024-09-17T01:56:30.021 INFO:tasks.workunit.client.0.smithi063.stdout:5/723: dwrite d6/d9/d13/d1d/f55 [0,4194304] 0 2024-09-17T01:56:30.022 INFO:tasks.workunit.client.0.smithi063.stdout:2/623: dread - d3/d7/fb8 zero size 2024-09-17T01:56:30.023 INFO:tasks.workunit.client.0.smithi063.stdout:7/706: dread d2/d3/d67/f7c [0,4194304] 0 2024-09-17T01:56:30.025 INFO:tasks.workunit.client.0.smithi063.stdout:0/729: getdents d1/d3/db/d18/d85/d92/dd4/de2 0 2024-09-17T01:56:30.025 INFO:tasks.workunit.client.0.smithi063.stdout:4/769: creat de/d17/d1b/dc7/d28/d98/ff5 x:0 0 0 2024-09-17T01:56:30.025 INFO:tasks.workunit.client.0.smithi063.stdout:1/817: mknod d0/d2d/d35/d3f/d81/d50/d6c/d90/c10e 0 2024-09-17T01:56:30.025 INFO:tasks.workunit.client.0.smithi063.stdout:9/680: symlink d9/de/d20/d37/d42/lee 0 2024-09-17T01:56:30.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/699: mknod dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dde/ce1 0 2024-09-17T01:56:30.025 INFO:tasks.workunit.client.0.smithi063.stdout:0/730: symlink d1/d1d/d74/lf1 0 2024-09-17T01:56:30.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/624: truncate d3/d7/df/d30/f67 7934712 0 2024-09-17T01:56:30.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/681: creat d9/de/d20/d37/d42/d7f/fef x:0 0 0 2024-09-17T01:56:30.026 INFO:tasks.workunit.client.0.smithi063.stdout:1/818: write d0/d2d/d35/d3f/d81/d50/d6c/d90/ff5 [653099,76793] 0 2024-09-17T01:56:30.027 INFO:tasks.workunit.client.0.smithi063.stdout:7/707: write d2/d3/d27/d33/f81 [4445880,32047] 0 2024-09-17T01:56:30.027 INFO:tasks.workunit.client.0.smithi063.stdout:9/682: creat d9/de/d33/ff0 x:0 0 0 2024-09-17T01:56:30.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/731: link d1/d3/db/l8f d1/d3/db/d6e/d86/lf2 0 2024-09-17T01:56:30.029 INFO:tasks.workunit.client.0.smithi063.stdout:1/819: creat d0/d2d/d35/d3f/d81/d50/f10f x:0 0 0 2024-09-17T01:56:30.029 INFO:tasks.workunit.client.0.smithi063.stdout:9/683: mknod d9/de/d20/d1b/db7/cf1 0 2024-09-17T01:56:30.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/708: mkdir d2/d3/de4 0 2024-09-17T01:56:30.029 INFO:tasks.workunit.client.0.smithi063.stdout:6/700: chown dc/d14/d19/d20/d32/d52/d5a/cb9 179601 1 2024-09-17T01:56:30.030 INFO:tasks.workunit.client.0.smithi063.stdout:0/732: write d1/d3/db/d6e/d86/dcc/d7c/fdb [2450401,22899] 0 2024-09-17T01:56:30.031 INFO:tasks.workunit.client.0.smithi063.stdout:6/701: fsync dc/d14/d19/d20/f71 0 2024-09-17T01:56:30.031 INFO:tasks.workunit.client.0.smithi063.stdout:7/709: creat d2/d15/d2f/d45/d82/fe5 x:0 0 0 2024-09-17T01:56:30.031 INFO:tasks.workunit.client.0.smithi063.stdout:9/684: dread d9/d8d/f34 [0,4194304] 0 2024-09-17T01:56:30.031 INFO:tasks.workunit.client.0.smithi063.stdout:8/616: dread d1/d7/d1d/f5f [0,4194304] 0 2024-09-17T01:56:30.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/710: creat d2/d15/d2f/d3e/fe6 x:0 0 0 2024-09-17T01:56:30.032 INFO:tasks.workunit.client.0.smithi063.stdout:9/685: unlink d9/f74 0 2024-09-17T01:56:30.032 INFO:tasks.workunit.client.0.smithi063.stdout:1/820: getdents d0/d2d/d35/d3f/d81/d50/d6c/d102 0 2024-09-17T01:56:30.032 INFO:tasks.workunit.client.0.smithi063.stdout:6/702: symlink dc/d14/d18/d74/dc8/le2 0 2024-09-17T01:56:30.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/617: symlink d1/d7/d1d/d9c/lba 0 2024-09-17T01:56:30.033 INFO:tasks.workunit.client.0.smithi063.stdout:6/703: chown dc/d14/d2f/f5b 36 1 2024-09-17T01:56:30.033 INFO:tasks.workunit.client.0.smithi063.stdout:7/711: stat d2/d15/d2f/d45/d84/f87 0 2024-09-17T01:56:30.033 INFO:tasks.workunit.client.0.smithi063.stdout:4/770: dwrite de/d17/d36/dbe/dbc/fd8 [0,4194304] 0 2024-09-17T01:56:30.036 INFO:tasks.workunit.client.0.smithi063.stdout:2/625: truncate d3/d7/df/d68/f51 2090474 0 2024-09-17T01:56:30.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/712: write d2/d15/d2f/d52/fcb [308289,58510] 0 2024-09-17T01:56:30.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/821: dwrite d0/d2d/f100 [0,4194304] 0 2024-09-17T01:56:30.041 INFO:tasks.workunit.client.0.smithi063.stdout:8/618: dwrite d1/d7/d28/d2a/d53/f55 [0,4194304] 0 2024-09-17T01:56:30.043 INFO:tasks.workunit.client.0.smithi063.stdout:7/713: rename d2/d15/d2f/d45/d84 to d2/d15/d2f/de7 0 2024-09-17T01:56:30.044 INFO:tasks.workunit.client.0.smithi063.stdout:2/626: dwrite d3/d2a/f73 [0,4194304] 0 2024-09-17T01:56:30.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/714: rename d2/d15/d2f/d52/d97/fde to d2/d3/d27/fe8 0 2024-09-17T01:56:30.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/619: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/fa5 786007 0 2024-09-17T01:56:30.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/715: rmdir d2/d3 39 2024-09-17T01:56:30.047 INFO:tasks.workunit.client.0.smithi063.stdout:4/771: dwrite de/d17/d1b/f62 [0,4194304] 0 2024-09-17T01:56:30.048 INFO:tasks.workunit.client.0.smithi063.stdout:4/772: symlink de/d2d/d3c/lf6 0 2024-09-17T01:56:30.049 INFO:tasks.workunit.client.0.smithi063.stdout:4/773: mknod de/d17/d1b/dc7/d28/d8d/cf7 0 2024-09-17T01:56:30.050 INFO:tasks.workunit.client.0.smithi063.stdout:7/716: creat d2/d15/d2f/d47/fe9 x:0 0 0 2024-09-17T01:56:30.051 INFO:tasks.workunit.client.0.smithi063.stdout:7/717: dread - d2/d15/d2f/dd3/fdc zero size 2024-09-17T01:56:30.052 INFO:tasks.workunit.client.0.smithi063.stdout:9/686: dread d9/d8d/d2a/d36/f9d [0,4194304] 0 2024-09-17T01:56:30.053 INFO:tasks.workunit.client.0.smithi063.stdout:7/718: truncate d2/d3/d22/f77 1360656 0 2024-09-17T01:56:30.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/704: dread dc/d14/d19/d20/d32/d52/f60 [0,4194304] 0 2024-09-17T01:56:30.054 INFO:tasks.workunit.client.0.smithi063.stdout:1/822: fdatasync d0/d2d/f100 0 2024-09-17T01:56:30.054 INFO:tasks.workunit.client.0.smithi063.stdout:2/627: dwrite d3/d7/df/f1a [4194304,4194304] 0 2024-09-17T01:56:30.055 INFO:tasks.workunit.client.0.smithi063.stdout:9/687: write d9/de/d20/d37/d42/dbe/fda [461590,24728] 0 2024-09-17T01:56:30.056 INFO:tasks.workunit.client.0.smithi063.stdout:1/823: fdatasync d0/d2d/d35/d3f/d81/f3e 0 2024-09-17T01:56:30.056 INFO:tasks.workunit.client.0.smithi063.stdout:6/705: getdents dc/d14 0 2024-09-17T01:56:30.056 INFO:tasks.workunit.client.0.smithi063.stdout:2/628: rename d3/c27 to d3/d7/df/d30/cb9 0 2024-09-17T01:56:30.057 INFO:tasks.workunit.client.0.smithi063.stdout:1/824: write d0/f2 [4406318,6895] 0 2024-09-17T01:56:30.058 INFO:tasks.workunit.client.0.smithi063.stdout:4/774: dwrite de/d17/d1b/dc7/f1d [0,4194304] 0 2024-09-17T01:56:30.058 INFO:tasks.workunit.client.0.smithi063.stdout:1/825: creat d0/d2d/d35/d8c/f110 x:0 0 0 2024-09-17T01:56:30.060 INFO:tasks.workunit.client.0.smithi063.stdout:9/688: link d9/de/d20/d1b/d25/d73/f81 d9/d8d/d2a/d36/ded/ff2 0 2024-09-17T01:56:30.060 INFO:tasks.workunit.client.0.smithi063.stdout:4/775: link de/d2d/fdb de/d17/d36/dbe/da6/ff8 0 2024-09-17T01:56:30.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/826: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc/f111 x:0 0 0 2024-09-17T01:56:30.062 INFO:tasks.workunit.client.0.smithi063.stdout:7/719: dwrite d2/d3/d17/d25/db0/fb2 [0,4194304] 0 2024-09-17T01:56:30.063 INFO:tasks.workunit.client.0.smithi063.stdout:1/827: mkdir d0/d1c/d112 0 2024-09-17T01:56:30.063 INFO:tasks.workunit.client.0.smithi063.stdout:7/720: chown d2/d3/d67/d8d/dca/fd1 47002101 1 2024-09-17T01:56:30.065 INFO:tasks.workunit.client.0.smithi063.stdout:4/776: rename de/d17/d1b/dc7/la0 to de/d17/d1b/d9b/lf9 0 2024-09-17T01:56:30.066 INFO:tasks.workunit.client.0.smithi063.stdout:5/724: sync 2024-09-17T01:56:30.067 INFO:tasks.workunit.client.0.smithi063.stdout:3/748: sync 2024-09-17T01:56:30.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/725: dread - d6/d9/d13/d1d/fc4 zero size 2024-09-17T01:56:30.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/726: read - d6/d9/d32/fd8 zero size 2024-09-17T01:56:30.068 INFO:tasks.workunit.client.0.smithi063.stdout:3/749: truncate df/d12/d30/d8a/fd2 978816 0 2024-09-17T01:56:30.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/727: fdatasync d6/d37/d19/d68/fad 0 2024-09-17T01:56:30.068 INFO:tasks.workunit.client.0.smithi063.stdout:4/777: mkdir de/d17/d1b/dc7/dfa 0 2024-09-17T01:56:30.069 INFO:tasks.workunit.client.0.smithi063.stdout:3/750: truncate df/d12/d1e/d5e/f9c 994864 0 2024-09-17T01:56:30.069 INFO:tasks.workunit.client.0.smithi063.stdout:9/689: dwrite d9/d8d/d75/fe9 [0,4194304] 0 2024-09-17T01:56:30.069 INFO:tasks.workunit.client.0.smithi063.stdout:4/778: write de/d2d/d52/d9c/fb9 [1634234,87688] 0 2024-09-17T01:56:30.070 INFO:tasks.workunit.client.0.smithi063.stdout:5/728: unlink d6/d37/d19/d76/d8f/de0/de5/c3d 0 2024-09-17T01:56:30.070 INFO:tasks.workunit.client.0.smithi063.stdout:4/779: chown de/d17/d36/d70/d77 568615 1 2024-09-17T01:56:30.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/751: creat df/d12/d30/f101 x:0 0 0 2024-09-17T01:56:30.071 INFO:tasks.workunit.client.0.smithi063.stdout:4/780: chown de/d17/d1b/f32 4077 1 2024-09-17T01:56:30.071 INFO:tasks.workunit.client.0.smithi063.stdout:5/729: creat d6/d35/dc1/d29/da3/dc8/fe7 x:0 0 0 2024-09-17T01:56:30.071 INFO:tasks.workunit.client.0.smithi063.stdout:3/752: write df/d12/d43/d50/d58/d97/daa/db1/dfd/fcd [486429,41754] 0 2024-09-17T01:56:30.072 INFO:tasks.workunit.client.0.smithi063.stdout:2/629: truncate d3/d7/d38/f45 3383829 0 2024-09-17T01:56:30.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/781: mknod de/d17/d1b/dc7/d28/d8d/cfb 0 2024-09-17T01:56:30.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/753: symlink df/d12/d43/d50/dfb/l102 0 2024-09-17T01:56:30.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/828: truncate d0/f20 2596234 0 2024-09-17T01:56:30.074 INFO:tasks.workunit.client.0.smithi063.stdout:5/730: write d6/d9/d32/d8c/da7/fcc [3209354,105689] 0 2024-09-17T01:56:30.075 INFO:tasks.workunit.client.0.smithi063.stdout:2/630: unlink d3/d7/d8d/laa 0 2024-09-17T01:56:30.075 INFO:tasks.workunit.client.0.smithi063.stdout:4/782: chown de/d17/d1b/dc7/d28/d8b 13 1 2024-09-17T01:56:30.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/631: write d3/d2a/f3d [1714751,77766] 0 2024-09-17T01:56:30.077 INFO:tasks.workunit.client.0.smithi063.stdout:3/754: write df/d12/d43/d50/f86 [1283248,64894] 0 2024-09-17T01:56:30.078 INFO:tasks.workunit.client.0.smithi063.stdout:5/731: creat d6/d35/dc1/d3f/dac/fe8 x:0 0 0 2024-09-17T01:56:30.078 INFO:tasks.workunit.client.0.smithi063.stdout:2/632: creat d3/d7/fba x:0 0 0 2024-09-17T01:56:30.078 INFO:tasks.workunit.client.0.smithi063.stdout:4/783: mknod de/d17/d36/dbe/dbc/cfc 0 2024-09-17T01:56:30.078 INFO:tasks.workunit.client.0.smithi063.stdout:7/721: dwrite d2/f23 [0,4194304] 0 2024-09-17T01:56:30.079 INFO:tasks.workunit.client.0.smithi063.stdout:2/633: write d3/d7/fb8 [741172,84969] 0 2024-09-17T01:56:30.079 INFO:tasks.workunit.client.0.smithi063.stdout:4/784: dread - de/d17/d36/dbe/fdf zero size 2024-09-17T01:56:30.081 INFO:tasks.workunit.client.0.smithi063.stdout:7/722: dread - d2/d3/d17/d25/db0/fc9 zero size 2024-09-17T01:56:30.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/634: chown l0 49426064 1 2024-09-17T01:56:30.081 INFO:tasks.workunit.client.0.smithi063.stdout:5/732: symlink d6/d35/dc1/d29/d36/de1/le9 0 2024-09-17T01:56:30.081 INFO:tasks.workunit.client.0.smithi063.stdout:9/690: dwrite d9/d8d/d2a/f53 [4194304,4194304] 0 2024-09-17T01:56:30.083 INFO:tasks.workunit.client.0.smithi063.stdout:6/706: dread dc/d14/d19/f1a [0,4194304] 0 2024-09-17T01:56:30.084 INFO:tasks.workunit.client.0.smithi063.stdout:5/733: write d6/d35/dc1/d29/d36/f5b [2740395,105548] 0 2024-09-17T01:56:30.084 INFO:tasks.workunit.client.0.smithi063.stdout:9/691: creat d9/d27/ff3 x:0 0 0 2024-09-17T01:56:30.086 INFO:tasks.workunit.client.0.smithi063.stdout:2/635: unlink d3/d7/df/d30/l75 0 2024-09-17T01:56:30.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/755: dwrite df/d12/f79 [0,4194304] 0 2024-09-17T01:56:30.088 INFO:tasks.workunit.client.0.smithi063.stdout:2/636: readlink d3/d7/d38/l52 0 2024-09-17T01:56:30.089 INFO:tasks.workunit.client.0.smithi063.stdout:5/734: write d6/d9/d13/d1d/f21 [116804,126512] 0 2024-09-17T01:56:30.091 INFO:tasks.workunit.client.0.smithi063.stdout:4/785: dwrite de/d17/d36/d70/fc9 [0,4194304] 0 2024-09-17T01:56:30.093 INFO:tasks.workunit.client.0.smithi063.stdout:6/707: dread dc/f38 [0,4194304] 0 2024-09-17T01:56:30.093 INFO:tasks.workunit.client.0.smithi063.stdout:2/637: truncate d3/d7/df/f2f 1924217 0 2024-09-17T01:56:30.094 INFO:tasks.workunit.client.0.smithi063.stdout:4/786: truncate de/d2d/d3c/f99 288230 0 2024-09-17T01:56:30.095 INFO:tasks.workunit.client.0.smithi063.stdout:7/723: dwrite d2/d15/d2f/d47/fe1 [0,4194304] 0 2024-09-17T01:56:30.096 INFO:tasks.workunit.client.0.smithi063.stdout:3/756: creat df/d12/d43/d50/d58/d97/daa/db1/f103 x:0 0 0 2024-09-17T01:56:30.097 INFO:tasks.workunit.client.0.smithi063.stdout:2/638: symlink d3/d7/d8d/lbb 0 2024-09-17T01:56:30.097 INFO:tasks.workunit.client.0.smithi063.stdout:4/787: mknod de/cfd 0 2024-09-17T01:56:30.097 INFO:tasks.workunit.client.0.smithi063.stdout:7/724: chown d2/d15/d2f 21167 1 2024-09-17T01:56:30.097 INFO:tasks.workunit.client.0.smithi063.stdout:9/692: dwrite d9/d8d/d2a/d40/f6c [0,4194304] 0 2024-09-17T01:56:30.099 INFO:tasks.workunit.client.0.smithi063.stdout:7/725: unlink d2/d3/d27/d39/l95 0 2024-09-17T01:56:30.099 INFO:tasks.workunit.client.0.smithi063.stdout:6/708: write dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/fc0 [5409935,123589] 0 2024-09-17T01:56:30.100 INFO:tasks.workunit.client.0.smithi063.stdout:4/788: mknod de/d17/d1b/dc7/cfe 0 2024-09-17T01:56:30.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/693: chown d9/de/d20/c31 5928209 1 2024-09-17T01:56:30.100 INFO:tasks.workunit.client.0.smithi063.stdout:2/639: mkdir d3/dbc 0 2024-09-17T01:56:30.100 INFO:tasks.workunit.client.0.smithi063.stdout:2/640: stat d3/d7/d38/f56 0 2024-09-17T01:56:30.101 INFO:tasks.workunit.client.0.smithi063.stdout:9/694: creat d9/de/dcf/ff4 x:0 0 0 2024-09-17T01:56:30.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/641: mknod d3/d7/cbd 0 2024-09-17T01:56:30.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/709: link dc/d14/d19/d20/f71 dc/d14/d2f/fe3 0 2024-09-17T01:56:30.103 INFO:tasks.workunit.client.0.smithi063.stdout:6/710: chown dc/d14/d19/d20/d32/d52/d5a/d43/l9f 479596 1 2024-09-17T01:56:30.103 INFO:tasks.workunit.client.0.smithi063.stdout:9/695: mkdir d9/de/d33/df5 0 2024-09-17T01:56:30.107 INFO:tasks.workunit.client.0.smithi063.stdout:3/757: dwrite df/d12/d43/d50/d58/f9f [0,4194304] 0 2024-09-17T01:56:30.107 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:30.109+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:30.110 INFO:tasks.workunit.client.0.smithi063.stdout:3/758: mkdir df/d12/d43/d50/d104 0 2024-09-17T01:56:30.111 INFO:tasks.workunit.client.0.smithi063.stdout:3/759: write df/d12/d1e/d39/f7b [3945591,557] 0 2024-09-17T01:56:30.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/696: dwrite d9/de/d20/d37/d42/d7f/fef [0,4194304] 0 2024-09-17T01:56:30.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/697: stat d9/d8d/d75 0 2024-09-17T01:56:30.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/711: dwrite dc/d14/d19/f1a [0,4194304] 0 2024-09-17T01:56:30.114 INFO:tasks.workunit.client.0.smithi063.stdout:6/712: write dc/d14/d19/f1a [212463,122446] 0 2024-09-17T01:56:30.114 INFO:tasks.workunit.client.0.smithi063.stdout:2/642: dread d3/d7/df/d30/f8e [0,4194304] 0 2024-09-17T01:56:30.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/620: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f3b [0,4194304] 0 2024-09-17T01:56:30.115 INFO:tasks.workunit.client.0.smithi063.stdout:1/829: dread d0/f20 [0,4194304] 0 2024-09-17T01:56:30.115 INFO:tasks.workunit.client.0.smithi063.stdout:0/733: sync 2024-09-17T01:56:30.115 INFO:tasks.workunit.client.0.smithi063.stdout:5/735: sync 2024-09-17T01:56:30.115 INFO:tasks.workunit.client.0.smithi063.stdout:7/726: sync 2024-09-17T01:56:30.116 INFO:tasks.workunit.client.0.smithi063.stdout:8/621: write d1/d7/d28/d2a/d37/f7a [3323500,111567] 0 2024-09-17T01:56:30.116 INFO:tasks.workunit.client.0.smithi063.stdout:0/734: write d1/d1d/f3b [4739323,74584] 0 2024-09-17T01:56:30.117 INFO:tasks.workunit.client.0.smithi063.stdout:9/698: link d9/d8d/d2a/d40/fc1 d9/de/d20/d1b/d25/ff6 0 2024-09-17T01:56:30.119 INFO:tasks.workunit.client.0.smithi063.stdout:8/622: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/c79 2667095 1 2024-09-17T01:56:30.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/713: symlink dc/d14/d18/le4 0 2024-09-17T01:56:30.120 INFO:tasks.workunit.client.0.smithi063.stdout:2/643: rmdir d3/d7/df/d68 39 2024-09-17T01:56:30.121 INFO:tasks.workunit.client.0.smithi063.stdout:5/736: symlink d6/d9/d13/dc6/lea 0 2024-09-17T01:56:30.123 INFO:tasks.workunit.client.0.smithi063.stdout:6/714: mkdir dc/d14/d19/d20/d32/d68/db4/dc6/de5 0 2024-09-17T01:56:30.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/644: creat d3/d7/d8d/da4/fbe x:0 0 0 2024-09-17T01:56:30.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/737: unlink d6/d9/d32/d8c/da7/da9/fd0 0 2024-09-17T01:56:30.126 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:30.126 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:30.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:30.126 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.575403989, 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.127 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:30.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:30.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.570602312, 2024-09-17T01:56:30.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:30.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:30.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:30.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.567529814, 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:30.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:30.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:30.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.145 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.565593658999999, 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:30.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:30.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.151 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.563611954000001, 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.152 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:30.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:30.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:30.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.560358401, 2024-09-17T01:56:30.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:30.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.549913883, 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:30.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:30.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:30.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.540745103000001, 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.170 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:30.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:30.175 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.536715746, 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:30.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:30.181 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.530390189, 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:30.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:30.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:30.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.187 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.527199544, 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:30.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:30.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.526043893000001, 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:30.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.199 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.523970554, 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:30.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:30.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.516869725999999, 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.206 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:30.207 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.208 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.209 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.210 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.211 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.511620735999999, 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.212 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.213 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.214 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.215 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.216 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.217 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.510426709000001, 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.218 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.219 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.220 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:30.221 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.222 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.223 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.503822275999999, 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.224 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.225 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:30.226 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.227 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.229 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.501440678, 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.230 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:30.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:30.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.235 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.498337841, 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.236 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:30.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:30.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 10.492485395999999, 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:30.242 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:30.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:30.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:30.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:30.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:30.248 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:30.249 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:30.249+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:30.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/830: dread d0/d2d/d35/d3f/d81/d50/f9c [0,4194304] 0 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:6/715: read - dc/d14/d19/d20/d32/d52/d5a/d62/fc1 zero size 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:3/760: dwrite df/d12/d43/d50/d58/fbd [0,4194304] 0 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:5/738: chown d6/d9/d32/dbb 238118947 1 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:2/645: rename d3/d7/l9b to d3/d7/d8d/lbf 0 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:8/623: dwrite d1/d7/d28/f42 [0,4194304] 0 2024-09-17T01:56:30.272 INFO:tasks.workunit.client.0.smithi063.stdout:9/699: dwrite d9/fc [4194304,4194304] 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:3/761: write df/d28/f48 [1278660,128299] 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:8/624: chown d1/l91 481736 1 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/831: write d0/d2d/f37 [2071561,77335] 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:3/762: write df/d12/f80 [748624,129434] 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:9/700: symlink d9/de/d20/d37/d42/d7f/lf7 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/832: creat d0/d2d/d35/d3f/d81/d50/d6c/d90/f113 x:0 0 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:8/625: mknod d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/cbb 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:3/763: symlink df/d12/d30/d8a/d9d/l105 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/789: dread de/d17/f23 [0,4194304] 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/833: rmdir d0/d2d/d5e/d7e 39 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:9/701: chown d9/d8d/d2a/d40/dac/dc2/dde/fe8 90149342 1 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/790: stat de/d17/d36/f5b 0 2024-09-17T01:56:30.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/834: write d0/d2d/d35/d3f/d94/fa0 [112029,10318] 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:1/835: stat d0/d2d/d35/d3f/d81/f3e 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/764: mkdir df/d12/d43/d50/d58/d97/daa/db1/dfd/d106 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:9/702: creat d9/d8d/d2a/d40/dac/ff8 x:0 0 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/791: rmdir de/d17/d1b/dc7/d28/d98 39 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:2/646: getdents d3/d7/df/d5a 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/765: unlink df/d12/d43/d50/dfb/fba 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/766: stat df/d12/d43/f62 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/792: mkdir de/d17/d1b/d9b/dff 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:2/647: mkdir d3/d7/d8d/dc0 0 2024-09-17T01:56:30.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/767: fdatasync df/d12/d30/fe7 0 2024-09-17T01:56:30.275 INFO:tasks.workunit.client.0.smithi063.stdout:1/836: link d0/d2d/d35/d3f/d81/d50/c5a d0/d2d/d35/d3f/d81/d50/c114 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:4/793: creat de/d17/d36/f100 x:0 0 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/648: mknod d3/dbc/cc1 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:4/794: mknod de/d2d/d3c/dd0/c101 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:3/768: write df/d12/d43/d50/d58/d97/daa/db1/dcc/fea [15584,15911] 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/649: symlink d3/d7/d8d/dc0/lc2 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:8/626: truncate d1/d7/d28/f42 495632 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:1/837: link d0/d2d/d35/d3f/d81/l6e d0/d93/d9e/l115 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:6/716: truncate dc/d14/d19/d20/d32/d52/f80 3801169 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:4/795: fdatasync de/d17/d1b/dc7/d28/d30/f7b 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:3/769: mkdir df/d12/d43/d50/d58/db5/d107 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:1/838: symlink d0/d2d/d5e/dd8/l116 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:8/627: write d1/d7/d1d/f5f [3106071,80867] 0 2024-09-17T01:56:30.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/650: creat d3/d7/df/d68/fc3 x:0 0 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:4/796: mkdir de/d102 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:1/839: fsync d0/d1c/f41 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:1/840: rmdir d0/d2d/d5e 39 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:8/628: mknod d1/d7/d28/d2a/d37/cbc 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:1/841: unlink d0/l2e 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/727: dread d2/d15/d2f/de7/fae [0,4194304] 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:1/842: creat d0/d93/dc4/f117 x:0 0 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:8/629: getdents d1/d7/d28/d2a/d37/d3a/d75/d9a/d41 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:3/770: getdents df/d12/d43/d50/d58/d97/daa/db1/dfd/d106 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:1/843: fsync d0/d2d/d35/d3f/d81/d50/d6c/de8/fd1 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:8/630: creat d1/d7/d28/d2a/d37/fbd x:0 0 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:3/771: unlink df/d12/d3a/d7a/l82 0 2024-09-17T01:56:30.277 INFO:tasks.workunit.client.0.smithi063.stdout:5/739: dread d6/d35/dc1/d54/fb2 [0,4194304] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:0/735: dread d1/d3/db/d4b/f22 [0,4194304] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/717: dwrite dc/d1b/d5e/f79 [0,4194304] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/651: write d3/d2a/f47 [531406,90001] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:5/740: rmdir d6/d35 39 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:0/736: chown d1/d3/lef 15 1 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/652: write d3/d7/df/d68/fb5 [547997,73518] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/772: symlink df/d12/d3a/d7a/l108 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:0/737: rmdir d1/d3/dc6 39 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/631: read d1/d7/d28/d2a/d37/f7a [686512,107294] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/653: read d3/d2a/f73 [2686926,78706] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/773: write df/d12/d30/f47 [1522450,79876] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:5/741: rename d6/d9/d13/c2d to d6/d35/dc1/d29/d36/de1/ceb 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/632: write d1/d7/d28/d2a/d4d/fae [168049,73402] 0 2024-09-17T01:56:30.278 INFO:tasks.workunit.client.0.smithi063.stdout:9/703: dread d9/d8d/d2a/f3f [0,4194304] 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:5/742: mknod d6/d35/dc1/d54/cec 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/774: dread - df/d12/d1e/d53/f7f zero size 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:2/654: write d3/d2a/f4c [1388885,30427] 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:4/797: dwrite de/d17/d1b/f6b [0,4194304] 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:6/718: dwrite dc/d14/d19/f82 [0,4194304] 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:8/633: rename d1/d7/d28/d2a to d1/d7/d28/d2a/d37/d3a/dbe 22 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:4/798: symlink de/d17/d1b/dc7/d28/d8b/l103 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:6/719: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/de6 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/775: creat df/d12/d3a/df7/f109 x:0 0 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:8/634: link d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/fa5 d1/d27/d81/fbf 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:5/743: link d6/d35/dc1/d3f/fce d6/d9/d32/d8c/fed 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/738: dwrite d1/d1d/d6d/f94 [0,4194304] 0 2024-09-17T01:56:30.279 INFO:tasks.workunit.client.0.smithi063.stdout:6/720: mkdir dc/d14/d2f/de7 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/776: symlink df/d12/d30/l10a 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:0/739: creat d1/d3/d1b/d50/ff3 x:0 0 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/744: fdatasync d6/d37/d19/d50/d98/fc0 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/745: stat d6/d35/dc1/d3f/c47 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/777: rename df/d12/d3a/lac to df/d83/l10b 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/844: sync 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/778: chown df/d12/d2d/ddc/lf6 7423974 1 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/845: fsync d0/d2d/d35/d3f/d81/d50/d6c/d90/f113 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:7/728: dread d2/d3/d67/f10 [0,4194304] 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:8/635: dwrite d1/d7/d28/f9f [0,4194304] 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:4/799: dwrite de/d2d/d52/f5f [0,4194304] 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:2/655: dwrite d3/d2a/fa0 [0,4194304] 0 2024-09-17T01:56:30.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/779: write df/d12/d43/d50/de6/fef [2900928,50046] 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:5/746: read d6/d37/d19/f75 [302480,56004] 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/656: chown d3/f6 57464421 1 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/846: write d0/d2d/d35/d3f/d81/d50/d6c/fe7 [693003,72965] 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:3/780: mknod df/d28/c10c 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:7/729: chown d2/d15/d2f/f64 582 1 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:7/730: mkdir d2/d98/dea 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/847: mknod d0/d2d/d35/d3f/d81/d50/d6c/d90/c118 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:8/636: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/c79 to d1/d7/d28/cc0 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/657: getdents d3/d7/df 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/848: readlink d0/d2d/d35/d9d/de2/lf9 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/658: dread - d3/f83 zero size 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/849: fdatasync d0/d1c/f28 0 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:1/850: dread - d0/d93/dc4/f117 zero size 2024-09-17T01:56:30.281 INFO:tasks.workunit.client.0.smithi063.stdout:8/637: creat d1/d7/d28/d2a/d37/d3a/d75/fc1 x:0 0 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/659: symlink d3/d7/d76/lc4 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:7/731: rename d2/d15/d2f/d47 to d2/d3/d27/d39/deb 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/660: symlink d3/d2a/lc5 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/661: stat d3/f10 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:5/747: dwrite d6/d37/fe [4194304,4194304] 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/638: mkdir d1/d7/d28/d2a/d37/d3a/d75/dc2 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:1/851: rename d0/d2d/d35/d6f/db7/fc7 to d0/d2d/d35/d3f/d81/d50/d6c/f119 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:1/852: dread - d0/d2d/d35/d3f/d81/d50/d6c/d90/f113 zero size 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/662: truncate d3/d7/df/d43/f3b 2308776 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:8/639: rename d1/d7/d28/d2a/d37/d3a/d75/c7d to d1/d7/d28/d2a/d53/cc3 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:1/853: creat d0/d2d/d35/d8c/d97/f11a x:0 0 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:1/854: write d0/d1c/f5c [495707,10984] 0 2024-09-17T01:56:30.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/663: readlink d3/d7/d38/l62 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:1/855: fdatasync d0/d2d/d35/d8c/f110 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/732: dwrite d2/d98/fbb [0,4194304] 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/664: truncate d3/d7/d38/f6c 5064134 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:9/704: dread d9/de/d20/d1b/fc9 [0,4194304] 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:5/748: dread d6/d9/d13/d1d/f21 [0,4194304] 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:8/640: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f67 [0,4194304] 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/733: rmdir d2/d15/d2f/de7 39 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:5/749: sync 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/665: unlink d3/d2a/l4e 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:9/705: stat d9/de/d20/d1b/fa8 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:5/750: truncate d6/d37/fe 8847737 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/666: write d3/d28/fa8 [427891,75543] 0 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:9/706: chown d9/de/d20/d32/cc3 83 1 2024-09-17T01:56:30.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/800: truncate de/d17/d1b/dc7/f1d 519779 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:5/751: rmdir d6/d37/d19/d76/d8f/de0/de5 39 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:2/667: symlink d3/d7/d8d/dc0/lc6 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/734: symlink d2/d3/d27/d65/dd2/lec 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:5/752: dread - d6/d35/dc1/d3f/fce zero size 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:5/753: fsync d6/d37/d19/d50/d92/fae 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:1/856: read d0/d1c/f48 [623385,84904] 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/781: dwrite df/d83/fc4 [0,4194304] 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/782: sync 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/783: chown df/d12/d30/d8a/fb2 1768584554 1 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:6/721: dread dc/d14/d19/d20/d32/d52/d5a/f9b [0,4194304] 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/784: dread - df/d12/d30/d8a/fb2 zero size 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/707: dwrite d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/735: mknod d2/d3/ced 0 2024-09-17T01:56:30.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/708: fdatasync d9/de/d20/d1b/d25/f2b 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/801: getdents de/d17/d36/dbe/d9a 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/785: unlink df/d12/d1e/d5e/fcf 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:6/722: creat dc/d14/d19/d20/d32/d52/d5a/d43/fe8 x:0 0 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:7/736: dread - d2/d15/d2f/d45/d82/fe5 zero size 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/802: readlink de/d17/d36/dbe/lc3 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:0/740: dread d1/f1e [0,4194304] 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/857: read d0/d93/fb9 [488275,73584] 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/803: write de/d17/d36/d70/f8a [4941987,96045] 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:5/754: dwrite d6/d35/dc1/d54/fd9 [0,4194304] 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:6/723: link dc/d14/d19/d20/d32/d52/d5a/fcc dc/d14/d18/d74/fe9 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:0/741: link d1/d3/d10/f5a d1/d3/db/d18/d85/da8/ff4 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/858: mknod d0/d1c/db1/dde/c11b 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:9/709: getdents d9/d8d/d2a/d40/dac/dc2 0 2024-09-17T01:56:30.285 INFO:tasks.workunit.client.0.smithi063.stdout:5/755: read d6/d9/d13/d1d/f21 [85308,30933] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:0/742: fsync d1/d3/db/d6e/fa4 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:4/804: write de/f38 [735554,23784] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/710: stat d9/d8d/d75/fe9 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:0/743: read d1/f1e [3841071,90488] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:5/756: chown d6/d9/d32/l59 7558 1 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:4/805: unlink de/d2d/lb3 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/711: symlink d9/d8d/d2a/d36/lf9 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:2/668: truncate d3/f6e 4136851 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:3/786: dwrite df/d12/d2d/f7d [0,4194304] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/737: dwrite d2/d15/f59 [0,4194304] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/641: dwrite d1/f2e [0,4194304] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/642: sync 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:4/806: write de/f57 [195215,109949] 0 2024-09-17T01:56:30.286 INFO:tasks.workunit.client.0.smithi063.stdout:2/669: readlink d3/d7/df/d43/lab 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:1/859: mknod d0/d2d/d35/d3f/d81/d50/d6c/d102/c11c 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:0/744: creat d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/ff5 x:0 0 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/712: write d9/de/d20/d37/d42/dbe/fda [648107,65018] 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:4/807: write de/d17/d1b/dc7/f96 [2744250,61838] 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:1/860: mknod d0/d2d/d35/d6f/c11d 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:2/670: symlink d3/d7/d8d/lc7 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:6/724: dwrite dc/d1b/d5e/f79 [4194304,4194304] 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:4/808: write de/d17/d1b/d9e/fae [343897,124735] 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/713: link d9/d27/ca0 d9/dbf/cfa 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:6/725: symlink dc/d14/d2f/de7/lea 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:3/787: link df/d12/d43/d50/d58/f75 df/d12/d43/d50/de6/f10d 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/714: symlink d9/d8d/d2a/d40/dac/dc2/dde/lfb 0 2024-09-17T01:56:30.287 INFO:tasks.workunit.client.0.smithi063.stdout:7/738: dwrite d2/d3/d17/d25/f1b [0,4194304] 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:1/861: link d0/c9 d0/d2d/d35/d3f/c11e 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:7/739: fdatasync d2/d3/d27/f5b 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:4/809: rename de/d17/d36/dbe/lc4 to de/d17/d1b/dc7/d28/l104 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:6/726: creat dc/d14/d65/feb x:0 0 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:0/745: getdents d1/d3/db/d6e/d86/dcc/d7c/d88 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/671: link d3/d2a/f54 d3/d7/d8d/fc8 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:6/727: chown dc/d14/c8e 3337 1 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:1/862: mknod d0/d2d/d5e/d7e/dd2/c11f 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/757: read d6/d37/d19/d76/d8f/de0/de5/d4f/f82 [3605583,99672] 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:9/715: link d9/de/d20/d37/d42/d7f/ld0 d9/de/d20/d37/d42/d7f/lfc 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:1/863: write d0/d2d/d35/d3f/d4e/d66/fe5 [534160,130307] 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/672: mknod d3/d7/d8d/cc9 0 2024-09-17T01:56:30.288 INFO:tasks.workunit.client.0.smithi063.stdout:4/810: creat de/d17/d1b/dc7/d28/d8d/f105 x:0 0 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/758: fsync d6/d37/d79/f7c 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/716: symlink d9/de/d20/d37/d42/d4c/lfd 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:1/864: symlink d0/d2d/d35/d9d/l120 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:2/673: truncate d3/d7/df/d43/f69 768753 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/717: creat d9/de/d33/df5/ffe x:0 0 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/643: dread d1/d7/d28/d2a/d4d/fae [0,4194304] 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/644: fdatasync d1/f16 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:6/728: dwrite dc/d14/d19/f2d [0,4194304] 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:7/740: dread d2/d15/d2f/d45/fab [0,4194304] 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:0/746: dwrite d1/d3/db/f39 [0,4194304] 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:2/674: getdents d3/d7/d76 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/759: dwrite d6/d9/d13/f1e [4194304,4194304] 0 2024-09-17T01:56:30.289 INFO:tasks.workunit.client.0.smithi063.stdout:7/741: getdents d2/d15/d2f/d3e/d73/dcd 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/675: mknod d3/d7/d76/cca 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/718: dwrite d9/d8d/d2a/f53 [4194304,4194304] 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/645: dwrite d1/d7/d28/d2a/d44/f73 [0,4194304] 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/811: dread de/d17/d1b/dc7/f9f [0,4194304] 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:0/747: dread d1/f1e [0,4194304] 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/719: read - d9/de/d20/d1b/d25/d73/f81 zero size 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:1/865: truncate d0/d2d/d35/d6f/db7/fd0 3661458 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/676: creat d3/d7/df/fcb x:0 0 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/812: dread de/d2d/d52/f5f [0,4194304] 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/760: creat d6/d37/d19/d76/d8f/de0/de5/d4f/fee x:0 0 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:0/748: rename d1/d3/db/d4b/d7d/f91 to d1/d1d/ff6 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/813: write de/d17/d36/d70/f72 [590899,101998] 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/761: creat d6/d35/dc1/d54/fef x:0 0 0 2024-09-17T01:56:30.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/720: rename d9/de/d20/d37/d42/d4c to d9/d27/dff 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:0/749: symlink d1/d3/db/d18/lf7 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:4/814: link de/d17/d1b/dc7/c29 de/d17/d36/dbe/da6/c106 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:5/762: unlink d6/d35/dc1/d3f/dac/ccd 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:0/750: mkdir d1/d3/db/d4b/d98/df8 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:4/815: read de/d2d/fdb [3006835,121827] 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:9/721: dwrite d9/de/d20/d37/f50 [4194304,4194304] 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:4/816: creat de/d17/d1b/d9e/f107 x:0 0 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:5/763: dwrite d6/d37/d19/d50/d98/fc0 [0,4194304] 0 2024-09-17T01:56:30.291 INFO:tasks.workunit.client.0.smithi063.stdout:9/722: dread - d9/de/d20/d37/d42/d7f/fb5 zero size 2024-09-17T01:56:30.292 INFO:tasks.workunit.client.0.smithi063.stdout:6/729: dread dc/d14/d18/d74/fb1 [0,4194304] 0 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:6/730: write dc/f13 [8311839,112818] 0 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:5/764: symlink d6/d35/dc1/d54/lf0 0 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/723: rename d9/d8d/d2a/d40/ld7 to d9/de/d20/d32/l100 0 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:4/817: chown de/f4c 1539 1 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:6/731: chown dc/d14/d19/d20/c3f 55748 1 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/724: fdatasync d9/de/d33/ff0 0 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:5/765: write d6/d9/f40 [1528110,115135] 0 2024-09-17T01:56:30.295 INFO:tasks.workunit.client.0.smithi063.stdout:4/818: write de/fe9 [175112,119762] 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/766: mkdir d6/d35/dc1/d29/d36/de1/df1 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/767: creat d6/d9/d32/d8c/da7/ff2 x:0 0 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/768: write d6/d9/d13/d1d/fc4 [1043956,32029] 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/725: dread d9/d8d/d2a/f3f [0,4194304] 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/726: rename d9/de/d20/d37/f91 to d9/d8d/d2a/d36/ded/f101 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/727: chown d9/dbf 69298287 1 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:1/866: sync 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:2/677: sync 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:8/646: dread d1/d7/f4e [0,4194304] 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:0/751: truncate d1/d3/db/d6e/d86/dcc/d7c/fdb 1792822 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:2/678: symlink d3/dbc/lcc 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:1/867: write d0/d93/d9e/dca/fcc [1313321,62779] 0 2024-09-17T01:56:30.296 INFO:tasks.workunit.client.0.smithi063.stdout:2/679: symlink d3/d7/df/lcd 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:6/732: sync 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:3/788: dread df/f26 [0,4194304] 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:2/680: readlink d3/d2a/lc5 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:3/789: fsync df/f26 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:5/769: read d6/d35/dc1/d29/d36/f97 [1436610,13964] 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:1/868: link d0/f8 d0/d2d/d35/d3f/d81/d50/d6c/d74/def/f121 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/728: dwrite d9/de/d20/d32/fd1 [0,4194304] 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:5/770: write d6/d35/dc1/d3a/f99 [10531,120609] 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:1/869: stat d0/d2d/d35/d3f/d81/d50/d6c/d90/cec 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:0/752: dread d1/d3/db/f39 [0,4194304] 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:5/771: chown d6/d35/dc1/d29/d36/de1/le9 2611795 1 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/729: creat d9/de/dcf/f102 x:0 0 0 2024-09-17T01:56:30.297 INFO:tasks.workunit.client.0.smithi063.stdout:5/772: mkdir d6/d9/d32/d8c/da7/da9/df3 0 2024-09-17T01:56:30.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/773: creat d6/d9/d13/d1d/d8a/ff4 x:0 0 0 2024-09-17T01:56:30.298 INFO:tasks.workunit.client.0.smithi063.stdout:3/790: dwrite df/d83/fc4 [0,4194304] 0 2024-09-17T01:56:30.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/774: readlink d6/d9/l1c 0 2024-09-17T01:56:30.298 INFO:tasks.workunit.client.0.smithi063.stdout:8/647: truncate d1/d7/d28/d2a/d37/d3a/f3c 1198444 0 2024-09-17T01:56:30.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/819: dwrite de/d17/f68 [0,4194304] 0 2024-09-17T01:56:30.300 INFO:tasks.workunit.client.0.smithi063.stdout:5/775: symlink d6/d35/lf5 0 2024-09-17T01:56:30.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/791: creat df/d12/d30/db8/f10e x:0 0 0 2024-09-17T01:56:30.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/820: fsync de/d17/d1b/dc7/f37 0 2024-09-17T01:56:30.300 INFO:tasks.workunit.client.0.smithi063.stdout:0/753: dwrite d1/d3/db/d18/d33/f2e [0,4194304] 0 2024-09-17T01:56:30.302 INFO:tasks.workunit.client.0.smithi063.stdout:8/648: link d1/d7/d28/d2a/d4d/l65 d1/d7/d28/d2a/d37/d3a/d75/d9a/lc4 0 2024-09-17T01:56:30.302 INFO:tasks.workunit.client.0.smithi063.stdout:8/649: sync 2024-09-17T01:56:30.302 INFO:tasks.workunit.client.0.smithi063.stdout:3/792: write df/d12/d3a/f73 [275182,55390] 0 2024-09-17T01:56:30.302 INFO:tasks.workunit.client.0.smithi063.stdout:5/776: write d6/d9/d13/d1d/f21 [685788,75698] 0 2024-09-17T01:56:30.303 INFO:tasks.workunit.client.0.smithi063.stdout:5/777: dread - d6/d35/dc1/d3f/fd4 zero size 2024-09-17T01:56:30.304 INFO:tasks.workunit.client.0.smithi063.stdout:8/650: unlink d1/d7/d1d/ca3 0 2024-09-17T01:56:30.305 INFO:tasks.workunit.client.0.smithi063.stdout:0/754: stat d1/d3/db/d6e/d86/dcc/d53/d62/dcd/fd9 0 2024-09-17T01:56:30.306 INFO:tasks.workunit.client.0.smithi063.stdout:3/793: write df/d12/d2d/fc6 [315372,37731] 0 2024-09-17T01:56:30.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/870: truncate d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a 628784 0 2024-09-17T01:56:30.307 INFO:tasks.workunit.client.0.smithi063.stdout:2/681: dwrite d3/d7/d8d/fc8 [0,4194304] 0 2024-09-17T01:56:30.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/778: chown d6/d9/d13/d1d/d8a/ff4 12 1 2024-09-17T01:56:30.308 INFO:tasks.workunit.client.0.smithi063.stdout:3/794: fdatasync df/d12/d2d/f36 0 2024-09-17T01:56:30.309 INFO:tasks.workunit.client.0.smithi063.stdout:0/755: read d1/d1f/f64 [976628,24343] 0 2024-09-17T01:56:30.309 INFO:tasks.workunit.client.0.smithi063.stdout:4/821: dwrite de/fe9 [0,4194304] 0 2024-09-17T01:56:30.309 INFO:tasks.workunit.client.0.smithi063.stdout:5/779: write d6/d35/f6c [175668,13337] 0 2024-09-17T01:56:30.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/682: symlink d3/d28/lce 0 2024-09-17T01:56:30.311 INFO:tasks.workunit.client.0.smithi063.stdout:5/780: chown d6/d35/dc1/d54/fef 20794794 1 2024-09-17T01:56:30.311 INFO:tasks.workunit.client.0.smithi063.stdout:3/795: write df/d12/d1e/d39/ff3 [754745,97042] 0 2024-09-17T01:56:30.311 INFO:tasks.workunit.client.0.smithi063.stdout:1/871: symlink d0/d93/dc4/dff/l122 0 2024-09-17T01:56:30.312 INFO:tasks.workunit.client.0.smithi063.stdout:4/822: stat de/d17/d1b/dc7/d28/d8d/f105 0 2024-09-17T01:56:30.312 INFO:tasks.workunit.client.0.smithi063.stdout:1/872: stat d0/d2d/d35/d9d/lc9 0 2024-09-17T01:56:30.312 INFO:tasks.workunit.client.0.smithi063.stdout:5/781: readlink d6/d35/l48 0 2024-09-17T01:56:30.314 INFO:tasks.workunit.client.0.smithi063.stdout:2/683: link d3/dbc/cc1 d3/d7/df/d30/ccf 0 2024-09-17T01:56:30.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/782: write d6/d37/d19/f75 [2825563,30833] 0 2024-09-17T01:56:30.314 INFO:tasks.workunit.client.0.smithi063.stdout:9/730: dread d9/f6a [0,4194304] 0 2024-09-17T01:56:30.314 INFO:tasks.workunit.client.0.smithi063.stdout:2/684: chown d3/f79 62467 1 2024-09-17T01:56:30.315 INFO:tasks.workunit.client.0.smithi063.stdout:2/685: write d3/f44 [2217464,130634] 0 2024-09-17T01:56:30.315 INFO:tasks.workunit.client.0.smithi063.stdout:9/731: fsync d9/de/ff 0 2024-09-17T01:56:30.317 INFO:tasks.workunit.client.0.smithi063.stdout:5/783: fdatasync d6/d9/d13/d1d/f21 0 2024-09-17T01:56:30.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/732: unlink d9/de/cba 0 2024-09-17T01:56:30.318 INFO:tasks.workunit.client.0.smithi063.stdout:2/686: write d3/d7/df/d5a/f95 [672866,11020] 0 2024-09-17T01:56:30.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/733: fsync d9/de/d20/d1b/d25/d73/fec 0 2024-09-17T01:56:30.318 INFO:tasks.workunit.client.0.smithi063.stdout:2/687: write d3/d7/d38/f65 [3585910,31333] 0 2024-09-17T01:56:30.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/796: dwrite df/d12/d43/d50/d58/d97/fe4 [0,4194304] 0 2024-09-17T01:56:30.319 INFO:tasks.workunit.client.0.smithi063.stdout:2/688: symlink d3/d2a/ld0 0 2024-09-17T01:56:30.321 INFO:tasks.workunit.client.0.smithi063.stdout:9/734: rename d9/de/d20/d37/d42/dbe to d9/de/d33/df5/d103 0 2024-09-17T01:56:30.321 INFO:tasks.workunit.client.0.smithi063.stdout:3/797: mknod df/d12/d43/d50/d58/d97/daa/c10f 0 2024-09-17T01:56:30.321 INFO:tasks.workunit.client.0.smithi063.stdout:2/689: creat d3/d7/d76/fd1 x:0 0 0 2024-09-17T01:56:30.321 INFO:tasks.workunit.client.0.smithi063.stdout:2/690: sync 2024-09-17T01:56:30.322 INFO:tasks.workunit.client.0.smithi063.stdout:3/798: chown df/d12/d1e/f27 969886560 1 2024-09-17T01:56:30.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/735: creat d9/d27/dff/f104 x:0 0 0 2024-09-17T01:56:30.324 INFO:tasks.workunit.client.0.smithi063.stdout:1/873: fsync d0/d2d/d35/d3f/d81/d50/d6c/d74/f8a 0 2024-09-17T01:56:30.325 INFO:tasks.workunit.client.0.smithi063.stdout:4/823: truncate de/fe9 1498345 0 2024-09-17T01:56:30.326 INFO:tasks.workunit.client.0.smithi063.stdout:4/824: dread - de/d17/d36/dbe/d9a/fad zero size 2024-09-17T01:56:30.327 INFO:tasks.workunit.client.0.smithi063.stdout:1/874: symlink d0/d2d/d35/d3f/d4e/l123 0 2024-09-17T01:56:30.327 INFO:tasks.workunit.client.0.smithi063.stdout:2/691: link d3/d7/df/d68/f74 d3/d7/fd2 0 2024-09-17T01:56:30.327 INFO:tasks.workunit.client.0.smithi063.stdout:7/742: dread d2/d3/d22/d3a/f70 [0,4194304] 0 2024-09-17T01:56:30.328 INFO:tasks.workunit.client.0.smithi063.stdout:2/692: creat d3/d2a/fd3 x:0 0 0 2024-09-17T01:56:30.328 INFO:tasks.workunit.client.0.smithi063.stdout:1/875: symlink d0/d2d/d35/d6f/db7/l124 0 2024-09-17T01:56:30.330 INFO:tasks.workunit.client.0.smithi063.stdout:5/784: truncate d6/d35/dc1/d3a/f4c 2665543 0 2024-09-17T01:56:30.330 INFO:tasks.workunit.client.0.smithi063.stdout:2/693: creat d3/d7/df/d43/fd4 x:0 0 0 2024-09-17T01:56:30.332 INFO:tasks.workunit.client.0.smithi063.stdout:9/736: dwrite d9/d8d/d2a/d36/f6f [0,4194304] 0 2024-09-17T01:56:30.333 INFO:tasks.workunit.client.0.smithi063.stdout:4/825: dread de/d2d/d3c/f4b [0,4194304] 0 2024-09-17T01:56:30.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/785: fdatasync d6/d37/d19/d76/d8f/de0/de5/fb7 0 2024-09-17T01:56:30.334 INFO:tasks.workunit.client.0.smithi063.stdout:4/826: chown de/f14 30 1 2024-09-17T01:56:30.334 INFO:tasks.workunit.client.0.smithi063.stdout:4/827: sync 2024-09-17T01:56:30.337 INFO:tasks.workunit.client.0.smithi063.stdout:5/786: getdents d6/d35/dc1/d3f/da6 0 2024-09-17T01:56:30.338 INFO:tasks.workunit.client.0.smithi063.stdout:6/733: dread dc/d14/d19/d20/f23 [4194304,4194304] 0 2024-09-17T01:56:30.338 INFO:tasks.workunit.client.0.smithi063.stdout:9/737: creat d9/d8d/ddf/f105 x:0 0 0 2024-09-17T01:56:30.339 INFO:tasks.workunit.client.0.smithi063.stdout:1/876: dwrite d0/d93/fb9 [0,4194304] 0 2024-09-17T01:56:30.340 INFO:tasks.workunit.client.0.smithi063.stdout:4/828: link de/d2d/d52/d9c/fe8 de/d17/d1b/dc7/d28/d8b/f108 0 2024-09-17T01:56:30.340 INFO:tasks.workunit.client.0.smithi063.stdout:9/738: rmdir d9/dbf 39 2024-09-17T01:56:30.340 INFO:tasks.workunit.client.0.smithi063.stdout:3/799: dread df/d12/d1e/d5e/f76 [0,4194304] 0 2024-09-17T01:56:30.341 INFO:tasks.workunit.client.0.smithi063.stdout:6/734: getdents dc/d14/d19 0 2024-09-17T01:56:30.342 INFO:tasks.workunit.client.0.smithi063.stdout:5/787: symlink d6/d35/dc1/d3f/lf6 0 2024-09-17T01:56:30.342 INFO:tasks.workunit.client.0.smithi063.stdout:2/694: dwrite d3/d2a/fad [0,4194304] 0 2024-09-17T01:56:30.342 INFO:tasks.workunit.client.0.smithi063.stdout:6/735: chown dc/d14/f70 232909895 1 2024-09-17T01:56:30.343 INFO:tasks.workunit.client.0.smithi063.stdout:4/829: unlink de/d17/d36/c86 0 2024-09-17T01:56:30.344 INFO:tasks.workunit.client.0.smithi063.stdout:1/877: truncate d0/d2d/d35/d3f/d81/d50/d6c/d90/ff5 1563294 0 2024-09-17T01:56:30.345 INFO:tasks.workunit.client.0.smithi063.stdout:4/830: creat de/d17/d1b/d9e/f109 x:0 0 0 2024-09-17T01:56:30.345 INFO:tasks.workunit.client.0.smithi063.stdout:3/800: mknod df/d12/d3a/c110 0 2024-09-17T01:56:30.345 INFO:tasks.workunit.client.0.smithi063.stdout:8/651: dread d1/d7/d28/d2a/f5b [0,4194304] 0 2024-09-17T01:56:30.345 INFO:tasks.workunit.client.0.smithi063.stdout:9/739: creat d9/de/d20/d37/f106 x:0 0 0 2024-09-17T01:56:30.345 INFO:tasks.workunit.client.0.smithi063.stdout:2/695: mkdir d3/d28/d72/dd5 0 2024-09-17T01:56:30.346 INFO:tasks.workunit.client.0.smithi063.stdout:1/878: mknod d0/d2d/d35/d3f/d81/d50/d6c/d74/c125 0 2024-09-17T01:56:30.347 INFO:tasks.workunit.client.0.smithi063.stdout:4/831: chown de/d17/d1b/dc7/d28/d30/l45 283063 1 2024-09-17T01:56:30.347 INFO:tasks.workunit.client.0.smithi063.stdout:2/696: unlink d3/d7/d38/f9f 0 2024-09-17T01:56:30.347 INFO:tasks.workunit.client.0.smithi063.stdout:3/801: write df/d12/d43/d50/f6a [380127,11678] 0 2024-09-17T01:56:30.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/879: stat d0/d93/d9e/dca/fcc 0 2024-09-17T01:56:30.348 INFO:tasks.workunit.client.0.smithi063.stdout:9/740: rename d9/de/d20/d1b/fc9 to d9/de/d20/d37/d42/d7f/f107 0 2024-09-17T01:56:30.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/880: chown d0/d1c/c46 496949 1 2024-09-17T01:56:30.349 INFO:tasks.workunit.client.0.smithi063.stdout:2/697: chown d3/d7/d8d/fc8 25564 1 2024-09-17T01:56:30.349 INFO:tasks.workunit.client.0.smithi063.stdout:9/741: fdatasync d9/de/d20/d1b/fa8 0 2024-09-17T01:56:30.350 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:30.353+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:30.350 INFO:tasks.workunit.client.0.smithi063.stdout:2/698: mknod d3/dbc/cd6 0 2024-09-17T01:56:30.351 INFO:tasks.workunit.client.0.smithi063.stdout:0/756: dread d1/d3/d10/f4e [0,4194304] 0 2024-09-17T01:56:30.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/742: symlink d9/de/d20/d32/l108 0 2024-09-17T01:56:30.352 INFO:tasks.workunit.client.0.smithi063.stdout:2/699: readlink d3/d7/d8d/dc0/lc2 0 2024-09-17T01:56:30.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/788: dwrite d6/d35/dc1/d69/f7a [0,4194304] 0 2024-09-17T01:56:30.353 INFO:tasks.workunit.client.0.smithi063.stdout:5/789: chown d6/f44 0 1 2024-09-17T01:56:30.354 INFO:tasks.workunit.client.0.smithi063.stdout:2/700: write d3/d7/df/d68/f59 [1008863,86818] 0 2024-09-17T01:56:30.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/743: write d9/f56 [1986013,96741] 0 2024-09-17T01:56:30.355 INFO:tasks.workunit.client.0.smithi063.stdout:8/652: dread d1/d7/d28/d2a/f5b [0,4194304] 0 2024-09-17T01:56:30.356 INFO:tasks.workunit.client.0.smithi063.stdout:6/736: dread dc/d14/d65/f7d [0,4194304] 0 2024-09-17T01:56:30.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/757: creat d1/d3/db/d4b/d98/ddd/ff9 x:0 0 0 2024-09-17T01:56:30.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/832: dwrite de/d17/d1b/d9e/fe5 [0,4194304] 0 2024-09-17T01:56:30.359 INFO:tasks.workunit.client.0.smithi063.stdout:6/737: creat dc/d14/d19/fec x:0 0 0 2024-09-17T01:56:30.359 INFO:tasks.workunit.client.0.smithi063.stdout:9/744: write d9/d8d/f46 [2559171,16715] 0 2024-09-17T01:56:30.360 INFO:tasks.workunit.client.0.smithi063.stdout:2/701: creat d3/d7/df/fd7 x:0 0 0 2024-09-17T01:56:30.360 INFO:tasks.workunit.client.0.smithi063.stdout:3/802: dread df/d12/d3a/f73 [0,4194304] 0 2024-09-17T01:56:30.360 INFO:tasks.workunit.client.0.smithi063.stdout:3/803: sync 2024-09-17T01:56:30.361 INFO:tasks.workunit.client.0.smithi063.stdout:7/743: dread d2/d3/d17/d25/f1b [4194304,4194304] 0 2024-09-17T01:56:30.363 INFO:tasks.workunit.client.0.smithi063.stdout:1/881: dwrite d0/d2d/d35/d3f/d81/d50/d6c/f119 [0,4194304] 0 2024-09-17T01:56:30.363 INFO:tasks.workunit.client.0.smithi063.stdout:7/744: stat d2/d3/d17 0 2024-09-17T01:56:30.364 INFO:tasks.workunit.client.0.smithi063.stdout:5/790: dwrite d6/d9/d32/f71 [0,4194304] 0 2024-09-17T01:56:30.365 INFO:tasks.workunit.client.0.smithi063.stdout:9/745: symlink d9/d27/dff/l109 0 2024-09-17T01:56:30.365 INFO:tasks.workunit.client.0.smithi063.stdout:0/758: write d1/d3/db/d4b/d82/fb4 [809179,62283] 0 2024-09-17T01:56:30.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/833: rename de/l15 to de/d17/d36/dbe/da6/l10a 0 2024-09-17T01:56:30.365 INFO:tasks.workunit.client.0.smithi063.stdout:6/738: creat dc/d14/d2f/fed x:0 0 0 2024-09-17T01:56:30.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/746: mkdir d9/d8d/ddf/d10a 0 2024-09-17T01:56:30.367 INFO:tasks.workunit.client.0.smithi063.stdout:0/759: symlink d1/d1d/da5/lfa 0 2024-09-17T01:56:30.368 INFO:tasks.workunit.client.0.smithi063.stdout:5/791: fsync d6/d35/dc1/d54/fd9 0 2024-09-17T01:56:30.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/882: fsync d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ff3 0 2024-09-17T01:56:30.370 INFO:teuthology.orchestra.run.smithi063.stderr:clear 4.2d pg_upmap mapping 2024-09-17T01:56:30.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/653: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f63 [0,4194304] 0 2024-09-17T01:56:30.375 INFO:tasks.workunit.client.0.smithi063.stdout:4/834: symlink de/d17/d36/d70/d77/l10b 0 2024-09-17T01:56:30.376 INFO:tasks.workunit.client.0.smithi063.stdout:9/747: write d9/de/d20/d37/f58 [4891430,56217] 0 2024-09-17T01:56:30.381 INFO:tasks.workunit.client.0.smithi063.stdout:2/702: dwrite d3/d7/df/d43/f55 [0,4194304] 0 2024-09-17T01:56:30.382 INFO:tasks.workunit.client.0.smithi063.stdout:8/654: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f1b 857359176 1 2024-09-17T01:56:30.383 INFO:tasks.workunit.client.0.smithi063.stdout:8/655: fdatasync d1/f5c 0 2024-09-17T01:56:30.383 INFO:tasks.workunit.client.0.smithi063.stdout:7/745: dwrite d2/d3/d17/d25/f9f [0,4194304] 0 2024-09-17T01:56:30.384 INFO:tasks.workunit.client.0.smithi063.stdout:2/703: write d3/d7/d38/f56 [1101485,44611] 0 2024-09-17T01:56:30.384 INFO:tasks.workunit.client.0.smithi063.stdout:3/804: dwrite df/d12/d3a/ffe [0,4194304] 0 2024-09-17T01:56:30.385 INFO:tasks.workunit.client.0.smithi063.stdout:5/792: creat d6/d37/d79/ff7 x:0 0 0 2024-09-17T01:56:30.386 INFO:tasks.workunit.client.0.smithi063.stdout:4/835: read de/d17/d36/d70/fc9 [249409,118088] 0 2024-09-17T01:56:30.387 INFO:tasks.workunit.client.0.smithi063.stdout:7/746: rename d2/d3/d17/d25/c85 to d2/d3/d27/d65/dd2/cee 0 2024-09-17T01:56:30.387 INFO:tasks.workunit.client.0.smithi063.stdout:3/805: symlink df/d12/d43/d50/d58/l111 0 2024-09-17T01:56:30.389 INFO:tasks.workunit.client.0.smithi063.stdout:4/836: mkdir de/d17/d36/dbe/dbc/d10c 0 2024-09-17T01:56:30.389 INFO:tasks.workunit.client.0.smithi063.stdout:9/748: write d9/de/d20/d1b/d25/d73/fd6 [488350,91875] 0 2024-09-17T01:56:30.389 INFO:tasks.workunit.client.0.smithi063.stdout:5/793: creat d6/d37/d19/de4/ff8 x:0 0 0 2024-09-17T01:56:30.389 INFO:tasks.workunit.client.0.smithi063.stdout:6/739: rmdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/dcd 0 2024-09-17T01:56:30.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/704: stat d3/d7/d76/caf 0 2024-09-17T01:56:30.390 INFO:tasks.workunit.client.0.smithi063.stdout:0/760: read d1/d3/db/d18/d33/f71 [1499558,94841] 0 2024-09-17T01:56:30.390 INFO:tasks.workunit.client.0.smithi063.stdout:7/747: stat d2/d3/d27/d8f/faf 0 2024-09-17T01:56:30.392 INFO:tasks.workunit.client.0.smithi063.stdout:7/748: write d2/d15/d2f/d52/f63 [3084604,86300] 0 2024-09-17T01:56:30.393 INFO:tasks.workunit.client.0.smithi063.stdout:3/806: mkdir df/d12/d112 0 2024-09-17T01:56:30.393 INFO:tasks.workunit.client.0.smithi063.stdout:8/656: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f4a [0,4194304] 0 2024-09-17T01:56:30.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/837: mkdir de/d17/d36/dbe/da6/d10d 0 2024-09-17T01:56:30.393 INFO:tasks.workunit.client.0.smithi063.stdout:5/794: rename d6/d35/c5a to d6/d37/d19/d76/d8f/de0/de5/d31/cf9 0 2024-09-17T01:56:30.394 INFO:tasks.workunit.client.0.smithi063.stdout:0/761: creat d1/d3/db/d4b/d98/ddd/ffb x:0 0 0 2024-09-17T01:56:30.394 INFO:tasks.workunit.client.0.smithi063.stdout:7/749: creat d2/d3/d27/d65/dd2/fef x:0 0 0 2024-09-17T01:56:30.394 INFO:tasks.workunit.client.0.smithi063.stdout:6/740: write dc/d14/d19/f1a [1290121,99809] 0 2024-09-17T01:56:30.394 INFO:tasks.workunit.client.0.smithi063.stdout:0/762: dread - d1/d3/d32/fe8 zero size 2024-09-17T01:56:30.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/749: symlink d9/de/d20/d37/l10b 0 2024-09-17T01:56:30.397 INFO:tasks.workunit.client.0.smithi063.stdout:2/705: link d3/d2a/f82 d3/d7/d8d/dc0/fd8 0 2024-09-17T01:56:30.397 INFO:tasks.workunit.client.0.smithi063.stdout:7/750: rmdir d2/d15/d2f/dd3 39 2024-09-17T01:56:30.397 INFO:tasks.workunit.client.0.smithi063.stdout:5/795: write d6/d35/f95 [1439889,55847] 0 2024-09-17T01:56:30.397 INFO:tasks.workunit.client.0.smithi063.stdout:6/741: rmdir dc/d14/d19 39 2024-09-17T01:56:30.397 INFO:tasks.workunit.client.0.smithi063.stdout:9/750: mknod d9/d8d/d2a/d36/ded/c10c 0 2024-09-17T01:56:30.398 INFO:tasks.workunit.client.0.smithi063.stdout:9/751: chown d9/d8d/d2a 17024 1 2024-09-17T01:56:30.398 INFO:tasks.workunit.client.0.smithi063.stdout:5/796: creat d6/d9/d13/ffa x:0 0 0 2024-09-17T01:56:30.399 INFO:tasks.workunit.client.0.smithi063.stdout:9/752: mknod d9/de/d20/d32/c10d 0 2024-09-17T01:56:30.399 INFO:tasks.workunit.client.0.smithi063.stdout:6/742: write dc/d14/d18/f94 [466226,97427] 0 2024-09-17T01:56:30.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/753: link d9/d27/c55 d9/dbf/c10e 0 2024-09-17T01:56:30.403 INFO:tasks.workunit.client.0.smithi063.stdout:1/883: dread d0/d2d/d35/d3f/d81/d50/d6c/fe7 [0,4194304] 0 2024-09-17T01:56:30.403 INFO:tasks.workunit.client.0.smithi063.stdout:0/763: dwrite d1/d3/d1b/f65 [4194304,4194304] 0 2024-09-17T01:56:30.403 INFO:tasks.workunit.client.0.smithi063.stdout:2/706: dread d3/d7/fd2 [0,4194304] 0 2024-09-17T01:56:30.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:56:30.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/754: chown d9/de/d20/d1b/f6e 115731 1 2024-09-17T01:56:30.404 INFO:tasks.workunit.client.0.smithi063.stdout:1/884: write d0/d2d/d35/d3f/d81/d50/d6c/d90/ff5 [1620255,118268] 0 2024-09-17T01:56:30.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/751: truncate d2/d3/d27/d65/f6d 1677661 0 2024-09-17T01:56:30.406 INFO:tasks.workunit.client.0.smithi063.stdout:0/764: creat d1/d3/db/d18/d33/d83/db7/ffc x:0 0 0 2024-09-17T01:56:30.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/707: mknod d3/dbc/cd9 0 2024-09-17T01:56:30.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/755: readlink d9/lc6 0 2024-09-17T01:56:30.407 INFO:tasks.workunit.client.0.smithi063.stdout:1/885: symlink d0/l126 0 2024-09-17T01:56:30.407 INFO:tasks.workunit.client.0.smithi063.stdout:0/765: stat d1/d3/db/f13 0 2024-09-17T01:56:30.407 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:30.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:2274 3.8 3:17051619:::200.0000000f:head [write 3231516~16970 [fadvise_dontneed] in=16970b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:30.410726+0000", 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00010811000000000001, 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013718399999999999, 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410726+0000", 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410726+0000", 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410727+0000", 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6499999999999999e-07 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410740+0000", 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2816999999999999e-05 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410749+0000", 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7529999999999996e-06 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410756+0000", 2024-09-17T01:56:30.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849999999999997e-06 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410805+0000", 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8928000000000003e-05 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:30.410866+0000", 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1158e-05 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.412 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:30.412 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-17T01:56:30.412 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:30.412 INFO:tasks.workunit.client.0.smithi063.stdout:6/743: dwrite dc/d14/d19/f82 [0,4194304] 0 2024-09-17T01:56:30.413 INFO:tasks.workunit.client.0.smithi063.stdout:9/756: rename d9/de/d20/d1b/f2d to d9/dbf/f10f 0 2024-09-17T01:56:30.413 INFO:tasks.workunit.client.0.smithi063.stdout:7/752: read d2/d3/d67/fc8 [1264058,88265] 0 2024-09-17T01:56:30.413 INFO:tasks.workunit.client.0.smithi063.stdout:0/766: write d1/d3/db/d18/d33/d83/fac [818303,18086] 0 2024-09-17T01:56:30.413 INFO:tasks.workunit.client.0.smithi063.stdout:0/767: chown d1/d3/db/d4b/ld0 2 1 2024-09-17T01:56:30.413 INFO:tasks.workunit.client.0.smithi063.stdout:6/744: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dde/dee 0 2024-09-17T01:56:30.413 INFO:tasks.workunit.client.0.smithi063.stdout:6/745: mkdir dc/d14/d19/d20/d66/def 0 2024-09-17T01:56:30.414 INFO:tasks.workunit.client.0.smithi063.stdout:2/708: dwrite d3/d2a/fd3 [0,4194304] 0 2024-09-17T01:56:30.414 INFO:tasks.workunit.client.0.smithi063.stdout:6/746: symlink dc/d14/d65/ddd/lf0 0 2024-09-17T01:56:30.416 INFO:tasks.workunit.client.0.smithi063.stdout:6/747: truncate dc/d14/d19/d20/d32/d52/d5a/fd4 824407 0 2024-09-17T01:56:30.417 INFO:tasks.workunit.client.0.smithi063.stdout:7/753: dwrite d2/d3/d22/d3a/f70 [0,4194304] 0 2024-09-17T01:56:30.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/886: truncate d0/d1c/f48 4876337 0 2024-09-17T01:56:30.419 INFO:tasks.workunit.client.0.smithi063.stdout:1/887: creat d0/d2d/d35/d3f/d4e/d66/f127 x:0 0 0 2024-09-17T01:56:30.419 INFO:tasks.workunit.client.0.smithi063.stdout:6/748: link dc/d1b/l30 dc/d14/d19/d20/lf1 0 2024-09-17T01:56:30.420 INFO:tasks.workunit.client.0.smithi063.stdout:4/838: dread de/d17/d36/dbe/f91 [0,4194304] 0 2024-09-17T01:56:30.420 INFO:tasks.workunit.client.0.smithi063.stdout:6/749: fsync dc/d14/d19/d20/d32/f54 0 2024-09-17T01:56:30.421 INFO:tasks.workunit.client.0.smithi063.stdout:1/888: creat d0/d2d/d5e/dd8/f128 x:0 0 0 2024-09-17T01:56:30.421 INFO:tasks.workunit.client.0.smithi063.stdout:1/889: readlink d0/d1c/l92 0 2024-09-17T01:56:30.421 INFO:tasks.workunit.client.0.smithi063.stdout:6/750: chown dc/d14/d19/d20/d32/d52/d5a/d43 57605782 1 2024-09-17T01:56:30.422 INFO:tasks.workunit.client.0.smithi063.stdout:1/890: chown d0/d2d/d35/d3f/d81/d50/d6c 720593 1 2024-09-17T01:56:30.425 INFO:tasks.workunit.client.0.smithi063.stdout:7/754: dwrite d2/d3/d27/f2d [0,4194304] 0 2024-09-17T01:56:30.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:30.429 INFO:tasks.workunit.client.0.smithi063.stdout:7/755: fdatasync d2/fd 0 2024-09-17T01:56:30.430 INFO:tasks.workunit.client.0.smithi063.stdout:1/891: read d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [784918,87993] 0 2024-09-17T01:56:30.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/839: dwrite de/f3b [0,4194304] 0 2024-09-17T01:56:30.431 INFO:tasks.workunit.client.0.smithi063.stdout:3/807: dread df/d12/d1e/d5e/f8f [0,4194304] 0 2024-09-17T01:56:30.431 INFO:tasks.workunit.client.0.smithi063.stdout:7/756: symlink d2/d15/d2f/d3e/d73/dcd/lf0 0 2024-09-17T01:56:30.431 INFO:tasks.workunit.client.0.smithi063.stdout:4/840: chown de/d17/d36/dbe/d9a/cd4 841560 1 2024-09-17T01:56:30.431 INFO:tasks.workunit.client.0.smithi063.stdout:1/892: fsync d0/d2d/d35/d3f/d94/f10b 0 2024-09-17T01:56:30.432 INFO:tasks.workunit.client.0.smithi063.stdout:3/808: chown df/d12/d43/d50/d58/d97/fe4 5 1 2024-09-17T01:56:30.433 INFO:tasks.workunit.client.0.smithi063.stdout:3/809: creat df/d12/d30/d8a/d9d/f113 x:0 0 0 2024-09-17T01:56:30.438 INFO:tasks.workunit.client.0.smithi063.stdout:2/709: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:56:30.440 INFO:tasks.workunit.client.0.smithi063.stdout:1/893: dwrite d0/d2d/d5e/dd8/fdd [0,4194304] 0 2024-09-17T01:56:30.441 INFO:tasks.workunit.client.0.smithi063.stdout:6/751: dread dc/d14/d19/d20/d66/fd5 [0,4194304] 0 2024-09-17T01:56:30.442 INFO:tasks.workunit.client.0.smithi063.stdout:3/810: dwrite df/d12/d30/db8/fd4 [0,4194304] 0 2024-09-17T01:56:30.442 INFO:tasks.workunit.client.0.smithi063.stdout:4/841: dread de/d17/d1b/dc7/f4e [0,4194304] 0 2024-09-17T01:56:30.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/710: mknod d3/d2a/dac/cda 0 2024-09-17T01:56:30.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/752: truncate dc/d14/d2f/fe3 756945 0 2024-09-17T01:56:30.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/753: chown dc/d14/d19/d20/d66 63483244 1 2024-09-17T01:56:30.445 INFO:tasks.workunit.client.0.smithi063.stdout:4/842: fdatasync de/d17/d36/dbe/fdf 0 2024-09-17T01:56:30.446 INFO:tasks.workunit.client.0.smithi063.stdout:2/711: mkdir d3/d7/df/d68/ddb 0 2024-09-17T01:56:30.446 INFO:tasks.workunit.client.0.smithi063.stdout:7/757: fsync d2/d3/d27/f2d 0 2024-09-17T01:56:30.447 INFO:tasks.workunit.client.0.smithi063.stdout:2/712: dread - d3/d28/f5c zero size 2024-09-17T01:56:30.449 INFO:tasks.workunit.client.0.smithi063.stdout:1/894: dwrite d0/d2d/d35/d3f/d81/f45 [0,4194304] 0 2024-09-17T01:56:30.450 INFO:tasks.workunit.client.0.smithi063.stdout:6/754: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/ff2 x:0 0 0 2024-09-17T01:56:30.450 INFO:tasks.workunit.client.0.smithi063.stdout:2/713: symlink d3/d7/df/d43/ldc 0 2024-09-17T01:56:30.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/758: mknod d2/d3/d67/d8d/dd4/cf1 0 2024-09-17T01:56:30.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/843: rename de/d17/dc6/ceb to de/d17/d1b/dc7/d28/d98/c10e 0 2024-09-17T01:56:30.451 INFO:tasks.workunit.client.0.smithi063.stdout:1/895: creat d0/d93/d9e/f129 x:0 0 0 2024-09-17T01:56:30.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/844: stat de/c13 0 2024-09-17T01:56:30.451 INFO:tasks.workunit.client.0.smithi063.stdout:7/759: creat d2/ff2 x:0 0 0 2024-09-17T01:56:30.454 INFO:tasks.workunit.client.0.smithi063.stdout:4/845: symlink de/d17/d1b/dc7/d28/d30/l10f 0 2024-09-17T01:56:30.454 INFO:tasks.workunit.client.0.smithi063.stdout:6/755: link dc/d14/c6a dc/d14/d19/d20/d32/d52/d5a/d43/dc5/cf3 0 2024-09-17T01:56:30.454 INFO:tasks.workunit.client.0.smithi063.stdout:6/756: chown dc 566677 1 2024-09-17T01:56:30.454 INFO:tasks.workunit.client.0.smithi063.stdout:6/757: readlink dc/d14/d19/l39 0 2024-09-17T01:56:30.455 INFO:tasks.workunit.client.0.smithi063.stdout:1/896: write d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ff3 [1080163,125407] 0 2024-09-17T01:56:30.455 INFO:tasks.workunit.client.0.smithi063.stdout:6/758: creat dc/d14/d19/d20/d32/d52/d5a/d97/db8/ff4 x:0 0 0 2024-09-17T01:56:30.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/897: write d0/d2d/d5e/d7e/fc6 [762796,39100] 0 2024-09-17T01:56:30.457 INFO:tasks.workunit.client.0.smithi063.stdout:6/759: write dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/fbb [506413,84176] 0 2024-09-17T01:56:30.458 INFO:tasks.workunit.client.0.smithi063.stdout:7/760: dwrite d2/d15/d2f/dd3/fdc [0,4194304] 0 2024-09-17T01:56:30.459 INFO:tasks.workunit.client.0.smithi063.stdout:7/761: readlink d2/d3/d67/lbe 0 2024-09-17T01:56:30.461 INFO:tasks.workunit.client.0.smithi063.stdout:7/762: write d2/d3/d27/d39/f42 [2469326,5076] 0 2024-09-17T01:56:30.461 INFO:tasks.workunit.client.0.smithi063.stdout:1/898: creat d0/d2d/d35/d3f/d4e/f12a x:0 0 0 2024-09-17T01:56:30.461 INFO:tasks.workunit.client.0.smithi063.stdout:7/763: readlink d2/d3/l26 0 2024-09-17T01:56:30.463 INFO:tasks.workunit.client.0.smithi063.stdout:1/899: creat d0/d2d/d35/d3f/d81/d50/d8b/f12b x:0 0 0 2024-09-17T01:56:30.464 INFO:tasks.workunit.client.0.smithi063.stdout:1/900: rmdir d0/d2d/d5e/d7e/dd2 39 2024-09-17T01:56:30.465 INFO:tasks.workunit.client.0.smithi063.stdout:1/901: mknod d0/d1c/db1/c12c 0 2024-09-17T01:56:30.466 INFO:tasks.workunit.client.0.smithi063.stdout:6/760: dwrite dc/d14/d19/d20/d32/d68/fce [0,4194304] 0 2024-09-17T01:56:30.467 INFO:tasks.workunit.client.0.smithi063.stdout:1/902: creat d0/d2d/f12d x:0 0 0 2024-09-17T01:56:30.470 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:30.473+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:30.472 INFO:tasks.workunit.client.0.smithi063.stdout:1/903: unlink d0/d93/d9e/la3 0 2024-09-17T01:56:30.472 INFO:tasks.workunit.client.0.smithi063.stdout:2/714: dread d3/d7/d38/f45 [0,4194304] 0 2024-09-17T01:56:30.474 INFO:tasks.workunit.client.0.smithi063.stdout:2/715: mknod d3/d28/d72/cdd 0 2024-09-17T01:56:30.475 INFO:tasks.workunit.client.0.smithi063.stdout:6/761: dread dc/d14/d19/d20/d32/d68/d9c/fa4 [0,4194304] 0 2024-09-17T01:56:30.476 INFO:tasks.workunit.client.0.smithi063.stdout:2/716: creat d3/d28/d72/dd5/fde x:0 0 0 2024-09-17T01:56:30.476 INFO:tasks.workunit.client.0.smithi063.stdout:8/657: sync 2024-09-17T01:56:30.477 INFO:tasks.workunit.client.0.smithi063.stdout:2/717: readlink d3/d7/d76/l7f 0 2024-09-17T01:56:30.477 INFO:tasks.workunit.client.0.smithi063.stdout:1/904: dread d0/d93/fb9 [0,4194304] 0 2024-09-17T01:56:30.477 INFO:tasks.workunit.client.0.smithi063.stdout:6/762: mkdir dc/d14/d19/d20/d66/def/df5 0 2024-09-17T01:56:30.477 INFO:tasks.workunit.client.0.smithi063.stdout:8/658: symlink d1/d7/d28/d2a/d4d/lc5 0 2024-09-17T01:56:30.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/659: stat d1/c11 0 2024-09-17T01:56:30.479 INFO:tasks.workunit.client.0.smithi063.stdout:1/905: chown d0/d2d/d35/d3f/c72 1 1 2024-09-17T01:56:30.480 INFO:tasks.workunit.client.0.smithi063.stdout:2/718: rename d3/d7/df/c31 to d3/d7/d8d/dc0/cdf 0 2024-09-17T01:56:30.481 INFO:tasks.workunit.client.0.smithi063.stdout:6/763: mknod dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/cf6 0 2024-09-17T01:56:30.481 INFO:tasks.workunit.client.0.smithi063.stdout:2/719: write d3/d2a/f3d [960994,90669] 0 2024-09-17T01:56:30.481 INFO:tasks.workunit.client.0.smithi063.stdout:4/846: dread de/f57 [0,4194304] 0 2024-09-17T01:56:30.481 INFO:tasks.workunit.client.0.smithi063.stdout:6/764: fsync dc/d14/d19/d20/d32/d52/d5a/d62/fc1 0 2024-09-17T01:56:30.482 INFO:tasks.workunit.client.0.smithi063.stdout:8/660: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f67 [662044,46761] 0 2024-09-17T01:56:30.482 INFO:tasks.workunit.client.0.smithi063.stdout:2/720: creat d3/d28/d72/dd5/fe0 x:0 0 0 2024-09-17T01:56:30.482 INFO:tasks.workunit.client.0.smithi063.stdout:6/765: symlink dc/d14/d18/d91/lf7 0 2024-09-17T01:56:30.482 INFO:tasks.workunit.client.0.smithi063.stdout:6/766: readlink dc/d14/d18/le4 0 2024-09-17T01:56:30.483 INFO:tasks.workunit.client.0.smithi063.stdout:7/764: dread d2/f4 [0,4194304] 0 2024-09-17T01:56:30.483 INFO:tasks.workunit.client.0.smithi063.stdout:3/811: dread df/d12/d1e/d5e/f8d [0,4194304] 0 2024-09-17T01:56:30.484 INFO:tasks.workunit.client.0.smithi063.stdout:2/721: rename d3/d7/df/d30/f58 to d3/d7/d76/fe1 0 2024-09-17T01:56:30.484 INFO:tasks.workunit.client.0.smithi063.stdout:6/767: symlink dc/d14/d2f/de7/lf8 0 2024-09-17T01:56:30.484 INFO:tasks.workunit.client.0.smithi063.stdout:7/765: dread - d2/d3/d27/d65/dd2/fef zero size 2024-09-17T01:56:30.484 INFO:tasks.workunit.client.0.smithi063.stdout:6/768: write dc/d14/d19/f1a [485169,116476] 0 2024-09-17T01:56:30.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/906: truncate d0/d93/d9e/dca/fd5 3842952 0 2024-09-17T01:56:30.485 INFO:tasks.workunit.client.0.smithi063.stdout:2/722: write d3/d7/d38/f6c [5470355,31158] 0 2024-09-17T01:56:30.486 INFO:tasks.workunit.client.0.smithi063.stdout:7/766: stat d2/d15/d2f/de7/f87 0 2024-09-17T01:56:30.486 INFO:tasks.workunit.client.0.smithi063.stdout:6/769: write dc/f4e [175291,53501] 0 2024-09-17T01:56:30.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/661: write d1/d27/f4b [1419414,38428] 0 2024-09-17T01:56:30.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/723: symlink d3/d7/d76/le2 0 2024-09-17T01:56:30.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/847: truncate de/d17/d36/d70/fa9 3487952 0 2024-09-17T01:56:30.487 INFO:tasks.workunit.client.0.smithi063.stdout:2/724: write d3/f83 [309155,48344] 0 2024-09-17T01:56:30.488 INFO:tasks.workunit.client.0.smithi063.stdout:7/767: mknod d2/d3/d17/d25/cf3 0 2024-09-17T01:56:30.489 INFO:tasks.workunit.client.0.smithi063.stdout:7/768: truncate d2/d3/fce 547938 0 2024-09-17T01:56:30.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/725: read d3/d2a/f73 [3565673,23073] 0 2024-09-17T01:56:30.489 INFO:tasks.workunit.client.0.smithi063.stdout:6/770: link dc/d14/d19/l3c dc/d14/d19/d20/d66/def/lf9 0 2024-09-17T01:56:30.490 INFO:tasks.workunit.client.0.smithi063.stdout:7/769: mkdir d2/df4 0 2024-09-17T01:56:30.491 INFO:tasks.workunit.client.0.smithi063.stdout:2/726: stat d3/d7/df/d68/c7d 0 2024-09-17T01:56:30.491 INFO:tasks.workunit.client.0.smithi063.stdout:6/771: dread dc/d14/d18/fad [0,4194304] 0 2024-09-17T01:56:30.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/770: fdatasync d2/d3/d67/fc8 0 2024-09-17T01:56:30.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:30.494 INFO:tasks.workunit.client.0.smithi063.stdout:2/727: stat d3/d7/df/l22 0 2024-09-17T01:56:30.494 INFO:tasks.workunit.client.0.smithi063.stdout:1/907: dwrite d0/d2d/d35/d6f/fc0 [0,4194304] 0 2024-09-17T01:56:30.494 INFO:tasks.workunit.client.0.smithi063.stdout:6/772: rename dc/d14/d2f/fe3 to dc/d1b/ffa 0 2024-09-17T01:56:30.495 INFO:tasks.workunit.client.0.smithi063.stdout:2/728: mknod d3/d2a/dac/ce3 0 2024-09-17T01:56:30.496 INFO:tasks.workunit.client.0.smithi063.stdout:4/848: dwrite de/d17/d36/d70/f8f [0,4194304] 0 2024-09-17T01:56:30.496 INFO:tasks.workunit.client.0.smithi063.stdout:1/908: creat d0/d2d/d35/d6f/f12e x:0 0 0 2024-09-17T01:56:30.496 INFO:tasks.workunit.client.0.smithi063.stdout:2/729: readlink d3/d7/d38/l98 0 2024-09-17T01:56:30.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/909: symlink d0/d1c/l12f 0 2024-09-17T01:56:30.502 INFO:tasks.workunit.client.0.smithi063.stdout:2/730: symlink d3/le4 0 2024-09-17T01:56:30.502 INFO:tasks.workunit.client.0.smithi063.stdout:1/910: link d0/d1c/db1/ce6 d0/d1c/db1/c130 0 2024-09-17T01:56:30.502 INFO:tasks.workunit.client.0.smithi063.stdout:2/731: creat d3/d2a/dac/fe5 x:0 0 0 2024-09-17T01:56:30.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/773: creat dc/d14/ffb x:0 0 0 2024-09-17T01:56:30.504 INFO:tasks.workunit.client.0.smithi063.stdout:4/849: dwrite de/d17/d1b/d9b/fcc [0,4194304] 0 2024-09-17T01:56:30.504 INFO:tasks.workunit.client.0.smithi063.stdout:3/812: dread df/d12/d43/d50/d58/fbd [0,4194304] 0 2024-09-17T01:56:30.506 INFO:tasks.workunit.client.0.smithi063.stdout:6/774: mkdir dc/d14/d19/d20/d32/d52/dfc 0 2024-09-17T01:56:30.508 INFO:tasks.workunit.client.0.smithi063.stdout:6/775: creat dc/d14/d19/d20/d32/d68/ffd x:0 0 0 2024-09-17T01:56:30.509 INFO:tasks.workunit.client.0.smithi063.stdout:4/850: read de/d17/d1b/dc7/f96 [2007729,46540] 0 2024-09-17T01:56:30.510 INFO:tasks.workunit.client.0.smithi063.stdout:6/776: write dc/d14/d65/f9a [357158,65997] 0 2024-09-17T01:56:30.511 INFO:tasks.workunit.client.0.smithi063.stdout:1/911: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [0,4194304] 0 2024-09-17T01:56:30.516 INFO:tasks.workunit.client.0.smithi063.stdout:4/851: mknod de/d2d/d3c/dea/c110 0 2024-09-17T01:56:30.516 INFO:tasks.workunit.client.0.smithi063.stdout:1/912: rmdir d0/d1c/d112 0 2024-09-17T01:56:30.516 INFO:tasks.workunit.client.0.smithi063.stdout:3/813: dwrite df/d12/d1e/d5e/f8d [0,4194304] 0 2024-09-17T01:56:30.516 INFO:tasks.workunit.client.0.smithi063.stdout:2/732: dwrite d3/d7/d38/f45 [0,4194304] 0 2024-09-17T01:56:30.517 INFO:tasks.workunit.client.0.smithi063.stdout:6/777: truncate dc/d14/d19/d20/d32/f61 721093 0 2024-09-17T01:56:30.518 INFO:tasks.workunit.client.0.smithi063.stdout:3/814: chown df/d12/d30/db8/fd4 330 1 2024-09-17T01:56:30.521 INFO:tasks.workunit.client.0.smithi063.stdout:1/913: mkdir d0/d2d/d35/d3f/d81/d50/d8b/d131 0 2024-09-17T01:56:30.521 INFO:tasks.workunit.client.0.smithi063.stdout:3/815: unlink df/d12/d43/d50/d58/d97/daa/ceb 0 2024-09-17T01:56:30.521 INFO:tasks.workunit.client.0.smithi063.stdout:3/816: fsync df/d12/d3a/ffe 0 2024-09-17T01:56:30.521 INFO:tasks.workunit.client.0.smithi063.stdout:2/733: unlink d3/d7/df/f1a 0 2024-09-17T01:56:30.521 INFO:tasks.workunit.client.0.smithi063.stdout:1/914: write d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [4649845,103353] 0 2024-09-17T01:56:30.523 INFO:tasks.workunit.client.0.smithi063.stdout:1/915: stat d0/d1c/db1/c12c 0 2024-09-17T01:56:30.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/734: mkdir d3/d28/d72/dd5/de6 0 2024-09-17T01:56:30.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/778: getdents dc/d14/d2f 0 2024-09-17T01:56:30.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/735: mknod d3/ce7 0 2024-09-17T01:56:30.524 INFO:tasks.workunit.client.0.smithi063.stdout:6/779: rename dc/d14/d19/fec to dc/d1b/ffe 0 2024-09-17T01:56:30.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/736: creat d3/d7/d8d/da4/fe8 x:0 0 0 2024-09-17T01:56:30.525 INFO:tasks.workunit.client.0.smithi063.stdout:2/737: chown d3/d7/d8d/dc0/lc2 1 1 2024-09-17T01:56:30.526 INFO:tasks.workunit.client.0.smithi063.stdout:6/780: truncate dc/d14/d19/d20/d32/f54 4488581 0 2024-09-17T01:56:30.526 INFO:tasks.workunit.client.0.smithi063.stdout:2/738: truncate d3/d7/df/d30/fb4 875070 0 2024-09-17T01:56:30.527 INFO:tasks.workunit.client.0.smithi063.stdout:2/739: read - d3/d28/d72/dd5/fe0 zero size 2024-09-17T01:56:30.528 INFO:tasks.workunit.client.0.smithi063.stdout:4/852: dwrite de/d17/d36/dbe/f91 [0,4194304] 0 2024-09-17T01:56:30.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/916: write d0/f8 [3749306,127220] 0 2024-09-17T01:56:30.529 INFO:tasks.workunit.client.0.smithi063.stdout:5/797: sync 2024-09-17T01:56:30.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/853: rmdir de/d17/d36 39 2024-09-17T01:56:30.531 INFO:tasks.workunit.client.0.smithi063.stdout:5/798: mknod d6/d37/cfb 0 2024-09-17T01:56:30.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/917: creat d0/d2d/d35/d3f/d81/d50/d104/f132 x:0 0 0 2024-09-17T01:56:30.532 INFO:tasks.workunit.client.0.smithi063.stdout:6/781: truncate dc/d14/d65/fa5 17825 0 2024-09-17T01:56:30.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/740: dread d3/d2a/fd3 [0,4194304] 0 2024-09-17T01:56:30.537 INFO:tasks.workunit.client.0.smithi063.stdout:2/741: getdents d3/d7/d8d/da4 0 2024-09-17T01:56:30.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/742: chown d3/d7/df/d43/f3b 2095119 1 2024-09-17T01:56:30.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/854: dwrite de/d2d/d3c/ff4 [0,4194304] 0 2024-09-17T01:56:30.541 INFO:tasks.workunit.client.0.smithi063.stdout:2/743: stat d3/d7/df/d30/c88 0 2024-09-17T01:56:30.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/918: dwrite d0/d93/d9e/fe4 [0,4194304] 0 2024-09-17T01:56:30.542 INFO:tasks.workunit.client.0.smithi063.stdout:6/782: dwrite dc/d14/d18/d74/fe0 [0,4194304] 0 2024-09-17T01:56:30.542 INFO:tasks.workunit.client.0.smithi063.stdout:2/744: chown d3/d7/df/d30/c36 2 1 2024-09-17T01:56:30.543 INFO:tasks.workunit.client.0.smithi063.stdout:2/745: dread - d3/d7/df/d43/fd4 zero size 2024-09-17T01:56:30.544 INFO:tasks.workunit.client.0.smithi063.stdout:2/746: mkdir d3/d7/df/d68/de9 0 2024-09-17T01:56:30.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/783: creat dc/d14/d18/fff x:0 0 0 2024-09-17T01:56:30.545 INFO:tasks.workunit.client.0.smithi063.stdout:2/747: chown d3/d7/d8d/lc7 1 1 2024-09-17T01:56:30.546 INFO:tasks.workunit.client.0.smithi063.stdout:6/784: stat dc/d14/c6a 0 2024-09-17T01:56:30.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/919: getdents d0/d2d/d35/d3f/d94 0 2024-09-17T01:56:30.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/748: dread - d3/d7/df/fcb zero size 2024-09-17T01:56:30.547 INFO:tasks.workunit.client.0.smithi063.stdout:1/920: creat d0/d2d/d35/d8c/d97/f133 x:0 0 0 2024-09-17T01:56:30.548 INFO:tasks.workunit.client.0.smithi063.stdout:2/749: chown d3/d7/df/d30/cb9 1647 1 2024-09-17T01:56:30.548 INFO:tasks.workunit.client.0.smithi063.stdout:1/921: fsync d0/d2d/d35/d9d/fb2 0 2024-09-17T01:56:30.549 INFO:tasks.workunit.client.0.smithi063.stdout:2/750: getdents d3/d7/df/d43 0 2024-09-17T01:56:30.551 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:30.553+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:30.551 INFO:tasks.workunit.client.0.smithi063.stdout:2/751: rename d3/f21 to d3/d7/df/d68/fea 0 2024-09-17T01:56:30.553 INFO:tasks.workunit.client.0.smithi063.stdout:6/785: dwrite dc/d14/d19/d20/d32/f87 [0,4194304] 0 2024-09-17T01:56:30.553 INFO:tasks.workunit.client.0.smithi063.stdout:5/799: dread d6/d35/dc1/d29/d36/f5e [0,4194304] 0 2024-09-17T01:56:30.556 INFO:tasks.workunit.client.0.smithi063.stdout:5/800: creat d6/d37/d19/de4/ffc x:0 0 0 2024-09-17T01:56:30.557 INFO:tasks.workunit.client.0.smithi063.stdout:6/786: write dc/d14/d19/d20/d66/fd5 [289543,2884] 0 2024-09-17T01:56:30.557 INFO:tasks.workunit.client.0.smithi063.stdout:1/922: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [4194304,4194304] 0 2024-09-17T01:56:30.558 INFO:tasks.workunit.client.0.smithi063.stdout:5/801: rename d6/d9/c49 to d6/d9/d32/cfd 0 2024-09-17T01:56:30.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/855: dread de/f16 [0,4194304] 0 2024-09-17T01:56:30.560 INFO:tasks.workunit.client.0.smithi063.stdout:6/787: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/d100 0 2024-09-17T01:56:30.560 INFO:tasks.workunit.client.0.smithi063.stdout:5/802: rmdir d6/d35/dc1/d29 39 2024-09-17T01:56:30.561 INFO:tasks.workunit.client.0.smithi063.stdout:5/803: chown d6/d35/dc1/d3a 252 1 2024-09-17T01:56:30.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/788: mknod dc/d14/d19/d20/d32/d52/d5a/c101 0 2024-09-17T01:56:30.562 INFO:tasks.workunit.client.0.smithi063.stdout:5/804: fdatasync d6/d37/d19/d76/d8f/de0/de5/fb7 0 2024-09-17T01:56:30.563 INFO:tasks.workunit.client.0.smithi063.stdout:4/856: link de/d17/d36/dbe/lc3 de/d17/d1b/dc7/l111 0 2024-09-17T01:56:30.564 INFO:tasks.workunit.client.0.smithi063.stdout:4/857: chown de/d17/d1b/dc7/d28/d98/lda 8 1 2024-09-17T01:56:30.565 INFO:tasks.workunit.client.0.smithi063.stdout:1/923: dwrite d0/d2d/d35/d3f/d81/f3e [0,4194304] 0 2024-09-17T01:56:30.565 INFO:tasks.workunit.client.0.smithi063.stdout:5/805: truncate d6/d37/d19/d76/d8f/de0/de5/d31/f80 570465 0 2024-09-17T01:56:30.566 INFO:tasks.workunit.client.0.smithi063.stdout:1/924: read d0/d2d/d5e/dd8/fdd [2053254,79638] 0 2024-09-17T01:56:30.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/925: chown d0/d2d/d35/d3f/d81/d50/d6c/d74/def/f121 3614728 1 2024-09-17T01:56:30.568 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:30.569 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:30.569 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:30.572 INFO:tasks.workunit.client.0.smithi063.stdout:3/817: dread df/fd0 [0,4194304] 0 2024-09-17T01:56:30.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/926: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d74/f95 [8388608,4194304] 0 2024-09-17T01:56:30.575 INFO:tasks.workunit.client.0.smithi063.stdout:1/927: mknod d0/c134 0 2024-09-17T01:56:30.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/928: mknod d0/d2d/d35/d3f/d81/d50/d8b/d131/c135 0 2024-09-17T01:56:30.577 INFO:tasks.workunit.client.0.smithi063.stdout:5/806: truncate d6/d9/d13/f1e 6505630 0 2024-09-17T01:56:30.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/929: readlink d0/d93/l99 0 2024-09-17T01:56:30.579 INFO:tasks.workunit.client.0.smithi063.stdout:3/818: dwrite df/d12/d1e/d39/f7b [0,4194304] 0 2024-09-17T01:56:30.579 INFO:tasks.workunit.client.0.smithi063.stdout:5/807: mknod d6/d35/dc1/d29/da3/dc8/dd3/cfe 0 2024-09-17T01:56:30.581 INFO:tasks.workunit.client.0.smithi063.stdout:5/808: fdatasync d6/d35/dc1/d29/da3/fbf 0 2024-09-17T01:56:30.584 INFO:tasks.workunit.client.0.smithi063.stdout:6/789: dread dc/d1b/d5e/f79 [0,4194304] 0 2024-09-17T01:56:30.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/930: dwrite d0/d2d/d35/d3f/d81/d50/d104/f132 [0,4194304] 0 2024-09-17T01:56:30.588 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:30.588 INFO:tasks.workunit.client.0.smithi063.stdout:5/809: dread d6/d9/d32/f71 [0,4194304] 0 2024-09-17T01:56:30.589 INFO:tasks.workunit.client.0.smithi063.stdout:6/790: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/d102 0 2024-09-17T01:56:30.589 INFO:tasks.workunit.client.0.smithi063.stdout:3/819: dwrite df/d12/d2d/f4a [0,4194304] 0 2024-09-17T01:56:30.589 INFO:tasks.workunit.client.0.smithi063.stdout:5/810: chown d6/d37/d19/d76/d8f/de0/de5/fb7 24 1 2024-09-17T01:56:30.590 INFO:tasks.workunit.client.0.smithi063.stdout:3/820: chown df/d12/d30/l10a 1 1 2024-09-17T01:56:30.590 INFO:tasks.workunit.client.0.smithi063.stdout:6/791: symlink dc/d14/d19/d20/d32/d52/d5a/d97/l103 0 2024-09-17T01:56:30.590 INFO:tasks.workunit.client.0.smithi063.stdout:1/931: rename d0/d2d/d35/d3f/d81/d50/c73 to d0/d2d/d35/d3f/d81/d50/d6c/de8/c136 0 2024-09-17T01:56:30.591 INFO:tasks.workunit.client.0.smithi063.stdout:3/821: fsync df/d12/d1e/d39/f91 0 2024-09-17T01:56:30.591 INFO:tasks.workunit.client.0.smithi063.stdout:1/932: rmdir d0/d2d/d5e/d7e 39 2024-09-17T01:56:30.592 INFO:tasks.workunit.client.0.smithi063.stdout:3/822: readlink df/d12/d43/d50/l5a 0 2024-09-17T01:56:30.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/933: write d0/d2d/d35/d3f/d81/d50/d8b/f8e [2622677,29896] 0 2024-09-17T01:56:30.594 INFO:tasks.workunit.client.0.smithi063.stdout:3/823: chown df/d12/d2d/ddc/f100 31875 1 2024-09-17T01:56:30.595 INFO:tasks.workunit.client.0.smithi063.stdout:1/934: readlink d0/d93/d9e/l115 0 2024-09-17T01:56:30.595 INFO:tasks.workunit.client.0.smithi063.stdout:3/824: fsync df/d12/d43/d50/d58/d97/fe4 0 2024-09-17T01:56:30.595 INFO:tasks.workunit.client.0.smithi063.stdout:1/935: readlink d0/d2d/lda 0 2024-09-17T01:56:30.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/936: write d0/d93/fd6 [171806,3984] 0 2024-09-17T01:56:30.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/937: stat d0/d2d/d35/d3f/d81/d50/d8b/d131 0 2024-09-17T01:56:30.597 INFO:tasks.workunit.client.0.smithi063.stdout:3/825: link df/d12/d3a/f51 df/d12/f114 0 2024-09-17T01:56:30.597 INFO:tasks.workunit.client.0.smithi063.stdout:3/826: write df/d12/d2d/f4a [846352,29696] 0 2024-09-17T01:56:30.597 INFO:tasks.workunit.client.0.smithi063.stdout:1/938: mkdir d0/d2d/d35/d3f/d137 0 2024-09-17T01:56:30.599 INFO:tasks.workunit.client.0.smithi063.stdout:6/792: rmdir dc/d14/d19/d99 0 2024-09-17T01:56:30.599 INFO:tasks.workunit.client.0.smithi063.stdout:3/827: link df/d12/d43/c61 df/d12/d1e/d53/c115 0 2024-09-17T01:56:30.600 INFO:tasks.workunit.client.0.smithi063.stdout:3/828: unlink df/d12/d43/d50/d58/l111 0 2024-09-17T01:56:30.600 INFO:tasks.workunit.client.0.smithi063.stdout:6/793: mkdir dc/d14/d19/d20/d32/d52/d5a/d97/d104 0 2024-09-17T01:56:30.601 INFO:tasks.workunit.client.0.smithi063.stdout:3/829: mkdir df/d12/d3a/df7/d116 0 2024-09-17T01:56:30.602 INFO:tasks.workunit.client.0.smithi063.stdout:6/794: getdents dc/d14/d18/d91 0 2024-09-17T01:56:30.602 INFO:tasks.workunit.client.0.smithi063.stdout:3/830: dread - df/d12/d43/d50/d58/db5/ff1 zero size 2024-09-17T01:56:30.603 INFO:tasks.workunit.client.0.smithi063.stdout:3/831: stat df/d12/d3a/df7/ff8 0 2024-09-17T01:56:30.603 INFO:tasks.workunit.client.0.smithi063.stdout:6/795: truncate dc/d14/d19/d20/f8b 1271126 0 2024-09-17T01:56:30.604 INFO:tasks.workunit.client.0.smithi063.stdout:3/832: creat df/d12/d43/d50/de6/f117 x:0 0 0 2024-09-17T01:56:30.606 INFO:tasks.workunit.client.0.smithi063.stdout:3/833: readlink df/d28/l99 0 2024-09-17T01:56:30.606 INFO:tasks.workunit.client.0.smithi063.stdout:3/834: creat df/d28/f118 x:0 0 0 2024-09-17T01:56:30.606 INFO:tasks.workunit.client.0.smithi063.stdout:3/835: creat df/d83/f119 x:0 0 0 2024-09-17T01:56:30.607 INFO:tasks.workunit.client.0.smithi063.stdout:1/939: dread d0/d2d/d35/d3f/d4e/d66/fe5 [0,4194304] 0 2024-09-17T01:56:30.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/796: truncate dc/d14/d19/d20/d32/d52/d5a/f9b 3913414 0 2024-09-17T01:56:30.610 INFO:tasks.workunit.client.0.smithi063.stdout:3/836: mknod df/d12/d30/c11a 0 2024-09-17T01:56:30.610 INFO:tasks.workunit.client.0.smithi063.stdout:1/940: rename d0/d2d/d35/d3f/d81/d50/d6c/de8/fd1 to d0/d2d/d5e/dc5/f138 0 2024-09-17T01:56:30.611 INFO:tasks.workunit.client.0.smithi063.stdout:3/837: mkdir df/d12/d30/d11b 0 2024-09-17T01:56:30.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/838: readlink df/d12/d2d/l98 0 2024-09-17T01:56:30.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/797: link dc/d14/d18/f94 dc/d14/d19/d20/d32/d68/db4/dc6/de5/f105 0 2024-09-17T01:56:30.613 INFO:tasks.workunit.client.0.smithi063.stdout:3/839: symlink df/d12/d43/d50/d104/l11c 0 2024-09-17T01:56:30.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/798: rmdir dc/d14/d19/d20/d32/d52/d5a/d97/db8 39 2024-09-17T01:56:30.615 INFO:tasks.workunit.client.0.smithi063.stdout:6/799: rename dc/f44 to dc/d14/d65/ddd/f106 0 2024-09-17T01:56:30.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/662: sync 2024-09-17T01:56:30.616 INFO:tasks.workunit.client.0.smithi063.stdout:0/768: sync 2024-09-17T01:56:30.617 INFO:tasks.workunit.client.0.smithi063.stdout:9/757: sync 2024-09-17T01:56:30.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/771: sync 2024-09-17T01:56:30.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/840: rename df/d12/d30/db8/lec to df/d12/d3a/d7a/l11d 0 2024-09-17T01:56:30.617 INFO:tasks.workunit.client.0.smithi063.stdout:8/663: mkdir d1/d7/dc6 0 2024-09-17T01:56:30.618 INFO:tasks.workunit.client.0.smithi063.stdout:1/941: dwrite d0/d2d/d35/d3f/d81/f42 [4194304,4194304] 0 2024-09-17T01:56:30.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/772: symlink d2/d15/d2f/de7/lf5 0 2024-09-17T01:56:30.618 INFO:tasks.workunit.client.0.smithi063.stdout:5/811: dread d6/d37/d19/d50/fc2 [0,4194304] 0 2024-09-17T01:56:30.620 INFO:tasks.workunit.client.0.smithi063.stdout:6/800: rename dc/d14/d19/d20/d32/d52/lcf to dc/d14/d2f/l107 0 2024-09-17T01:56:30.621 INFO:tasks.workunit.client.0.smithi063.stdout:5/812: rmdir d6/d37/d19/d50/d98/da0 39 2024-09-17T01:56:30.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/942: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc/f139 x:0 0 0 2024-09-17T01:56:30.621 INFO:tasks.workunit.client.0.smithi063.stdout:8/664: write d1/d7/d28/d2a/d4d/fae [541631,25665] 0 2024-09-17T01:56:30.621 INFO:tasks.workunit.client.0.smithi063.stdout:9/758: rename d9/de/d20/d1b/db7/cf1 to d9/d8d/d2a/d40/dac/c110 0 2024-09-17T01:56:30.621 INFO:tasks.workunit.client.0.smithi063.stdout:3/841: creat df/d12/d43/d50/d58/d97/daa/db1/dd7/f11e x:0 0 0 2024-09-17T01:56:30.622 INFO:tasks.workunit.client.0.smithi063.stdout:3/842: chown df/d83/fc4 3212 1 2024-09-17T01:56:30.623 INFO:tasks.workunit.client.0.smithi063.stdout:7/773: rename d2/d3 to d2/d15/d2f/d45/d82/df6 0 2024-09-17T01:56:30.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/665: mkdir d1/d27/d81/da4/dc7 0 2024-09-17T01:56:30.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/801: link dc/d14/d65/ddd/f106 dc/d14/d19/d20/f108 0 2024-09-17T01:56:30.625 INFO:tasks.workunit.client.0.smithi063.stdout:3/843: getdents df/d12/d2d 0 2024-09-17T01:56:30.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/774: read d2/d15/d2f/d45/d82/df6/fce [233798,107831] 0 2024-09-17T01:56:30.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/802: dread - dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/fdc zero size 2024-09-17T01:56:30.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/844: mknod df/d12/d43/d50/d58/d97/daa/c11f 0 2024-09-17T01:56:30.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/775: write d2/d15/d2f/de7/f87 [299931,25543] 0 2024-09-17T01:56:30.629 INFO:tasks.workunit.client.0.smithi063.stdout:7/776: mknod d2/d98/dea/cf7 0 2024-09-17T01:56:30.630 INFO:tasks.workunit.client.0.smithi063.stdout:3/845: rmdir df/d12/d43/d50/dfb/dbb 39 2024-09-17T01:56:30.630 INFO:tasks.workunit.client.0.smithi063.stdout:8/666: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/fc8 x:0 0 0 2024-09-17T01:56:30.630 INFO:tasks.workunit.client.0.smithi063.stdout:6/803: link dc/d14/d19/d20/d32/d52/d5a/cb9 dc/d1b/c109 0 2024-09-17T01:56:30.631 INFO:tasks.workunit.client.0.smithi063.stdout:9/759: getdents d9/d8d/d2a/d40/dac 0 2024-09-17T01:56:30.631 INFO:tasks.workunit.client.0.smithi063.stdout:6/804: stat dc/d14/d19/f53 0 2024-09-17T01:56:30.632 INFO:tasks.workunit.client.0.smithi063.stdout:5/813: dwrite d6/d37/d79/ff7 [0,4194304] 0 2024-09-17T01:56:30.634 INFO:tasks.workunit.client.0.smithi063.stdout:1/943: dwrite d0/d1c/db1/f103 [0,4194304] 0 2024-09-17T01:56:30.636 INFO:tasks.workunit.client.0.smithi063.stdout:9/760: truncate d9/de/d20/d37/f8e 4905759 0 2024-09-17T01:56:30.637 INFO:tasks.workunit.client.0.smithi063.stdout:5/814: fdatasync d6/d35/dc1/d29/d36/f7d 0 2024-09-17T01:56:30.638 INFO:tasks.workunit.client.0.smithi063.stdout:6/805: write dc/d14/d19/f53 [1818901,118063] 0 2024-09-17T01:56:30.640 INFO:tasks.workunit.client.0.smithi063.stdout:8/667: dwrite d1/d7/d28/f42 [0,4194304] 0 2024-09-17T01:56:30.641 INFO:tasks.workunit.client.0.smithi063.stdout:9/761: mkdir d9/d8d/d2a/d40/dac/d111 0 2024-09-17T01:56:30.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/846: rename df/d12/d3a/f9e to df/d12/d43/d50/d58/d97/daa/db1/dcc/f120 0 2024-09-17T01:56:30.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/777: truncate d2/d15/d2f/d45/fab 441290 0 2024-09-17T01:56:30.642 INFO:tasks.workunit.client.0.smithi063.stdout:6/806: getdents dc/d14/d19/d20/d32/d52/dfc 0 2024-09-17T01:56:30.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/815: link d6/d37/d19/fcb d6/d35/dc1/d29/d36/de1/df1/fff 0 2024-09-17T01:56:30.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/762: getdents d9/de/d33/df5 0 2024-09-17T01:56:30.646 INFO:tasks.workunit.client.0.smithi063.stdout:7/778: truncate d2/d15/d2f/d45/d82/df6/d27/d65/f6d 2645447 0 2024-09-17T01:56:30.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/752: sync 2024-09-17T01:56:30.648 INFO:tasks.workunit.client.0.smithi063.stdout:4/858: sync 2024-09-17T01:56:30.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/944: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [0,4194304] 0 2024-09-17T01:56:30.650 INFO:tasks.workunit.client.0.smithi063.stdout:2/753: write d3/f4 [846561,66966] 0 2024-09-17T01:56:30.650 INFO:tasks.workunit.client.0.smithi063.stdout:7/779: symlink d2/d15/d2f/d45/d82/df6/d27/d33/d7b/lf8 0 2024-09-17T01:56:30.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/859: symlink de/d17/d36/dbe/l112 0 2024-09-17T01:56:30.651 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:30.653+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:30.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/754: dread - d3/d7/d76/fd1 zero size 2024-09-17T01:56:30.652 INFO:tasks.workunit.client.0.smithi063.stdout:6/807: dread dc/d14/d18/d74/fb1 [0,4194304] 0 2024-09-17T01:56:30.653 INFO:tasks.workunit.client.0.smithi063.stdout:9/763: truncate d9/de/d20/d1b/d25/ff6 1612197 0 2024-09-17T01:56:30.653 INFO:tasks.workunit.client.0.smithi063.stdout:8/668: dwrite d1/d7/d28/d2a/d37/d3a/d85/f93 [0,4194304] 0 2024-09-17T01:56:30.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/816: getdents d6/d35/dc1/d29/da3/dc8/dd3 0 2024-09-17T01:56:30.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/780: mknod d2/d15/d2f/d45/d82/df6/d17/d25/db0/cf9 0 2024-09-17T01:56:30.654 INFO:tasks.workunit.client.0.smithi063.stdout:1/945: chown d0/d93/d9e/f129 31659 1 2024-09-17T01:56:30.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/817: fsync d6/fd 0 2024-09-17T01:56:30.654 INFO:tasks.workunit.client.0.smithi063.stdout:9/764: creat d9/d8d/d2a/f112 x:0 0 0 2024-09-17T01:56:30.655 INFO:tasks.workunit.client.0.smithi063.stdout:2/755: rename d3/f6e to d3/d7/feb 0 2024-09-17T01:56:30.655 INFO:tasks.workunit.client.0.smithi063.stdout:7/781: stat d2/d15/d2f/d45/d82/df6/d27/d65/dd2/cee 0 2024-09-17T01:56:30.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/818: creat d6/d37/d19/d50/f100 x:0 0 0 2024-09-17T01:56:30.658 INFO:tasks.workunit.client.0.smithi063.stdout:2/756: truncate d3/d7/fb8 1456070 0 2024-09-17T01:56:30.659 INFO:tasks.workunit.client.0.smithi063.stdout:6/808: link dc/d14/fc4 dc/d14/d2f/de7/f10a 0 2024-09-17T01:56:30.661 INFO:tasks.workunit.client.0.smithi063.stdout:5/819: unlink d6/d35/dc1/d29/f96 0 2024-09-17T01:56:30.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/757: rename d3/f6 to d3/d7/df/d5a/fec 0 2024-09-17T01:56:30.663 INFO:tasks.workunit.client.0.smithi063.stdout:1/946: dread d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [0,4194304] 0 2024-09-17T01:56:30.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/860: dwrite de/d17/d1b/dc7/f55 [4194304,4194304] 0 2024-09-17T01:56:30.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/809: truncate dc/d14/d19/f3d 192122 0 2024-09-17T01:56:30.664 INFO:tasks.workunit.client.0.smithi063.stdout:8/669: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/fb3 to d1/d7/d28/d2a/d37/d3a/fc9 0 2024-09-17T01:56:30.665 INFO:tasks.workunit.client.0.smithi063.stdout:4/861: unlink de/d17/d36/cbf 0 2024-09-17T01:56:30.666 INFO:tasks.workunit.client.0.smithi063.stdout:2/758: creat d3/d7/d38/da9/fed x:0 0 0 2024-09-17T01:56:30.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/765: dwrite d9/de/d20/d1b/d25/d73/fec [0,4194304] 0 2024-09-17T01:56:30.670 INFO:tasks.workunit.client.0.smithi063.stdout:4/862: truncate de/d17/d1b/dc7/f1d 266329 0 2024-09-17T01:56:30.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/863: mknod de/d2d/d52/d9c/c113 0 2024-09-17T01:56:30.675 INFO:tasks.workunit.client.0.smithi063.stdout:2/759: write d3/d7/fd2 [185356,57042] 0 2024-09-17T01:56:30.675 INFO:tasks.workunit.client.0.smithi063.stdout:9/766: truncate d9/de/d20/d1b/d25/d73/f81 30690 0 2024-09-17T01:56:30.676 INFO:tasks.workunit.client.0.smithi063.stdout:5/820: dwrite d6/f12 [0,4194304] 0 2024-09-17T01:56:30.682 INFO:tasks.workunit.client.0.smithi063.stdout:2/760: symlink d3/d7/df/d43/lee 0 2024-09-17T01:56:30.682 INFO:tasks.workunit.client.0.smithi063.stdout:1/947: dwrite d0/d2d/d35/d3f/d81/f45 [0,4194304] 0 2024-09-17T01:56:30.682 INFO:tasks.workunit.client.0.smithi063.stdout:8/670: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f8b [0,4194304] 0 2024-09-17T01:56:30.683 INFO:tasks.workunit.client.0.smithi063.stdout:5/821: dread - d6/d35/dc1/d29/da3/dc8/fe7 zero size 2024-09-17T01:56:30.684 INFO:tasks.workunit.client.0.smithi063.stdout:6/810: dwrite dc/d14/d65/fa5 [0,4194304] 0 2024-09-17T01:56:30.685 INFO:tasks.workunit.client.0.smithi063.stdout:9/767: mkdir d9/de/d33/df5/d103/d113 0 2024-09-17T01:56:30.685 INFO:tasks.workunit.client.0.smithi063.stdout:6/811: write dc/d14/d19/f53 [911500,7827] 0 2024-09-17T01:56:30.688 INFO:tasks.workunit.client.0.smithi063.stdout:2/761: unlink d3/d7/df/d43/lab 0 2024-09-17T01:56:30.688 INFO:tasks.workunit.client.0.smithi063.stdout:8/671: symlink d1/d7/d28/d2a/d37/d3a/d85/lca 0 2024-09-17T01:56:30.688 INFO:tasks.workunit.client.0.smithi063.stdout:8/672: readlink d1/d7/d28/d2a/d37/d3a/l90 0 2024-09-17T01:56:30.688 INFO:tasks.workunit.client.0.smithi063.stdout:5/822: symlink d6/d37/d19/d76/d8f/de0/de5/d4f/l101 0 2024-09-17T01:56:30.689 INFO:tasks.workunit.client.0.smithi063.stdout:2/762: rmdir d3/d7/d76 39 2024-09-17T01:56:30.689 INFO:tasks.workunit.client.0.smithi063.stdout:4/864: link de/d17/d36/dbe/d9a/cd4 de/d17/d1b/dc7/d28/d30/c114 0 2024-09-17T01:56:30.689 INFO:tasks.workunit.client.0.smithi063.stdout:1/948: mknod d0/d2d/d5e/d7e/c13a 0 2024-09-17T01:56:30.690 INFO:tasks.workunit.client.0.smithi063.stdout:2/763: unlink d3/d2a/f54 0 2024-09-17T01:56:30.690 INFO:tasks.workunit.client.0.smithi063.stdout:8/673: getdents d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49 0 2024-09-17T01:56:30.692 INFO:tasks.workunit.client.0.smithi063.stdout:3/847: sync 2024-09-17T01:56:30.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/769: sync 2024-09-17T01:56:30.692 INFO:tasks.workunit.client.0.smithi063.stdout:8/674: dread - d1/d7/d28/d2a/d37/d3a/d75/fc1 zero size 2024-09-17T01:56:30.692 INFO:tasks.workunit.client.0.smithi063.stdout:5/823: write d6/d35/dc1/d29/da3/fdc [89303,42865] 0 2024-09-17T01:56:30.692 INFO:tasks.workunit.client.0.smithi063.stdout:6/812: dread dc/d14/d19/d20/d32/d52/d5a/d43/f6d [0,4194304] 0 2024-09-17T01:56:30.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/770: fdatasync d1/d3/db/d6e/d86/dcc/d7c/db6/fdf 0 2024-09-17T01:56:30.695 INFO:tasks.workunit.client.0.smithi063.stdout:6/813: unlink dc/d14/d18/d91/lf7 0 2024-09-17T01:56:30.696 INFO:tasks.workunit.client.0.smithi063.stdout:1/949: rename d0/d2d/d35/d3f/d81/d50/c62 to d0/d2d/d35/d3f/d81/d50/d6c/c13b 0 2024-09-17T01:56:30.696 INFO:tasks.workunit.client.0.smithi063.stdout:5/824: mknod d6/d37/d19/d76/d8f/de0/c102 0 2024-09-17T01:56:30.697 INFO:tasks.workunit.client.0.smithi063.stdout:8/675: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/l8c 48172 1 2024-09-17T01:56:30.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/848: rename df/d12/d30/d8a/fb2 to df/d12/d30/d11b/f121 0 2024-09-17T01:56:30.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/768: dwrite d9/de/f2f [4194304,4194304] 0 2024-09-17T01:56:30.699 INFO:tasks.workunit.client.0.smithi063.stdout:4/865: dwrite de/d17/d1b/f83 [0,4194304] 0 2024-09-17T01:56:30.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/849: truncate df/d12/d30/d8a/d9d/f113 230960 0 2024-09-17T01:56:30.703 INFO:tasks.workunit.client.0.smithi063.stdout:1/950: mkdir d0/d2d/d35/d3f/d94/d13c 0 2024-09-17T01:56:30.703 INFO:tasks.workunit.client.0.smithi063.stdout:9/769: mknod d9/de/d20/d1b/db7/c114 0 2024-09-17T01:56:30.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/850: creat df/d12/d43/d50/de6/f122 x:0 0 0 2024-09-17T01:56:30.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/814: getdents dc/d14/d65/ddd 0 2024-09-17T01:56:30.704 INFO:tasks.workunit.client.0.smithi063.stdout:0/771: truncate d1/d1d/f2d 787728 0 2024-09-17T01:56:30.705 INFO:tasks.workunit.client.0.smithi063.stdout:5/825: getdents d6/d9 0 2024-09-17T01:56:30.706 INFO:tasks.workunit.client.0.smithi063.stdout:9/770: mknod d9/de/d20/d32/c115 0 2024-09-17T01:56:30.706 INFO:tasks.workunit.client.0.smithi063.stdout:0/772: chown d1/d3/db/d18/d85 3 1 2024-09-17T01:56:30.706 INFO:tasks.workunit.client.0.smithi063.stdout:1/951: creat d0/d2d/d35/d3f/d81/d50/d8b/f13d x:0 0 0 2024-09-17T01:56:30.706 INFO:tasks.workunit.client.0.smithi063.stdout:7/782: dread d2/d15/f59 [0,4194304] 0 2024-09-17T01:56:30.707 INFO:tasks.workunit.client.0.smithi063.stdout:2/764: dread d3/d7/fb8 [0,4194304] 0 2024-09-17T01:56:30.707 INFO:tasks.workunit.client.0.smithi063.stdout:7/783: stat d2/d15/d2f/d45/d82/df6/d22/d3a/f70 0 2024-09-17T01:56:30.708 INFO:tasks.workunit.client.0.smithi063.stdout:0/773: read d1/d1d/d6d/f94 [2492346,69853] 0 2024-09-17T01:56:30.708 INFO:tasks.workunit.client.0.smithi063.stdout:1/952: mkdir d0/d93/dc4/dff/d13e 0 2024-09-17T01:56:30.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/826: getdents d6/d37/d19/d76/d8f/de0/de5/d31 0 2024-09-17T01:56:30.710 INFO:tasks.workunit.client.0.smithi063.stdout:9/771: creat d9/d8d/ddf/d10a/f116 x:0 0 0 2024-09-17T01:56:30.712 INFO:tasks.workunit.client.0.smithi063.stdout:1/953: rename d0/d1c/l12f to d0/d2d/d5e/dc5/l13f 0 2024-09-17T01:56:30.712 INFO:tasks.workunit.client.0.smithi063.stdout:4/866: dread de/d17/d36/d70/f72 [0,4194304] 0 2024-09-17T01:56:30.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/815: dwrite dc/d14/d19/d20/d32/d52/d5a/f26 [0,4194304] 0 2024-09-17T01:56:30.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/827: symlink d6/d9/d32/d8c/da7/l103 0 2024-09-17T01:56:30.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/784: dwrite d2/d15/d2f/d45/d82/df6/d27/d39/d40/f6a [0,4194304] 0 2024-09-17T01:56:30.721 INFO:tasks.workunit.client.0.smithi063.stdout:0/774: dread d1/f3d [0,4194304] 0 2024-09-17T01:56:30.721 INFO:tasks.workunit.client.0.smithi063.stdout:8/676: dread d1/f10 [0,4194304] 0 2024-09-17T01:56:30.722 INFO:tasks.workunit.client.0.smithi063.stdout:0/775: write d1/d3/db/d4b/fbb [402878,25808] 0 2024-09-17T01:56:30.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/816: write dc/d1b/f41 [675660,42070] 0 2024-09-17T01:56:30.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/776: symlink d1/d1d/d74/d9a/lfd 0 2024-09-17T01:56:30.724 INFO:tasks.workunit.client.0.smithi063.stdout:9/772: link d9/de/d20/d1b/d25/d73/f7c d9/de/d33/f117 0 2024-09-17T01:56:30.724 INFO:tasks.workunit.client.0.smithi063.stdout:1/954: creat d0/d2d/d5e/d7e/f140 x:0 0 0 2024-09-17T01:56:30.724 INFO:tasks.workunit.client.0.smithi063.stdout:1/955: chown d0/d1c/l36 379803540 1 2024-09-17T01:56:30.725 INFO:tasks.workunit.client.0.smithi063.stdout:5/828: creat d6/d9/d32/d8c/da7/da9/df3/f104 x:0 0 0 2024-09-17T01:56:30.725 INFO:tasks.workunit.client.0.smithi063.stdout:8/677: symlink d1/d7/d28/d2a/lcb 0 2024-09-17T01:56:30.726 INFO:tasks.workunit.client.0.smithi063.stdout:1/956: creat d0/d2d/d35/d3f/d81/d50/d6c/de8/f141 x:0 0 0 2024-09-17T01:56:30.728 INFO:tasks.workunit.client.0.smithi063.stdout:6/817: unlink dc/d14/d19/d20/d32/f61 0 2024-09-17T01:56:30.728 INFO:tasks.workunit.client.0.smithi063.stdout:0/777: mknod d1/d3/dc6/cfe 0 2024-09-17T01:56:30.729 INFO:tasks.workunit.client.0.smithi063.stdout:4/867: creat de/d17/d36/dbe/da6/f115 x:0 0 0 2024-09-17T01:56:30.729 INFO:tasks.workunit.client.0.smithi063.stdout:0/778: readlink d1/d3/db/d4b/de0/lee 0 2024-09-17T01:56:30.730 INFO:tasks.workunit.client.0.smithi063.stdout:0/779: stat d1/f3d 0 2024-09-17T01:56:30.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/678: symlink d1/d7/d28/d2a/d37/d3a/lcc 0 2024-09-17T01:56:30.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/818: chown dc/d1b/cca 3825309 1 2024-09-17T01:56:30.733 INFO:tasks.workunit.client.0.smithi063.stdout:7/785: creat d2/d15/d2f/d45/d82/df6/ffa x:0 0 0 2024-09-17T01:56:30.735 INFO:tasks.workunit.client.0.smithi063.stdout:5/829: dwrite d6/d35/dc1/d29/d36/fb6 [0,4194304] 0 2024-09-17T01:56:30.739 INFO:tasks.workunit.client.0.smithi063.stdout:9/773: dwrite d9/de/d20/d1b/d25/ff6 [0,4194304] 0 2024-09-17T01:56:30.741 INFO:tasks.workunit.client.0.smithi063.stdout:7/786: unlink d2/d15/d2f/d45/d82/df6/d17/c21 0 2024-09-17T01:56:30.742 INFO:tasks.workunit.client.0.smithi063.stdout:1/957: dwrite d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [0,4194304] 0 2024-09-17T01:56:30.743 INFO:tasks.workunit.client.0.smithi063.stdout:9/774: mkdir d9/d8d/d2a/d40/dac/dc2/d118 0 2024-09-17T01:56:30.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/830: mknod d6/d37/d19/d50/d98/da0/c105 0 2024-09-17T01:56:30.744 INFO:tasks.workunit.client.0.smithi063.stdout:5/831: fsync d6/fd 0 2024-09-17T01:56:30.744 INFO:tasks.workunit.client.0.smithi063.stdout:8/679: rename d1/d7/d28/d2a/d4d/f6b to d1/d7/d28/d2a/d37/fcd 0 2024-09-17T01:56:30.747 INFO:tasks.workunit.client.0.smithi063.stdout:8/680: symlink d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/lce 0 2024-09-17T01:56:30.749 INFO:tasks.workunit.client.0.smithi063.stdout:7/787: dread d2/d15/d2f/de7/f87 [0,4194304] 0 2024-09-17T01:56:30.749 INFO:tasks.workunit.client.0.smithi063.stdout:5/832: write d6/d9/d13/d1d/f21 [765821,14909] 0 2024-09-17T01:56:30.749 INFO:tasks.workunit.client.0.smithi063.stdout:2/765: dread d3/d2a/fa0 [0,4194304] 0 2024-09-17T01:56:30.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/681: write d1/d7/d28/d2a/d37/d3a/fc9 [1890231,52971] 0 2024-09-17T01:56:30.752 INFO:tasks.workunit.client.0.smithi063.stdout:4/868: dread de/d2d/fdb [0,4194304] 0 2024-09-17T01:56:30.752 INFO:tasks.workunit.client.0.smithi063.stdout:1/958: dwrite d0/d93/fb9 [0,4194304] 0 2024-09-17T01:56:30.752 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:30.753 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:30.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/788: symlink d2/d15/d2f/d45/d82/df6/d67/lfb 0 2024-09-17T01:56:30.753 INFO:tasks.workunit.client.0.smithi063.stdout:2/766: truncate d3/d7/df/d30/fb4 1349546 0 2024-09-17T01:56:30.753 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:30.753+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:30.754 INFO:tasks.workunit.client.0.smithi063.stdout:9/775: dwrite d9/de/d20/d37/d42/d7f/f83 [4194304,4194304] 0 2024-09-17T01:56:30.754 INFO:tasks.workunit.client.0.smithi063.stdout:8/682: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/c6a 14 1 2024-09-17T01:56:30.757 INFO:tasks.workunit.client.0.smithi063.stdout:8/683: unlink d1/f5e 0 2024-09-17T01:56:30.760 INFO:tasks.workunit.client.0.smithi063.stdout:5/833: dwrite d6/d37/d19/d68/fbe [0,4194304] 0 2024-09-17T01:56:30.760 INFO:tasks.workunit.client.0.smithi063.stdout:1/959: mkdir d0/d2d/d35/d3f/d81/d50/d6c/d142 0 2024-09-17T01:56:30.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/684: creat d1/d7/fcf x:0 0 0 2024-09-17T01:56:30.761 INFO:tasks.workunit.client.0.smithi063.stdout:5/834: dread - d6/d37/d19/de4/ffc zero size 2024-09-17T01:56:30.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/960: chown d0/d2d/d35/d9d/l120 1 1 2024-09-17T01:56:30.762 INFO:tasks.workunit.client.0.smithi063.stdout:2/767: dwrite d3/d7/df/d68/f59 [0,4194304] 0 2024-09-17T01:56:30.766 INFO:tasks.workunit.client.0.smithi063.stdout:4/869: dwrite de/d2d/d3c/f99 [0,4194304] 0 2024-09-17T01:56:30.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/768: symlink d3/d7/df/d68/lef 0 2024-09-17T01:56:30.766 INFO:tasks.workunit.client.0.smithi063.stdout:8/685: chown d1/d7/d28/d2a/d37/d3a/daf/cb4 1663844 1 2024-09-17T01:56:30.767 INFO:tasks.workunit.client.0.smithi063.stdout:1/961: stat d0/d2d/d35/d3f/c87 0 2024-09-17T01:56:30.767 INFO:tasks.workunit.client.0.smithi063.stdout:5/835: mknod d6/d35/dc1/d29/d36/de1/df1/c106 0 2024-09-17T01:56:30.767 INFO:tasks.workunit.client.0.smithi063.stdout:1/962: chown d0/d2d/d5e 0 1 2024-09-17T01:56:30.767 INFO:tasks.workunit.client.0.smithi063.stdout:8/686: write d1/d7/d28/f50 [4915710,65171] 0 2024-09-17T01:56:30.767 INFO:tasks.workunit.client.0.smithi063.stdout:5/836: stat d6/d35/dc1/d54/cec 0 2024-09-17T01:56:30.768 INFO:tasks.workunit.client.0.smithi063.stdout:1/963: write d0/d2d/d35/d3f/d4e/d66/f69 [4917814,62703] 0 2024-09-17T01:56:30.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/837: creat d6/d9/d32/d8c/da7/da9/df3/f107 x:0 0 0 2024-09-17T01:56:30.769 INFO:tasks.workunit.client.0.smithi063.stdout:1/964: creat d0/d2d/d35/d3f/d81/d50/d6c/d74/f143 x:0 0 0 2024-09-17T01:56:30.769 INFO:tasks.workunit.client.0.smithi063.stdout:8/687: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/lce to d1/d7/d1d/d9c/ld0 0 2024-09-17T01:56:30.770 INFO:tasks.workunit.client.0.smithi063.stdout:5/838: rmdir d6/d35/dc1/d3f/da6 0 2024-09-17T01:56:30.773 INFO:tasks.workunit.client.0.smithi063.stdout:9/776: read d9/de/d20/d1b/d25/d73/f81 [21973,8278] 0 2024-09-17T01:56:30.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/965: dread d0/d2d/d35/d3f/d81/d50/d6c/d90/fd7 [0,4194304] 0 2024-09-17T01:56:30.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/777: symlink d9/d8d/ddf/d10a/l119 0 2024-09-17T01:56:30.776 INFO:tasks.workunit.client.0.smithi063.stdout:1/966: creat d0/d93/dc4/f144 x:0 0 0 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.403027582, 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:30.777 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:30.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:30.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.205031501000001, 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:30.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.204148247999999, 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.790 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:30.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:30.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.202148728999999, 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:30.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:30.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.201092019000001, 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.802 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:30.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:30.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.808 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.198013687, 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:30.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.814 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.19610817, 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:30.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:30.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.193874472999999, 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:30.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:30.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.192938336999999, 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.827 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:30.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.170985839, 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:30.833 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:30.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:30.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.167939831, 2024-09-17T01:56:30.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:30.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:30.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:30.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.162747424000001, 2024-09-17T01:56:30.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:30.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.851 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.15738788, 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:30.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:30.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.152915305000001, 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.858 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:30.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:30.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.141403095999999, 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:30.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:30.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.870 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.133451905999999, 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:30.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.129133455, 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:30.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:30.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:30.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.124393209000001, 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.883 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:30.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.121911520999999, 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.889 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:30.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.120916297999999, 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:30.895 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:30.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:30.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:30.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:30.901 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:30.903 INFO:tasks.workunit.client.0.smithi063.stdout:8/688: dwrite d1/d7/d1d/f77 [0,4194304] 0 2024-09-17T01:56:30.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/839: dwrite d6/d37/d19/d50/f100 [0,4194304] 0 2024-09-17T01:56:30.903 INFO:tasks.workunit.client.0.smithi063.stdout:1/967: mkdir d0/d2d/d35/d3f/d81/d50/d8b/d131/d145 0 2024-09-17T01:56:30.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/840: mknod d6/d37/d19/d76/d8f/de0/de5/da4/c108 0 2024-09-17T01:56:30.903 INFO:tasks.workunit.client.0.smithi063.stdout:8/689: creat d1/d7/d28/d2a/fd1 x:0 0 0 2024-09-17T01:56:30.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/968: creat d0/d2d/d5e/f146 x:0 0 0 2024-09-17T01:56:30.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/778: dwrite d9/de/d20/d37/d42/d7f/f92 [0,4194304] 0 2024-09-17T01:56:30.904 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:30.905 INFO:tasks.workunit.client.0.smithi063.stdout:4/870: write de/d2d/d3c/f4b [466006,44199] 0 2024-09-17T01:56:30.905 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:30.905 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:30.905 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:30.906 INFO:tasks.workunit.client.0.smithi063.stdout:9/779: chown d9/de/d20/d1b/db7/fb9 395178482 1 2024-09-17T01:56:30.906 INFO:tasks.workunit.client.0.smithi063.stdout:4/871: creat de/d17/d1b/dc7/d28/d30/f116 x:0 0 0 2024-09-17T01:56:30.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/841: dwrite d6/d35/f57 [0,4194304] 0 2024-09-17T01:56:30.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/872: chown de/d2d/d3c/f87 66151 1 2024-09-17T01:56:30.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/842: stat d6/d35/dc1/d54/lf0 0 2024-09-17T01:56:30.907 INFO:tasks.workunit.client.0.smithi063.stdout:8/690: dwrite d1/d7/d1d/f7f [0,4194304] 0 2024-09-17T01:56:30.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/873: write de/d2d/f43 [925198,103434] 0 2024-09-17T01:56:30.907 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:30.908 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:30.910 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:30.905+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/874: rmdir de/d17/d1b/dc7/d28/d98 39 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:8/691: rename d1/d7/d28/d2a/d37/cbc to d1/d27/d82/cd2 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:5/843: link d6/d37/d19/d76/d8f/lb4 d6/d37/d19/d76/l109 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/875: chown de/d17/d36/dbe/dbc/cd1 188699400 1 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:8/692: mknod d1/d7/d1d/db7/cd3 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/876: fdatasync de/d17/d1b/d9e/f107 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/877: getdents de/d17/d36/dbe/da6/d10d 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:3/851: sync 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:5/844: truncate d6/d9/d32/d8c/da7/da9/fab 23847 0 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/878: chown de/d17/d1b/dc7/d28/d30/l48 26705726 1 2024-09-17T01:56:30.924 INFO:tasks.workunit.client.0.smithi063.stdout:5/845: mknod d6/d9/c10a 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/852: rename df/d12/d30/f101 to df/d12/d30/d8a/d9d/f123 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/846: stat d6/d35/dc1/fb5 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/853: mkdir df/d12/d43/d50/d58/d97/daa/db1/dcc/d124 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/879: link de/f14 de/d17/dc6/f117 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:8/693: dwrite d1/d7/d28/d2a/d37/d3a/fc9 [0,4194304] 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:9/780: dread d9/de/d20/d37/d42/f6b [0,4194304] 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/847: getdents d6/d35 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/880: mkdir de/d118 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/854: mknod df/d12/d43/d50/d58/d97/daa/db1/dcc/c125 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/881: fsync de/f57 0 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:3/855: dread - df/d83/f119 zero size 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/882: rmdir de 39 2024-09-17T01:56:30.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/883: rename de/d17/l20 to de/d17/d1b/dc7/d28/d30/l119 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/848: symlink d6/d9/d32/d8c/l10b 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/856: dwrite df/d12/d43/d50/d58/d97/daa/fe9 [0,4194304] 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/789: dread d2/d15/d2f/d45/d48/fbc [0,4194304] 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/857: mknod df/d12/d2d/c126 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/884: dwrite de/d17/d1b/dc7/d28/d8d/fb0 [0,4194304] 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/885: fdatasync de/f38 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/769: dread d3/d7/df/f18 [0,4194304] 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/849: dwrite d6/d37/d19/de4/ff8 [0,4194304] 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/858: mknod df/d12/d43/d50/d58/d97/daa/db1/c127 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/770: unlink d3/fa2 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/790: mknod d2/d15/d2f/d45/d82/df6/d17/cfc 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/850: mkdir d6/d35/dc1/d29/d36/d10c 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:3/859: getdents df/d12/d43/d50/d104 0 2024-09-17T01:56:30.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/771: rename d3/d7/df/d43/lee to d3/d28/lf0 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/851: symlink d6/d37/d19/d76/d8f/de0/de5/d4f/l10d 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/852: creat d6/d9/d13/f10e x:0 0 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/853: mkdir d6/d37/d19/d76/d8f/de0/d10f 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:8/694: dread d1/f16 [0,4194304] 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/791: dwrite d2/d15/d2f/d45/d82/df6/d27/d65/f6d [0,4194304] 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/854: link d6/d35/dc1/d54/lf0 d6/d37/d19/d76/d8f/de0/de5/d4f/ddd/l110 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/772: dwrite d3/d7/feb [0,4194304] 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:1/969: dread d0/d2d/d35/d3f/d81/d50/d6c/de8/f80 [0,4194304] 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/773: link d3/d7/df/fcb d3/d2a/dac/ff1 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:1/970: symlink d0/d2d/d35/d3f/d81/d50/d6c/d74/def/l147 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/792: creat d2/d15/d2f/d45/d82/df6/d17/ffd x:0 0 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:1/971: mkdir d0/d2d/d5e/dc5/d148 0 2024-09-17T01:56:30.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/774: read - d3/d28/f5c zero size 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/793: creat d2/d15/d2f/d3e/d73/dcd/ffe x:0 0 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/775: mknod d3/d7/df/d30/cf2 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/781: dread d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:1/972: readlink d0/d2d/d35/d3f/d81/l77 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/776: write d3/d7/d38/f65 [1550472,92175] 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/782: dread - d9/de/d20/d1b/d25/fd9 zero size 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/794: rename d2/d15/d2f/d45/d82/df6/d27/d39/deb/fe1 to d2/d15/d2f/d45/d82/df6/d22/d3a/fff 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:1/973: creat d0/d2d/d35/d3f/d94/da6/f149 x:0 0 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/783: fdatasync d9/f6a 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/795: symlink d2/d15/d2f/d3e/l100 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:1/974: write d0/d1c/f5c [96205,13638] 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/784: creat d9/dbf/f11a x:0 0 0 2024-09-17T01:56:30.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/855: dwrite d6/d35/dc1/d3a/f4c [0,4194304] 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:7/796: dread - d2/d15/d2f/d45/d82/df6/fb8 zero size 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:7/797: chown d2/d15/d2f/d52/fcb 37264 1 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:1/975: creat d0/d2d/d5e/d7e/dd2/f14a x:0 0 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/856: symlink d6/l111 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/785: truncate d9/de/d20/d1b/d25/fd9 47026 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/857: mkdir d6/d37/d19/d50/d98/d112 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:1/976: read d0/f1a [1993296,63056] 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/786: write d9/de/d20/d32/fd1 [2268884,27584] 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:1/977: symlink d0/d93/d9e/l14b 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/787: fsync d9/d8d/d2a/d40/fea 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/858: mkdir d6/d37/d19/d50/d98/d113 0 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/788: chown d9/f5b 0 1 2024-09-17T01:56:30.929 INFO:tasks.workunit.client.0.smithi063.stdout:1/978: mknod d0/d2d/d5e/d7e/dd2/c14c 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/859: dread - d6/d35/dc1/fd2 zero size 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/789: dread - d9/de/dcf/fd2 zero size 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:1/979: creat d0/d1c/f14d x:0 0 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/790: truncate d9/d8d/d2a/d40/f71 1550751 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/798: dread d2/d15/d2f/d45/d82/df6/d22/d3a/f88 [0,4194304] 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/791: creat d9/de/d20/f11b x:0 0 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/792: write d9/d8d/d2a/f112 [1038245,68091] 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/793: fsync d9/de/d33/ff0 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/860: dwrite d6/d35/dc1/fb5 [0,4194304] 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/799: rename d2/d15/d2f/d45/d82/df6/d22/d3a/c99 to d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/da6/c101 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:1/980: dwrite d0/d2d/d35/d3f/d4e/f6a [0,4194304] 0 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/800: dread - d2/d15/d2f/d45/d82/df6/d27/fe8 zero size 2024-09-17T01:56:30.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/794: write d9/f5b [675868,11408] 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:1/981: creat d0/d2d/d35/d9d/de2/f14e x:0 0 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/801: fsync d2/d15/d2f/d45/d82/df6/d17/d25/f1b 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:8/695: dread d1/f70 [0,4194304] 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:1/982: creat d0/d2d/d35/d3f/d4e/f14f x:0 0 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:5/861: dread d6/d37/d19/d68/fbe [0,4194304] 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:1/983: write d0/d2d/d35/d3f/d81/d50/d6c/de8/f141 [271761,118756] 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/802: dread d2/d15/d2f/d45/d82/df6/d67/f75 [4194304,4194304] 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:9/795: dread d9/de/d20/d1b/d25/ff6 [0,4194304] 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:5/862: mknod d6/d9/d13/d1d/c114 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/803: creat d2/d98/dea/f102 x:0 0 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:9/796: creat d9/d8d/d2a/d40/dac/f11c x:0 0 0 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:9/797: chown d9/de/d20/d37/d42 87150069 1 2024-09-17T01:56:30.931 INFO:tasks.workunit.client.0.smithi063.stdout:8/696: dwrite d1/d7/d1d/f7f [0,4194304] 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:9/798: fdatasync d9/d8d/d2a/d40/dac/ff8 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:5/863: read d6/d37/d19/d76/d8f/de0/de5/d31/f33 [155025,46084] 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:9/799: unlink d9/d27/dff/f104 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:9/800: mknod d9/de/d20/d1b/d25/d73/c11d 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:5/864: rename d6/d35/dc1/d29/d36/de1/df1/c106 to d6/d35/dc1/d29/d36/de1/df1/c115 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:9/801: write d9/d8d/d2a/f112 [1465158,106521] 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:1/984: dwrite d0/d1c/f28 [0,4194304] 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:9/802: mknod d9/d8d/d2a/d40/dac/c11e 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:1/985: chown d0/d1c/ldb 50 1 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/804: truncate d2/d15/d2f/f3d 305286 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:1/986: creat d0/d2d/d35/d3f/d81/d50/d8b/db3/f150 x:0 0 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:1/987: symlink d0/d2d/d35/d3f/d81/d50/d6c/de8/l151 0 2024-09-17T01:56:30.932 INFO:tasks.workunit.client.0.smithi063.stdout:5/865: dwrite d6/d37/d79/ff7 [0,4194304] 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:7/805: truncate d2/d15/d2f/d45/d82/df6/d27/d39/f3c 3813006 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:9/803: dwrite d9/d8d/d2a/d40/dac/ff8 [0,4194304] 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:1/988: getdents d0/d2d 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:1/989: fdatasync d0/f8 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/866: rename d6/d35/dc1/d29/da3 to d6/d37/d19/d76/d8f/de0/de5/d4f/d116 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:7/806: creat d2/d15/d2f/d45/d82/df6/d67/d8d/dd4/f103 x:0 0 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:1/990: symlink d0/d93/dc4/dff/d13e/l152 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:1/991: chown d0/d2d/d35/d3f/d81/d50/d6c/d74/l9b 29 1 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/867: rename d6/d37/d79 to d6/d37/d19/d76/d8f/de0/d117 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/868: symlink d6/d37/d19/d76/d8f/de0/de5/da4/l118 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:7/807: read d2/d15/d2f/dd3/fdc [1991471,28346] 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:7/808: mknod d2/d15/d2f/d45/d82/df6/d67/d8d/dd4/c104 0 2024-09-17T01:56:30.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/869: truncate d6/f44 686448 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:7/809: dread - d2/d15/d2f/d45/d82/fe5 zero size 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:7/810: stat d2/d15/d2f/d45/d82/df6/d27/f2d 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/870: symlink d6/d37/d19/d76/d8f/de0/de5/d4f/d116/dc8/dd3/l119 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/871: chown d6/d9/d32/d8c/da7/da9/fab 3 1 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/872: creat d6/d35/dc1/d29/d36/f11a x:0 0 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/697: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f33 [4194304,4194304] 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:1/992: dread d0/d2d/d35/d3f/d81/d50/d6c/d74/dd4/ddc/f107 [0,4194304] 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/698: rename d1/d7/d28/d2a/d37/f7a to d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/fd4 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:1/993: creat d0/d2d/d35/d3f/d81/d50/d104/f153 x:0 0 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/873: dwrite d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/699: creat d1/d7/d28/d2a/d37/d3a/d85/fd5 x:0 0 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:1/994: rmdir d0/d2d/d35/d8c 39 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/700: creat d1/d7/d28/d2a/d44/fd6 x:0 0 0 2024-09-17T01:56:30.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/819: sync 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/780: sync 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/995: symlink d0/d2d/d5e/dd8/l154 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/781: dread - d1/d3/db/d18/d33/d83/fec zero size 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/804: dread d9/de/d20/d1b/d25/d73/f7c [0,4194304] 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/996: mknod d0/d1c/db1/dde/c155 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/782: fsync d1/d3/d10/f5a 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/805: write d9/de/d33/df5/ffe [360178,36548] 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/997: creat d0/d2d/d5e/dc5/d148/f156 x:0 0 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/783: unlink d1/d1f/f64 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:9/806: write d9/fc8 [65057,65876] 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/784: symlink d1/d3/db/d6e/d86/lff 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/998: rename d0/d2d/d35/d6f/ldf to d0/d2d/d35/d3f/d81/d50/d6c/de8/l157 0 2024-09-17T01:56:30.935 INFO:tasks.workunit.client.0.smithi063.stdout:5/874: truncate d6/d35/dc1/f9e 1652965 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/785: unlink d1/d3/db/d6e/d86/lf2 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/875: mknod d6/d9/d32/d8c/da7/da9/df3/c11b 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/701: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f3b [0,4194304] 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/786: mkdir d1/d3/db/d6e/d86/dcc/d53/d62/dcd/d100 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/876: fdatasync d6/d37/d19/d68/fbe 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/702: readlink d1/d7/d28/d2a/d37/d3a/l8a 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/787: mkdir d1/d1d/d101 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/811: dread d2/f4 [0,4194304] 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/703: write d1/d7/d28/d2a/d37/d3a/d85/f93 [2257291,44872] 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/877: rename d6/d37/d19/d76/lda to d6/d35/dc1/d3f/dac/l11c 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/788: getdents d1/d1f 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/999: dread d0/d93/d9e/dca/fee [0,4194304] 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/812: mkdir d2/d15/d2f/d45/d82/df6/d17/d25/db0/d105 0 2024-09-17T01:56:30.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/878: symlink d6/d9/d32/d8c/da7/da9/df3/l11d 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/813: rename d2/d15/d2f/d45/d82/lb4 to d2/d15/d2f/l106 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/814: dread - d2/d15/d2f/d45/d82/df6/ffa zero size 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/815: getdents d2/df4 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:0/789: dwrite d1/d1d/f3b [4194304,4194304] 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:8/704: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f3b [4194304,4194304] 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/816: creat d2/d15/d2f/d45/d82/df6/d27/d39/d40/f107 x:0 0 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:0/790: mknod d1/d1d/c102 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:7/817: stat d2/d15/d2f/d45/d82/df6/d27/c44 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/820: dread dc/d14/d19/d20/d32/d52/d5a/f9b [0,4194304] 0 2024-09-17T01:56:30.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/821: chown dc/d14/d2f/de7 21356 1 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:7/818: rename d2/d15/d2f/l9e to d2/d15/d2f/d45/d82/df6/d27/d33/l108 0 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/822: truncate dc/d14/d19/d20/d32/d68/f6c 8687787 0 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:9/807: dread d9/dbf/f10f [0,4194304] 0 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:7/819: chown d2/d15/d2f/d45/d82/df6/d27/d39/d40/f6a 1 1 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/705: dwrite d1/d7/d1d/f5f [4194304,4194304] 0 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/706: chown d1/d7/d28/d2a/d37/d3a 1746208 1 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:9/808: write d9/de/d20/d1b/d25/d73/fdd [160581,102765] 0 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/707: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f58 7581382 0 2024-09-17T01:56:30.939 INFO:tasks.workunit.client.0.smithi063.stdout:9/809: rename d9/de/d20/d1b/d25/d73/f96 to d9/d8d/d2a/d40/dac/d111/f11f 0 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/820: dwrite d2/d15/d2f/d45/d82/df6/d27/d39/f9c [0,4194304] 0 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:9/810: rename d9/de/d20/d1b/c64 to d9/de/d33/df5/c120 0 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/821: mknod d2/d15/d2f/d45/d82/df6/d22/db6/c109 0 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:9/811: write d9/d8d/d2a/d40/dac/ff8 [1948391,94223] 0 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/822: rmdir d2/d15/d2f/d45/d82/df6/d67/d8d/dca 39 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:9/812: mkdir d9/de/d20/d1b/d25/d73/d121 0 2024-09-17T01:56:30.940 INFO:tasks.workunit.client.0.smithi063.stdout:7/823: symlink d2/d15/d2f/d45/d82/df6/d22/d3a/l10a 0 2024-09-17T01:56:30.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/813: mkdir d9/d8d/ddf/d10a/d122 0 2024-09-17T01:56:30.944 INFO:tasks.workunit.client.0.smithi063.stdout:7/824: truncate d2/d15/d2f/d45/d82/df6/d22/d3a/f83 3257152 0 2024-09-17T01:56:30.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/814: dwrite d9/d8d/d2a/d40/dac/fe6 [0,4194304] 0 2024-09-17T01:56:30.946 INFO:tasks.workunit.client.0.smithi063.stdout:7/825: symlink d2/d15/d2f/d45/d82/df6/d27/d65/dd2/l10b 0 2024-09-17T01:56:30.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/826: write d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/fc6 [997187,69169] 0 2024-09-17T01:56:30.948 INFO:tasks.workunit.client.0.smithi063.stdout:0/791: dread d1/d1d/f99 [0,4194304] 0 2024-09-17T01:56:30.949 INFO:tasks.workunit.client.0.smithi063.stdout:0/792: mknod d1/d3/d32/c103 0 2024-09-17T01:56:30.950 INFO:tasks.workunit.client.0.smithi063.stdout:0/793: mknod d1/d3/db/d6e/d86/dcc/d7c/d88/c104 0 2024-09-17T01:56:30.950 INFO:tasks.workunit.client.0.smithi063.stdout:0/794: dread - d1/d1f/fe9 zero size 2024-09-17T01:56:30.951 INFO:tasks.workunit.client.0.smithi063.stdout:8/708: fsync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f23 0 2024-09-17T01:56:30.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/795: write d1/d1f/f77 [1555003,54205] 0 2024-09-17T01:56:30.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/827: rename d2/d15/d2f/d45/d82/df6/d22/d3a/f83 to d2/d15/d2f/d45/d82/df6/d27/d65/f10c 0 2024-09-17T01:56:30.952 INFO:tasks.workunit.client.0.smithi063.stdout:9/815: dread d9/de/d20/d1b/d25/d73/fd6 [0,4194304] 0 2024-09-17T01:56:30.952 INFO:tasks.workunit.client.0.smithi063.stdout:8/709: rmdir d1/d7/dc6 0 2024-09-17T01:56:30.953 INFO:tasks.workunit.client.0.smithi063.stdout:7/828: getdents d2/d15/d2f/d45/d82 0 2024-09-17T01:56:30.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/710: symlink d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/ld7 0 2024-09-17T01:56:30.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/711: mknod d1/d27/d81/da4/cd8 0 2024-09-17T01:56:30.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/712: creat d1/d27/d82/fd9 x:0 0 0 2024-09-17T01:56:30.957 INFO:tasks.workunit.client.0.smithi063.stdout:8/713: link d1/d7/d28/d2a/d37/f78 d1/d7/d28/d2a/d44/d6e/fda 0 2024-09-17T01:56:30.959 INFO:tasks.workunit.client.0.smithi063.stdout:9/816: dwrite d9/de/d20/d37/d42/f93 [0,4194304] 0 2024-09-17T01:56:30.959 INFO:tasks.workunit.client.0.smithi063.stdout:8/714: link d1/d7/d28/d2a/d37/d3a/daf/fb8 d1/d7/d28/d2a/d59/fdb 0 2024-09-17T01:56:30.959 INFO:tasks.workunit.client.0.smithi063.stdout:7/829: dwrite d2/d15/d2f/d3e/fe6 [0,4194304] 0 2024-09-17T01:56:30.960 INFO:tasks.workunit.client.0.smithi063.stdout:8/715: chown d1/d7/d28 0 1 2024-09-17T01:56:30.960 INFO:tasks.workunit.client.0.smithi063.stdout:8/716: chown d1 91 1 2024-09-17T01:56:30.960 INFO:tasks.workunit.client.0.smithi063.stdout:9/817: creat d9/d8d/d2a/d36/ded/f123 x:0 0 0 2024-09-17T01:56:30.962 INFO:tasks.workunit.client.0.smithi063.stdout:9/818: rename d9/d8d/d2a/d36/c4d to d9/d8d/c124 0 2024-09-17T01:56:30.962 INFO:tasks.workunit.client.0.smithi063.stdout:8/717: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f8b to d1/d7/d28/d2a/d59/fdc 0 2024-09-17T01:56:30.963 INFO:tasks.workunit.client.0.smithi063.stdout:7/830: rename d2/d15/d2f/d45/d82/df6/d27/d65/dd2/fef to d2/d15/d2f/d45/d82/df6/d27/d8f/f10d 0 2024-09-17T01:56:30.963 INFO:tasks.workunit.client.0.smithi063.stdout:8/718: truncate d1/d7/d28/f51 1470378 0 2024-09-17T01:56:30.964 INFO:tasks.workunit.client.0.smithi063.stdout:9/819: rename d9/de/d20/f24 to d9/de/d20/d1b/f125 0 2024-09-17T01:56:30.965 INFO:tasks.workunit.client.0.smithi063.stdout:9/820: chown d9/d27/f3a 7143776 1 2024-09-17T01:56:30.966 INFO:tasks.workunit.client.0.smithi063.stdout:9/821: creat d9/de/d33/df5/d103/d113/f126 x:0 0 0 2024-09-17T01:56:30.967 INFO:tasks.workunit.client.0.smithi063.stdout:8/719: rename d1/d7/d28/d2a/d4d/f7c to d1/d7/d28/d2a/d37/d3a/d75/fdd 0 2024-09-17T01:56:30.968 INFO:tasks.workunit.client.0.smithi063.stdout:8/720: creat d1/d7/d28/d2a/d4d/fde x:0 0 0 2024-09-17T01:56:30.973 INFO:tasks.workunit.client.0.smithi063.stdout:9/822: dwrite d9/de/d33/f38 [0,4194304] 0 2024-09-17T01:56:30.973 INFO:tasks.workunit.client.0.smithi063.stdout:8/721: dwrite d1/d27/d82/f88 [0,4194304] 0 2024-09-17T01:56:30.974 INFO:tasks.workunit.client.0.smithi063.stdout:9/823: mknod d9/d8d/ddf/d10a/c127 0 2024-09-17T01:56:30.977 INFO:tasks.workunit.client.0.smithi063.stdout:9/824: link d9/de/d20/d37/c59 d9/de/d20/d1b/d25/d73/da4/c128 0 2024-09-17T01:56:30.977 INFO:tasks.workunit.client.0.smithi063.stdout:9/825: fdatasync d9/d8d/d2a/d40/fc1 0 2024-09-17T01:56:30.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/826: rename d9/de/d20/d1b/db7/c114 to d9/de/d20/d1b/d25/c129 0 2024-09-17T01:56:30.980 INFO:tasks.workunit.client.0.smithi063.stdout:9/827: fdatasync d9/de/d20/d37/d42/f93 0 2024-09-17T01:56:30.981 INFO:tasks.workunit.client.0.smithi063.stdout:9/828: mkdir d9/de/d20/d1b/d25/d12a 0 2024-09-17T01:56:30.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/722: dwrite d1/d27/f64 [0,4194304] 0 2024-09-17T01:56:30.981 INFO:tasks.workunit.client.0.smithi063.stdout:7/831: dread d2/d15/d2f/d45/d82/df6/d17/f79 [0,4194304] 0 2024-09-17T01:56:30.983 INFO:tasks.workunit.client.0.smithi063.stdout:8/723: dread - d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f52 zero size 2024-09-17T01:56:30.983 INFO:tasks.workunit.client.0.smithi063.stdout:8/724: mknod d1/d7/d28/d2a/d53/cdf 0 2024-09-17T01:56:30.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/777: sync 2024-09-17T01:56:30.986 INFO:tasks.workunit.client.0.smithi063.stdout:3/860: sync 2024-09-17T01:56:30.986 INFO:tasks.workunit.client.0.smithi063.stdout:4/886: sync 2024-09-17T01:56:30.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/725: creat d1/d27/d81/da4/fe0 x:0 0 0 2024-09-17T01:56:30.987 INFO:tasks.workunit.client.0.smithi063.stdout:3/861: mkdir df/d12/d30/d128 0 2024-09-17T01:56:30.988 INFO:tasks.workunit.client.0.smithi063.stdout:2/778: mknod d3/d7/df/d43/cf3 0 2024-09-17T01:56:30.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/832: dwrite d2/d15/d2f/d45/d82/df6/d27/d39/f8a [0,4194304] 0 2024-09-17T01:56:30.989 INFO:tasks.workunit.client.0.smithi063.stdout:8/726: chown d1/d7/c29 12687 1 2024-09-17T01:56:30.989 INFO:tasks.workunit.client.0.smithi063.stdout:9/829: dwrite d9/de/d33/df5/d103/fda [0,4194304] 0 2024-09-17T01:56:30.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/862: symlink df/d12/d1e/d39/l129 0 2024-09-17T01:56:30.992 INFO:tasks.workunit.client.0.smithi063.stdout:8/727: creat d1/d27/d82/fe1 x:0 0 0 2024-09-17T01:56:30.992 INFO:tasks.workunit.client.0.smithi063.stdout:4/887: link de/d17/d1b/dc7/c29 de/d102/c11a 0 2024-09-17T01:56:30.992 INFO:tasks.workunit.client.0.smithi063.stdout:2/779: symlink d3/d28/lf4 0 2024-09-17T01:56:30.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/830: getdents d9/de/d20/d1b/db7 0 2024-09-17T01:56:30.993 INFO:tasks.workunit.client.0.smithi063.stdout:2/780: read - d3/d7/d8d/da4/fbe zero size 2024-09-17T01:56:30.994 INFO:tasks.workunit.client.0.smithi063.stdout:2/781: write d3/d2a/f3d [342063,15134] 0 2024-09-17T01:56:30.994 INFO:tasks.workunit.client.0.smithi063.stdout:4/888: creat de/d17/d36/dbe/d9a/f11b x:0 0 0 2024-09-17T01:56:30.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/833: dwrite d2/d15/f6b [0,4194304] 0 2024-09-17T01:56:30.995 INFO:tasks.workunit.client.0.smithi063.stdout:4/889: fdatasync de/d17/d1b/f83 0 2024-09-17T01:56:30.997 INFO:tasks.workunit.client.0.smithi063.stdout:7/834: rename d2/d15/d2f/d45/d82/df6/d67/d8d to d2/d15/d2f/d3e/d10e 0 2024-09-17T01:56:30.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/782: dread - d3/d7/d76/f99 zero size 2024-09-17T01:56:30.997 INFO:tasks.workunit.client.0.smithi063.stdout:4/890: chown de/d17/d1b/dc7/d28/d8b/f108 153232616 1 2024-09-17T01:56:30.999 INFO:tasks.workunit.client.0.smithi063.stdout:4/891: truncate de/d17/d36/d70/fc9 5145830 0 2024-09-17T01:56:31.000 INFO:tasks.workunit.client.0.smithi063.stdout:4/892: write de/fcb [7395,105942] 0 2024-09-17T01:56:31.001 INFO:tasks.workunit.client.0.smithi063.stdout:8/728: dwrite d1/d27/d82/fe1 [0,4194304] 0 2024-09-17T01:56:31.001 INFO:tasks.workunit.client.0.smithi063.stdout:4/893: stat de/f3b 0 2024-09-17T01:56:31.002 INFO:tasks.workunit.client.0.smithi063.stdout:3/863: write df/d12/d3a/f51 [1562326,73852] 0 2024-09-17T01:56:31.002 INFO:tasks.workunit.client.0.smithi063.stdout:2/783: write d3/d7/d8d/dc0/fd8 [1047405,22652] 0 2024-09-17T01:56:31.002 INFO:tasks.workunit.client.0.smithi063.stdout:4/894: chown de/d17/d1b/dc7 0 1 2024-09-17T01:56:31.003 INFO:tasks.workunit.client.0.smithi063.stdout:2/784: rmdir d3/d7/df/d68 39 2024-09-17T01:56:31.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/729: creat d1/d7/d28/d2a/d37/d3a/d75/dc2/fe2 x:0 0 0 2024-09-17T01:56:31.004 INFO:tasks.workunit.client.0.smithi063.stdout:3/864: creat df/d12/d30/d8a/d9d/f12a x:0 0 0 2024-09-17T01:56:31.005 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:31.005+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:31.005 INFO:tasks.workunit.client.0.smithi063.stdout:4/895: symlink de/d17/d36/d70/l11c 0 2024-09-17T01:56:31.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/785: dread - d3/d2a/dac/ff1 zero size 2024-09-17T01:56:31.005 INFO:tasks.workunit.client.0.smithi063.stdout:9/831: dwrite d9/d8d/d2a/d36/ded/f101 [0,4194304] 0 2024-09-17T01:56:31.006 INFO:tasks.workunit.client.0.smithi063.stdout:2/786: chown d3/d7/df/d5a/f95 158694519 1 2024-09-17T01:56:31.006 INFO:tasks.workunit.client.0.smithi063.stdout:8/730: truncate d1/f10 8133779 0 2024-09-17T01:56:31.007 INFO:tasks.workunit.client.0.smithi063.stdout:9/832: symlink d9/de/d20/d1b/d25/d73/l12b 0 2024-09-17T01:56:31.007 INFO:tasks.workunit.client.0.smithi063.stdout:2/787: write d3/d7/df/d5a/f95 [1228062,3380] 0 2024-09-17T01:56:31.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/731: symlink d1/d7/d28/d2a/d37/d3a/d75/le3 0 2024-09-17T01:56:31.008 INFO:tasks.workunit.client.0.smithi063.stdout:2/788: fsync d3/d7/fb8 0 2024-09-17T01:56:31.009 INFO:tasks.workunit.client.0.smithi063.stdout:2/789: mknod d3/d28/d72/cf5 0 2024-09-17T01:56:31.010 INFO:tasks.workunit.client.0.smithi063.stdout:8/732: truncate d1/d7/d1d/f40 545686 0 2024-09-17T01:56:31.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/835: dwrite d2/d15/d2f/d45/d82/df6/d27/d65/f6d [0,4194304] 0 2024-09-17T01:56:31.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/790: dread - d3/d7/d8d/da4/fe8 zero size 2024-09-17T01:56:31.011 INFO:tasks.workunit.client.0.smithi063.stdout:8/733: symlink d1/d7/d28/d2a/d44/le4 0 2024-09-17T01:56:31.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/836: rmdir d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b 39 2024-09-17T01:56:31.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/837: chown d2/d15/d2f/cbf 105374 1 2024-09-17T01:56:31.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/833: dwrite d9/de/d20/d32/fbc [0,4194304] 0 2024-09-17T01:56:31.017 INFO:tasks.workunit.client.0.smithi063.stdout:7/838: mkdir d2/d15/d2f/d45/d82/df6/de4/d10f 0 2024-09-17T01:56:31.018 INFO:tasks.workunit.client.0.smithi063.stdout:8/734: dwrite d1/d7/d1d/f1f [0,4194304] 0 2024-09-17T01:56:31.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/834: getdents d9/d27/dff 0 2024-09-17T01:56:31.019 INFO:tasks.workunit.client.0.smithi063.stdout:7/839: rename d2/d15/d2f/d52/d97/ld5 to d2/d98/dea/l110 0 2024-09-17T01:56:31.022 INFO:tasks.workunit.client.0.smithi063.stdout:9/835: rmdir d9/de/d33/df5 39 2024-09-17T01:56:31.022 INFO:tasks.workunit.client.0.smithi063.stdout:7/840: creat d2/d15/d2f/d3e/d10e/dca/f111 x:0 0 0 2024-09-17T01:56:31.024 INFO:tasks.workunit.client.0.smithi063.stdout:8/735: dwrite d1/f70 [4194304,4194304] 0 2024-09-17T01:56:31.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/841: write d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/fc6 [1801722,107512] 0 2024-09-17T01:56:31.025 INFO:tasks.workunit.client.0.smithi063.stdout:8/736: fdatasync d1/d27/d81/fbf 0 2024-09-17T01:56:31.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/791: read d3/d7/df/f1e [3642985,50567] 0 2024-09-17T01:56:31.027 INFO:tasks.workunit.client.0.smithi063.stdout:8/737: readlink d1/d7/lb 0 2024-09-17T01:56:31.028 INFO:tasks.workunit.client.0.smithi063.stdout:7/842: getdents d2/d15/d2f/d45/d82/df6/d27/d8f 0 2024-09-17T01:56:31.030 INFO:tasks.workunit.client.0.smithi063.stdout:9/836: dwrite d9/d8d/d2a/d40/f5c [0,4194304] 0 2024-09-17T01:56:31.030 INFO:tasks.workunit.client.0.smithi063.stdout:7/843: rename d2/d15/d2f/d45/d82/df6/d17/l2c to d2/d15/d2f/d45/d82/df6/d27/d39/deb/l112 0 2024-09-17T01:56:31.031 INFO:tasks.workunit.client.0.smithi063.stdout:7/844: chown d2/d15/d2f/d45/d82/df6/d27/f5b 114987 1 2024-09-17T01:56:31.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/845: chown d2/d15/d2f/de7/fae 3 1 2024-09-17T01:56:31.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/846: mknod d2/d15/d2f/d52/d97/c113 0 2024-09-17T01:56:31.034 INFO:tasks.workunit.client.0.smithi063.stdout:7/847: mkdir d2/d15/d2f/d45/d82/df6/d27/d65/dd2/d114 0 2024-09-17T01:56:31.034 INFO:tasks.workunit.client.0.smithi063.stdout:7/848: creat d2/d15/d2f/d3e/d10e/dd4/f115 x:0 0 0 2024-09-17T01:56:31.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/849: rename d2/d15/d2f/d3e/d10e/dd4/c104 to d2/d15/d2f/dd3/c116 0 2024-09-17T01:56:31.038 INFO:tasks.workunit.client.0.smithi063.stdout:7/850: mknod d2/d15/d2f/d45/d82/df6/d27/d33/dc0/c117 0 2024-09-17T01:56:31.038 INFO:tasks.workunit.client.0.smithi063.stdout:4/896: dread de/d17/d36/dbe/dbc/fd8 [0,4194304] 0 2024-09-17T01:56:31.039 INFO:tasks.workunit.client.0.smithi063.stdout:4/897: chown de/d2d/d3c/l6f 23 1 2024-09-17T01:56:31.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/898: write de/d17/d36/dbe/fe1 [929426,127230] 0 2024-09-17T01:56:31.041 INFO:tasks.workunit.client.0.smithi063.stdout:4/899: creat de/d17/df3/f11d x:0 0 0 2024-09-17T01:56:31.042 INFO:tasks.workunit.client.0.smithi063.stdout:6/823: sync 2024-09-17T01:56:31.042 INFO:tasks.workunit.client.0.smithi063.stdout:5/879: sync 2024-09-17T01:56:31.042 INFO:tasks.workunit.client.0.smithi063.stdout:0/796: sync 2024-09-17T01:56:31.042 INFO:tasks.workunit.client.0.smithi063.stdout:2/792: dread d3/f4 [0,4194304] 0 2024-09-17T01:56:31.043 INFO:tasks.workunit.client.0.smithi063.stdout:6/824: creat dc/d14/d18/d91/f10b x:0 0 0 2024-09-17T01:56:31.043 INFO:tasks.workunit.client.0.smithi063.stdout:0/797: rmdir d1/d3/db/d6e/d86/dcc/d7c 39 2024-09-17T01:56:31.044 INFO:tasks.workunit.client.0.smithi063.stdout:5/880: symlink d6/d35/dc1/d29/d36/de1/df1/l11e 0 2024-09-17T01:56:31.044 INFO:tasks.workunit.client.0.smithi063.stdout:7/851: dwrite d2/d15/f9a [0,4194304] 0 2024-09-17T01:56:31.044 INFO:tasks.workunit.client.0.smithi063.stdout:2/793: symlink d3/d7/d38/lf6 0 2024-09-17T01:56:31.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/852: readlink d2/d15/d2f/d45/d82/df6/d27/d33/l4f 0 2024-09-17T01:56:31.046 INFO:tasks.workunit.client.0.smithi063.stdout:2/794: fsync d3/d7/fba 0 2024-09-17T01:56:31.047 INFO:tasks.workunit.client.0.smithi063.stdout:5/881: creat d6/d37/d19/d76/d8f/f11f x:0 0 0 2024-09-17T01:56:31.047 INFO:tasks.workunit.client.0.smithi063.stdout:2/795: write d3/d28/f5c [355471,30499] 0 2024-09-17T01:56:31.047 INFO:tasks.workunit.client.0.smithi063.stdout:0/798: rename d1/d3/db/d4b/d2f/fc4 to d1/d3/db/d6e/d86/dcc/d53/d62/f105 0 2024-09-17T01:56:31.049 INFO:tasks.workunit.client.0.smithi063.stdout:2/796: write d3/f44 [2653223,24137] 0 2024-09-17T01:56:31.049 INFO:tasks.workunit.client.0.smithi063.stdout:5/882: read - d6/d37/d19/d68/f78 zero size 2024-09-17T01:56:31.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/797: stat d3/d7/df/d30/ccf 0 2024-09-17T01:56:31.051 INFO:tasks.workunit.client.0.smithi063.stdout:0/799: fdatasync d1/d3/db/f42 0 2024-09-17T01:56:31.051 INFO:tasks.workunit.client.0.smithi063.stdout:5/883: creat d6/d37/d19/d76/d8f/de0/f120 x:0 0 0 2024-09-17T01:56:31.052 INFO:tasks.workunit.client.0.smithi063.stdout:2/798: creat d3/d7/df/d68/ff7 x:0 0 0 2024-09-17T01:56:31.053 INFO:tasks.workunit.client.0.smithi063.stdout:7/853: dwrite d2/d15/d2f/d45/d82/df6/d67/fc8 [0,4194304] 0 2024-09-17T01:56:31.053 INFO:tasks.workunit.client.0.smithi063.stdout:5/884: rmdir d6/d37/d19/d76/d8f/de0/de5 39 2024-09-17T01:56:31.053 INFO:tasks.workunit.client.0.smithi063.stdout:5/885: write d6/d9/d13/d1d/f21 [1230798,53] 0 2024-09-17T01:56:31.054 INFO:tasks.workunit.client.0.smithi063.stdout:5/886: chown d6/d9/d13/d1d/fc4 25 1 2024-09-17T01:56:31.055 INFO:tasks.workunit.client.0.smithi063.stdout:2/799: symlink d3/d7/d38/lf8 0 2024-09-17T01:56:31.057 INFO:tasks.workunit.client.0.smithi063.stdout:7/854: rmdir d2/d15/d2f/d45/d82/df6/de4 39 2024-09-17T01:56:31.058 INFO:tasks.workunit.client.0.smithi063.stdout:0/800: dwrite d1/d3/d1b/d50/ff3 [0,4194304] 0 2024-09-17T01:56:31.059 INFO:tasks.workunit.client.0.smithi063.stdout:5/887: truncate d6/d37/d19/d76/d8f/de0/de5/d4f/d116/dc8/fdf 41297 0 2024-09-17T01:56:31.060 INFO:tasks.workunit.client.0.smithi063.stdout:7/855: fdatasync d2/d15/d2f/d45/d48/f6f 0 2024-09-17T01:56:31.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/801: rmdir d1/d3/db/d4b/d98/df8 0 2024-09-17T01:56:31.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/888: rename d6/d35/f95 to d6/d9/d32/d8c/da7/da9/df3/f121 0 2024-09-17T01:56:31.061 INFO:tasks.workunit.client.0.smithi063.stdout:7/856: fdatasync d2/d15/d2f/d45/d82/df6/d27/d39/f4e 0 2024-09-17T01:56:31.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/889: stat d6/d9/d32/d8c/da7 0 2024-09-17T01:56:31.062 INFO:tasks.workunit.client.0.smithi063.stdout:0/802: rename d1/d3/db/d18/d33/d83/fec to d1/d1d/d6d/f106 0 2024-09-17T01:56:31.063 INFO:tasks.workunit.client.0.smithi063.stdout:0/803: chown d1/d3/db/d18 335620227 1 2024-09-17T01:56:31.064 INFO:tasks.workunit.client.0.smithi063.stdout:0/804: mkdir d1/d3/db/d6e/d107 0 2024-09-17T01:56:31.064 INFO:tasks.workunit.client.0.smithi063.stdout:7/857: rename d2/d15/d2f/d45/d82/df6/d27/d33/d7b/lc1 to d2/l118 0 2024-09-17T01:56:31.064 INFO:tasks.workunit.client.0.smithi063.stdout:6/825: dread dc/d14/d19/d20/d32/d52/d5a/d43/f50 [0,4194304] 0 2024-09-17T01:56:31.065 INFO:tasks.workunit.client.0.smithi063.stdout:0/805: getdents d1/d1d/da5 0 2024-09-17T01:56:31.065 INFO:tasks.workunit.client.0.smithi063.stdout:6/826: chown dc/d14/d19/d20/d32/d52/d5a/d43/f6d 1604 1 2024-09-17T01:56:31.066 INFO:tasks.workunit.client.0.smithi063.stdout:7/858: getdents d2/d15/d2f/d45/d82/df6/d17/d25/db0 0 2024-09-17T01:56:31.066 INFO:tasks.workunit.client.0.smithi063.stdout:6/827: unlink dc/d14/d65/fa5 0 2024-09-17T01:56:31.066 INFO:tasks.workunit.client.0.smithi063.stdout:0/806: stat d1/d3/db/d4b/d98/ddd/ffb 0 2024-09-17T01:56:31.066 INFO:tasks.workunit.client.0.smithi063.stdout:5/890: truncate d6/f12 7825412 0 2024-09-17T01:56:31.067 INFO:tasks.workunit.client.0.smithi063.stdout:5/891: fsync d6/d9/d32/d8c/fc9 0 2024-09-17T01:56:31.067 INFO:tasks.workunit.client.0.smithi063.stdout:6/828: creat dc/d14/d19/d20/d32/d68/db4/dc6/f10c x:0 0 0 2024-09-17T01:56:31.067 INFO:tasks.workunit.client.0.smithi063.stdout:0/807: rmdir d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda 39 2024-09-17T01:56:31.068 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:31.068 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:31.069 INFO:tasks.workunit.client.0.smithi063.stdout:5/892: creat d6/d35/dc1/d3f/dac/f122 x:0 0 0 2024-09-17T01:56:31.069 INFO:tasks.workunit.client.0.smithi063.stdout:7/859: rename d2/d15/d2f/de7/f87 to d2/d15/d2f/d45/d82/df6/d67/f119 0 2024-09-17T01:56:31.069 INFO:tasks.workunit.client.0.smithi063.stdout:2/800: dread d3/d7/d8d/dc0/fd8 [0,4194304] 0 2024-09-17T01:56:31.069 INFO:tasks.workunit.client.0.smithi063.stdout:6/829: fsync dc/d14/d19/d20/d32/d52/d5a/fcc 0 2024-09-17T01:56:31.069 INFO:tasks.workunit.client.0.smithi063.stdout:0/808: creat d1/d3/db/d4b/d2f/d56/f108 x:0 0 0 2024-09-17T01:56:31.069 INFO:tasks.workunit.client.0.smithi063.stdout:2/801: rmdir d3/d2a 39 2024-09-17T01:56:31.070 INFO:tasks.workunit.client.0.smithi063.stdout:7/860: chown d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/fc6 5947 1 2024-09-17T01:56:31.070 INFO:tasks.workunit.client.0.smithi063.stdout:6/830: chown dc/d14/d19/d20/d32/d52/d5a/d97/l103 107153796 1 2024-09-17T01:56:31.072 INFO:tasks.workunit.client.0.smithi063.stdout:7/861: fdatasync d2/fb 0 2024-09-17T01:56:31.072 INFO:tasks.workunit.client.0.smithi063.stdout:2/802: symlink d3/d7/df/d68/de9/lf9 0 2024-09-17T01:56:31.072 INFO:tasks.workunit.client.0.smithi063.stdout:6/831: rename dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/cdf to dc/d14/d19/d20/d66/c10d 0 2024-09-17T01:56:31.073 INFO:tasks.workunit.client.0.smithi063.stdout:6/832: fsync dc/d14/d18/f31 0 2024-09-17T01:56:31.074 INFO:tasks.workunit.client.0.smithi063.stdout:6/833: mknod dc/c10e 0 2024-09-17T01:56:31.075 INFO:tasks.workunit.client.0.smithi063.stdout:3/865: sync 2024-09-17T01:56:31.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/738: sync 2024-09-17T01:56:31.075 INFO:tasks.workunit.client.0.smithi063.stdout:4/900: sync 2024-09-17T01:56:31.075 INFO:tasks.workunit.client.0.smithi063.stdout:9/837: sync 2024-09-17T01:56:31.077 INFO:tasks.workunit.client.0.smithi063.stdout:4/901: creat de/d2d/d52/d9c/f11e x:0 0 0 2024-09-17T01:56:31.078 INFO:tasks.workunit.client.0.smithi063.stdout:3/866: rmdir df/d12/d43/d50/d58/d97/daa/db1 39 2024-09-17T01:56:31.079 INFO:tasks.workunit.client.0.smithi063.stdout:2/803: dread d3/d7/df/d43/f69 [0,4194304] 0 2024-09-17T01:56:31.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/739: read d1/d7/d28/d2a/d37/d3a/fc9 [763094,88336] 0 2024-09-17T01:56:31.080 INFO:tasks.workunit.client.0.smithi063.stdout:4/902: write de/f3b [1970374,46816] 0 2024-09-17T01:56:31.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/867: rmdir df/d12/d43 39 2024-09-17T01:56:31.082 INFO:tasks.workunit.client.0.smithi063.stdout:8/740: fsync d1/f70 0 2024-09-17T01:56:31.082 INFO:tasks.workunit.client.0.smithi063.stdout:7/862: dwrite d2/d15/d2f/d3e/d73/dcd/ffe [0,4194304] 0 2024-09-17T01:56:31.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:31.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/804: creat d3/d28/d72/dd5/ffa x:0 0 0 2024-09-17T01:56:31.084 INFO:tasks.workunit.client.0.smithi063.stdout:6/834: dwrite dc/d14/f70 [0,4194304] 0 2024-09-17T01:56:31.084 INFO:tasks.workunit.client.0.smithi063.stdout:0/809: dwrite d1/d3/db/d6e/d86/dcc/d53/f8b [0,4194304] 0 2024-09-17T01:56:31.084 INFO:tasks.workunit.client.0.smithi063.stdout:3/868: symlink df/d12/d1e/d53/l12b 0 2024-09-17T01:56:31.085 INFO:tasks.workunit.client.0.smithi063.stdout:4/903: rmdir de/d17/df2 0 2024-09-17T01:56:31.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/838: truncate d9/fc 5226573 0 2024-09-17T01:56:31.086 INFO:tasks.workunit.client.0.smithi063.stdout:9/839: stat d9/d8d/d2a/d40/dac/cb0 0 2024-09-17T01:56:31.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/835: mknod dc/d14/d19/d20/d66/c10f 0 2024-09-17T01:56:31.087 INFO:tasks.workunit.client.0.smithi063.stdout:4/904: mknod de/d17/d1b/d9b/c11f 0 2024-09-17T01:56:31.087 INFO:tasks.workunit.client.0.smithi063.stdout:9/840: dread - d9/d8d/d2a/d40/dac/f11c zero size 2024-09-17T01:56:31.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/741: symlink d1/d7/d28/d2a/d37/d3a/d75/d9a/le5 0 2024-09-17T01:56:31.087 INFO:tasks.workunit.client.0.smithi063.stdout:2/805: mknod d3/d7/cfb 0 2024-09-17T01:56:31.088 INFO:tasks.workunit.client.0.smithi063.stdout:0/810: rename d1/d3/db/d18/d85/da8/lba to d1/d3/db/d6e/d86/dcc/d7c/l109 0 2024-09-17T01:56:31.089 INFO:tasks.workunit.client.0.smithi063.stdout:2/806: symlink d3/d2a/lfc 0 2024-09-17T01:56:31.089 INFO:tasks.workunit.client.0.smithi063.stdout:4/905: dread - de/d17/d36/dbe/da6/fba zero size 2024-09-17T01:56:31.090 INFO:tasks.workunit.client.0.smithi063.stdout:6/836: mknod dc/d14/d19/d20/d66/def/df5/c110 0 2024-09-17T01:56:31.090 INFO:tasks.workunit.client.0.smithi063.stdout:4/906: fsync de/d17/d1b/f6a 0 2024-09-17T01:56:31.091 INFO:tasks.workunit.client.0.smithi063.stdout:0/811: mknod d1/d3/db/d6e/d107/c10a 0 2024-09-17T01:56:31.091 INFO:tasks.workunit.client.0.smithi063.stdout:4/907: mkdir de/d17/d1b/d9b/d120 0 2024-09-17T01:56:31.091 INFO:tasks.workunit.client.0.smithi063.stdout:6/837: write dc/d14/d19/d20/d32/d52/d5a/d43/f50 [141055,13472] 0 2024-09-17T01:56:31.092 INFO:tasks.workunit.client.0.smithi063.stdout:0/812: fsync d1/d3/db/d4b/d2f/d56/f108 0 2024-09-17T01:56:31.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/908: creat de/d17/d1b/d9b/dff/f121 x:0 0 0 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/813: write d1/f3d [1737359,57949] 0 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:3/869: dwrite df/d12/d2d/f3c [0,4194304] 0 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:6/838: read dc/d14/d19/d20/f71 [358283,116141] 0 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:3/870: chown df/d12/d1e/d53/dca/fd6 12 1 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:9/841: sync 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:8/742: sync 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:3/871: rmdir df/d12/d43/d50 39 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:9/842: dread - d9/de/d20/d1b/fa8 zero size 2024-09-17T01:56:31.098 INFO:tasks.workunit.client.0.smithi063.stdout:6/839: fdatasync dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/fc3 0 2024-09-17T01:56:31.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/843: creat d9/de/dcf/f12c x:0 0 0 2024-09-17T01:56:31.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/844: write d9/f56 [2476050,5063] 0 2024-09-17T01:56:31.100 INFO:tasks.workunit.client.0.smithi063.stdout:0/814: dwrite d1/d1d/f3b [4194304,4194304] 0 2024-09-17T01:56:31.101 INFO:tasks.workunit.client.0.smithi063.stdout:4/909: dwrite de/d17/d1b/dc7/f96 [0,4194304] 0 2024-09-17T01:56:31.102 INFO:tasks.workunit.client.0.smithi063.stdout:0/815: write d1/d3/db/d18/d33/d83/db7/ffc [933606,22950] 0 2024-09-17T01:56:31.102 INFO:tasks.workunit.client.0.smithi063.stdout:8/743: dread d1/d7/d28/d2a/d37/fcd [0,4194304] 0 2024-09-17T01:56:31.102 INFO:tasks.workunit.client.0.smithi063.stdout:8/744: write d1/fb5 [410496,70187] 0 2024-09-17T01:56:31.103 INFO:tasks.workunit.client.0.smithi063.stdout:4/910: getdents de/d17/d1b/dc7/d28/d8d 0 2024-09-17T01:56:31.103 INFO:tasks.workunit.client.0.smithi063.stdout:0/816: getdents d1/d3/db/d6e/d86/dcc/d53/d62/dcd/d100 0 2024-09-17T01:56:31.104 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:31.105+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:31.104 INFO:tasks.workunit.client.0.smithi063.stdout:4/911: truncate de/d17/d1b/f32 2258306 0 2024-09-17T01:56:31.105 INFO:tasks.workunit.client.0.smithi063.stdout:0/817: symlink d1/d3/db/d6e/d86/dcc/d7c/l10b 0 2024-09-17T01:56:31.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/912: rmdir de/d118 0 2024-09-17T01:56:31.107 INFO:tasks.workunit.client.0.smithi063.stdout:4/913: rename de/d2d/d3c/f4b to de/d2d/d3c/dd0/f122 0 2024-09-17T01:56:31.107 INFO:tasks.workunit.client.0.smithi063.stdout:6/840: dread dc/d14/d18/fad [0,4194304] 0 2024-09-17T01:56:31.108 INFO:tasks.workunit.client.0.smithi063.stdout:3/872: dread df/d12/d30/d8a/d9d/f113 [0,4194304] 0 2024-09-17T01:56:31.108 INFO:tasks.workunit.client.0.smithi063.stdout:2/807: read d3/d7/df/d30/fb4 [78531,121229] 0 2024-09-17T01:56:31.109 INFO:tasks.workunit.client.0.smithi063.stdout:4/914: fdatasync de/d17/f23 0 2024-09-17T01:56:31.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/893: dread d6/d37/d19/d50/f100 [0,4194304] 0 2024-09-17T01:56:31.111 INFO:tasks.workunit.client.0.smithi063.stdout:7/863: dwrite d2/d15/d2f/d45/d48/f6f [0,4194304] 0 2024-09-17T01:56:31.112 INFO:tasks.workunit.client.0.smithi063.stdout:8/745: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/fa2 [0,4194304] 0 2024-09-17T01:56:31.116 INFO:tasks.workunit.client.0.smithi063.stdout:2/808: symlink d3/d7/df/lfd 0 2024-09-17T01:56:31.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/873: rmdir df/d12/d43/d50/d58/dc3 39 2024-09-17T01:56:31.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/915: truncate de/d17/d1b/f1e 1763468 0 2024-09-17T01:56:31.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/894: symlink d6/d9/d13/d1d/l123 0 2024-09-17T01:56:31.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/874: mkdir df/d12/d1e/d53/d12c 0 2024-09-17T01:56:31.117 INFO:tasks.workunit.client.0.smithi063.stdout:6/841: dread dc/d14/d19/d20/d32/d52/d5a/d43/f50 [0,4194304] 0 2024-09-17T01:56:31.117 INFO:tasks.workunit.client.0.smithi063.stdout:4/916: dread - de/d17/d1b/dc7/d28/d8b/f108 zero size 2024-09-17T01:56:31.117 INFO:tasks.workunit.client.0.smithi063.stdout:0/818: read d1/d3/db/d4b/f22 [1964548,4396] 0 2024-09-17T01:56:31.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/895: dread - d6/d9/d32/d8c/da7/da9/df3/f104 zero size 2024-09-17T01:56:31.118 INFO:tasks.workunit.client.0.smithi063.stdout:4/917: chown de/d17/d1b/f6b 1 1 2024-09-17T01:56:31.119 INFO:tasks.workunit.client.0.smithi063.stdout:0/819: fdatasync d1/d1d/d74/f7f 0 2024-09-17T01:56:31.120 INFO:tasks.workunit.client.0.smithi063.stdout:2/809: mkdir d3/d7/df/d68/dfe 0 2024-09-17T01:56:31.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/842: mknod dc/d14/d19/d20/d32/d52/d5a/d62/c111 0 2024-09-17T01:56:31.120 INFO:tasks.workunit.client.0.smithi063.stdout:3/875: mknod df/d12/d43/d50/d58/db5/d107/c12d 0 2024-09-17T01:56:31.120 INFO:tasks.workunit.client.0.smithi063.stdout:5/896: write d6/d37/d19/f2c [3148263,10500] 0 2024-09-17T01:56:31.120 INFO:tasks.workunit.client.0.smithi063.stdout:4/918: creat de/d2d/d3c/dd0/f123 x:0 0 0 2024-09-17T01:56:31.120 INFO:tasks.workunit.client.0.smithi063.stdout:7/864: dwrite d2/d15/d2f/d45/d82/df6/d17/ffd [0,4194304] 0 2024-09-17T01:56:31.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/897: unlink d6/d37/d19/f75 0 2024-09-17T01:56:31.123 INFO:tasks.workunit.client.0.smithi063.stdout:7/865: write d2/d15/d2f/d45/d82/df6/d27/d39/f46 [6907171,121144] 0 2024-09-17T01:56:31.123 INFO:tasks.workunit.client.0.smithi063.stdout:3/876: creat df/d12/d43/d50/d58/d97/daa/db1/dfd/d106/f12e x:0 0 0 2024-09-17T01:56:31.123 INFO:tasks.workunit.client.0.smithi063.stdout:2/810: dread d3/d7/df/d30/fb4 [0,4194304] 0 2024-09-17T01:56:31.125 INFO:tasks.workunit.client.0.smithi063.stdout:4/919: truncate de/d2d/d3c/f99 1120296 0 2024-09-17T01:56:31.125 INFO:tasks.workunit.client.0.smithi063.stdout:2/811: chown d3/d7/d38/l78 512920780 1 2024-09-17T01:56:31.126 INFO:tasks.workunit.client.0.smithi063.stdout:4/920: mkdir de/d17/d1b/d124 0 2024-09-17T01:56:31.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/843: rename dc/d14/d19/d20/d32/d68/db4/dc6/f10c to dc/d1b/d5e/f112 0 2024-09-17T01:56:31.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/812: creat d3/d2a/dac/fff x:0 0 0 2024-09-17T01:56:31.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/877: read df/d12/d1e/f57 [1075160,65753] 0 2024-09-17T01:56:31.127 INFO:tasks.workunit.client.0.smithi063.stdout:4/921: unlink de/d17/d36/dbe/dbc/cfc 0 2024-09-17T01:56:31.127 INFO:tasks.workunit.client.0.smithi063.stdout:2/813: mkdir d3/d7/d8d/d100 0 2024-09-17T01:56:31.128 INFO:tasks.workunit.client.0.smithi063.stdout:6/844: write dc/d14/d19/d20/d32/d52/d5a/fd4 [418155,70360] 0 2024-09-17T01:56:31.129 INFO:tasks.workunit.client.0.smithi063.stdout:6/845: stat dc/d14/d2f/f5f 0 2024-09-17T01:56:31.130 INFO:tasks.workunit.client.0.smithi063.stdout:4/922: creat de/d17/d36/dbe/dbc/f125 x:0 0 0 2024-09-17T01:56:31.130 INFO:tasks.workunit.client.0.smithi063.stdout:3/878: read df/d12/d3a/f92 [3027613,77918] 0 2024-09-17T01:56:31.132 INFO:tasks.workunit.client.0.smithi063.stdout:5/898: dwrite d6/d9/d32/d8c/da7/da9/fab [0,4194304] 0 2024-09-17T01:56:31.133 INFO:tasks.workunit.client.0.smithi063.stdout:9/845: sync 2024-09-17T01:56:31.133 INFO:tasks.workunit.client.0.smithi063.stdout:7/866: dwrite d2/d15/d2f/d45/d82/df6/d27/f5b [0,4194304] 0 2024-09-17T01:56:31.134 INFO:tasks.workunit.client.0.smithi063.stdout:7/867: chown d2/d15/d2f/d3e 13 1 2024-09-17T01:56:31.135 INFO:tasks.workunit.client.0.smithi063.stdout:6/846: creat dc/d14/d19/d20/d32/d68/db4/dc6/f113 x:0 0 0 2024-09-17T01:56:31.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/820: dread d1/d3/d32/fcb [0,4194304] 0 2024-09-17T01:56:31.136 INFO:tasks.workunit.client.0.smithi063.stdout:2/814: dwrite d3/d7/f5b [0,4194304] 0 2024-09-17T01:56:31.137 INFO:tasks.workunit.client.0.smithi063.stdout:4/923: rename de/d2d/c5c to de/d17/d1b/dc7/d28/d8b/c126 0 2024-09-17T01:56:31.137 INFO:tasks.workunit.client.0.smithi063.stdout:9/846: mkdir d9/dbf/d12d 0 2024-09-17T01:56:31.138 INFO:tasks.workunit.client.0.smithi063.stdout:4/924: chown de/d17/d1b/fbb 11023 1 2024-09-17T01:56:31.139 INFO:tasks.workunit.client.0.smithi063.stdout:7/868: chown d2/d15/d2f/d45/d82/df6/d27/d39/f9c 0 1 2024-09-17T01:56:31.139 INFO:tasks.workunit.client.0.smithi063.stdout:2/815: write d3/d7/d38/da9/fed [581522,36367] 0 2024-09-17T01:56:31.140 INFO:tasks.workunit.client.0.smithi063.stdout:6/847: mknod dc/d14/d65/c114 0 2024-09-17T01:56:31.140 INFO:tasks.workunit.client.0.smithi063.stdout:0/821: mkdir d1/d3/db/d4b/d7d/d10c 0 2024-09-17T01:56:31.141 INFO:tasks.workunit.client.0.smithi063.stdout:9/847: rename d9/de/d20/d1b/lc4 to d9/de/d20/d1b/d25/d73/d121/l12e 0 2024-09-17T01:56:31.141 INFO:tasks.workunit.client.0.smithi063.stdout:5/899: dwrite d6/d35/dc1/d3a/f4c [0,4194304] 0 2024-09-17T01:56:31.142 INFO:tasks.workunit.client.0.smithi063.stdout:4/925: mknod de/d17/d1b/d9b/d120/c127 0 2024-09-17T01:56:31.142 INFO:tasks.workunit.client.0.smithi063.stdout:6/848: write dc/d14/d18/f31 [2277734,75675] 0 2024-09-17T01:56:31.145 INFO:tasks.workunit.client.0.smithi063.stdout:4/926: chown de/d17/dc6 190 1 2024-09-17T01:56:31.145 INFO:tasks.workunit.client.0.smithi063.stdout:0/822: stat d1/d3/db/d18/l46 0 2024-09-17T01:56:31.145 INFO:tasks.workunit.client.0.smithi063.stdout:9/848: write d9/de/d33/f38 [201256,65638] 0 2024-09-17T01:56:31.146 INFO:tasks.workunit.client.0.smithi063.stdout:2/816: rmdir d3/d7/df/d68/ddb 0 2024-09-17T01:56:31.146 INFO:tasks.workunit.client.0.smithi063.stdout:5/900: chown d6/d9/d13/d1d/d8a 5 1 2024-09-17T01:56:31.146 INFO:tasks.workunit.client.0.smithi063.stdout:7/869: rename d2/d15/d2f/d45/d82/df6/d27/d65/fc4 to d2/d15/f11a 0 2024-09-17T01:56:31.147 INFO:tasks.workunit.client.0.smithi063.stdout:2/817: fdatasync d3/d28/f97 0 2024-09-17T01:56:31.147 INFO:tasks.workunit.client.0.smithi063.stdout:9/849: mkdir d9/de/d20/d1b/d25/d73/da4/d12f 0 2024-09-17T01:56:31.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/901: creat d6/d35/f124 x:0 0 0 2024-09-17T01:56:31.147 INFO:tasks.workunit.client.0.smithi063.stdout:6/849: rename dc/d14/d19/d20/d32/d52/d5a/c7f to dc/d14/d19/d20/d32/d68/c115 0 2024-09-17T01:56:31.147 INFO:tasks.workunit.client.0.smithi063.stdout:7/870: stat d2/d15/d2f/d3e 0 2024-09-17T01:56:31.148 INFO:tasks.workunit.client.0.smithi063.stdout:9/850: unlink d9/d27/dff/c51 0 2024-09-17T01:56:31.148 INFO:tasks.workunit.client.0.smithi063.stdout:0/823: rename d1/d1d/l20 to d1/d3/db/d4b/de0/l10d 0 2024-09-17T01:56:31.148 INFO:tasks.workunit.client.0.smithi063.stdout:2/818: creat d3/d7/df/d68/f101 x:0 0 0 2024-09-17T01:56:31.149 INFO:tasks.workunit.client.0.smithi063.stdout:0/824: symlink d1/d3/db/d18/l10e 0 2024-09-17T01:56:31.149 INFO:tasks.workunit.client.0.smithi063.stdout:4/927: read de/fe9 [1063613,55206] 0 2024-09-17T01:56:31.149 INFO:tasks.workunit.client.0.smithi063.stdout:9/851: mknod d9/de/d20/d1b/c130 0 2024-09-17T01:56:31.150 INFO:tasks.workunit.client.0.smithi063.stdout:7/871: creat d2/d15/d2f/d45/d82/df6/d27/d39/d40/f11b x:0 0 0 2024-09-17T01:56:31.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/928: mkdir de/d17/d36/dbe/d128 0 2024-09-17T01:56:31.151 INFO:tasks.workunit.client.0.smithi063.stdout:7/872: creat d2/d15/d2f/d45/d82/df6/d27/d39/deb/f11c x:0 0 0 2024-09-17T01:56:31.153 INFO:tasks.workunit.client.0.smithi063.stdout:2/819: rename d3/d7/df/d68 to d3/d7/d38/da9/d102 0 2024-09-17T01:56:31.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/929: getdents de/d17/d1b 0 2024-09-17T01:56:31.155 INFO:tasks.workunit.client.0.smithi063.stdout:7/873: creat d2/d15/d2f/d45/d82/df6/d17/d25/f11d x:0 0 0 2024-09-17T01:56:31.155 INFO:tasks.workunit.client.0.smithi063.stdout:4/930: dread - de/d17/df3/f11d zero size 2024-09-17T01:56:31.156 INFO:tasks.workunit.client.0.smithi063.stdout:9/852: rename d9/de/d20/d1b/fd8 to d9/de/d20/d1b/d25/f131 0 2024-09-17T01:56:31.156 INFO:tasks.workunit.client.0.smithi063.stdout:2/820: unlink d3/d7/df/l87 0 2024-09-17T01:56:31.156 INFO:tasks.workunit.client.0.smithi063.stdout:5/902: dwrite d6/d37/d19/d76/d8f/de0/f120 [0,4194304] 0 2024-09-17T01:56:31.156 INFO:tasks.workunit.client.0.smithi063.stdout:9/853: chown d9/de 203498 1 2024-09-17T01:56:31.157 INFO:tasks.workunit.client.0.smithi063.stdout:5/903: dread - d6/d37/d19/de4/ffc zero size 2024-09-17T01:56:31.158 INFO:tasks.workunit.client.0.smithi063.stdout:0/825: dwrite d1/d3/db/d4b/d98/ddd/ffb [0,4194304] 0 2024-09-17T01:56:31.159 INFO:tasks.workunit.client.0.smithi063.stdout:0/826: dread - d1/d3/db/d6e/d86/dcc/d7c/d88/fe5 zero size 2024-09-17T01:56:31.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/821: read d3/d7/d38/da9/d102/f46 [2477228,104311] 0 2024-09-17T01:56:31.161 INFO:tasks.workunit.client.0.smithi063.stdout:3/879: dread df/d12/d43/d50/dfb/dbb/ff2 [0,4194304] 0 2024-09-17T01:56:31.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/904: rename d6/f18 to d6/d9/d32/f125 0 2024-09-17T01:56:31.163 INFO:tasks.workunit.client.0.smithi063.stdout:8/746: dread d1/d7/d28/f9f [0,4194304] 0 2024-09-17T01:56:31.163 INFO:tasks.workunit.client.0.smithi063.stdout:5/905: truncate d6/d35/dc1/d29/d36/f7d 733392 0 2024-09-17T01:56:31.164 INFO:tasks.workunit.client.0.smithi063.stdout:8/747: chown d1/d7/c29 2638 1 2024-09-17T01:56:31.164 INFO:tasks.workunit.client.0.smithi063.stdout:5/906: rmdir d6/d35/dc1 39 2024-09-17T01:56:31.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/827: dwrite d1/d3/d1b/f38 [0,4194304] 0 2024-09-17T01:56:31.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/748: mkdir d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/de6 0 2024-09-17T01:56:31.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/907: rename d6/d35/dc1/d3f/l87 to d6/d9/d13/d1d/d8a/l126 0 2024-09-17T01:56:31.167 INFO:tasks.workunit.client.0.smithi063.stdout:0/828: creat d1/d3/d1b/f10f x:0 0 0 2024-09-17T01:56:31.168 INFO:tasks.workunit.client.0.smithi063.stdout:8/749: creat d1/d7/d28/d2a/d44/d6e/fe7 x:0 0 0 2024-09-17T01:56:31.169 INFO:tasks.workunit.client.0.smithi063.stdout:5/908: rename d6/d37/d19/d76/d8f/de0/de5/d4f/l10d to d6/d35/dc1/l127 0 2024-09-17T01:56:31.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/854: dwrite d9/d8d/f34 [0,4194304] 0 2024-09-17T01:56:31.171 INFO:tasks.workunit.client.0.smithi063.stdout:0/829: truncate d1/d3/db/d6e/d86/dcc/d7c/d88/fe5 851864 0 2024-09-17T01:56:31.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/750: getdents d1/d7/d28/d2a/d37/d3a/d75/dc2 0 2024-09-17T01:56:31.171 INFO:tasks.workunit.client.0.smithi063.stdout:5/909: write d6/d37/d19/d50/fc2 [4438442,93850] 0 2024-09-17T01:56:31.172 INFO:tasks.workunit.client.0.smithi063.stdout:2/822: dread d3/d2a/f8b [0,4194304] 0 2024-09-17T01:56:31.172 INFO:tasks.workunit.client.0.smithi063.stdout:3/880: truncate df/d12/d43/d50/d58/fbd 4158536 0 2024-09-17T01:56:31.173 INFO:tasks.workunit.client.0.smithi063.stdout:5/910: chown d6/d9/d13/d1d/l90 62 1 2024-09-17T01:56:31.173 INFO:tasks.workunit.client.0.smithi063.stdout:8/751: truncate d1/d27/d81/fbf 1752019 0 2024-09-17T01:56:31.174 INFO:tasks.workunit.client.0.smithi063.stdout:5/911: fsync d6/d37/d19/d68/f78 0 2024-09-17T01:56:31.174 INFO:tasks.workunit.client.0.smithi063.stdout:9/855: getdents d9/de/d33/df5/d103/d113 0 2024-09-17T01:56:31.175 INFO:tasks.workunit.client.0.smithi063.stdout:2/823: link d3/cc d3/d2a/dac/c103 0 2024-09-17T01:56:31.177 INFO:tasks.workunit.client.0.smithi063.stdout:2/824: chown d3/d2a/c4b 1600659331 1 2024-09-17T01:56:31.178 INFO:tasks.workunit.client.0.smithi063.stdout:2/825: creat d3/d7/df/d30/f104 x:0 0 0 2024-09-17T01:56:31.180 INFO:tasks.workunit.client.0.smithi063.stdout:0/830: dwrite d1/d3/db/d6e/d86/dcc/d53/f8b [4194304,4194304] 0 2024-09-17T01:56:31.182 INFO:tasks.workunit.client.0.smithi063.stdout:6/850: dread dc/f12 [0,4194304] 0 2024-09-17T01:56:31.183 INFO:tasks.workunit.client.0.smithi063.stdout:9/856: dwrite d9/de/ff [0,4194304] 0 2024-09-17T01:56:31.183 INFO:tasks.workunit.client.0.smithi063.stdout:3/881: truncate df/d12/d1e/f4f 8676744 0 2024-09-17T01:56:31.183 INFO:tasks.workunit.client.0.smithi063.stdout:8/752: truncate d1/d7/d28/d2a/d37/d3a/d75/fdd 934982 0 2024-09-17T01:56:31.183 INFO:tasks.workunit.client.0.smithi063.stdout:5/912: dwrite d6/d37/d19/d50/d98/fc0 [0,4194304] 0 2024-09-17T01:56:31.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/851: chown dc/c4c 6783449 1 2024-09-17T01:56:31.184 INFO:tasks.workunit.client.0.smithi063.stdout:0/831: mkdir d1/d3/db/d4b/d98/d110 0 2024-09-17T01:56:31.185 INFO:tasks.workunit.client.0.smithi063.stdout:6/852: readlink dc/d14/d19/d20/d32/d52/d5a/d97/l103 0 2024-09-17T01:56:31.186 INFO:tasks.workunit.client.0.smithi063.stdout:3/882: creat df/d12/d2d/f12f x:0 0 0 2024-09-17T01:56:31.186 INFO:tasks.workunit.client.0.smithi063.stdout:7/874: dread d2/d15/d2f/dd3/fdc [0,4194304] 0 2024-09-17T01:56:31.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/832: write d1/d3/db/d4b/d2f/d56/f57 [4566911,22384] 0 2024-09-17T01:56:31.187 INFO:tasks.workunit.client.0.smithi063.stdout:8/753: rename d1/d7/d28/d2a/d37/d3a/d75/la0 to d1/d7/d28/d2a/le8 0 2024-09-17T01:56:31.187 INFO:tasks.workunit.client.0.smithi063.stdout:5/913: chown d6/d37/d19/d76/d8f/de0/de5/d4f/d116/dc8/fdf 461 1 2024-09-17T01:56:31.188 INFO:tasks.workunit.client.0.smithi063.stdout:0/833: chown d1/d3/db/d6e/le1 42 1 2024-09-17T01:56:31.188 INFO:tasks.workunit.client.0.smithi063.stdout:3/883: creat df/d12/d43/f130 x:0 0 0 2024-09-17T01:56:31.189 INFO:tasks.workunit.client.0.smithi063.stdout:7/875: write d2/d15/d2f/d45/d82/df6/d27/d39/deb/fe9 [202730,79705] 0 2024-09-17T01:56:31.191 INFO:tasks.workunit.client.0.smithi063.stdout:5/914: creat d6/d9/d13/d1d/d8a/f128 x:0 0 0 2024-09-17T01:56:31.191 INFO:tasks.workunit.client.0.smithi063.stdout:0/834: symlink d1/d3/d1b/d50/l111 0 2024-09-17T01:56:31.191 INFO:tasks.workunit.client.0.smithi063.stdout:8/754: rename d1/l1c to d1/d7/d28/d2a/d44/le9 0 2024-09-17T01:56:31.192 INFO:tasks.workunit.client.0.smithi063.stdout:9/857: dwrite d9/de/d20/d1b/d25/fd9 [0,4194304] 0 2024-09-17T01:56:31.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/755: fdatasync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f4a 0 2024-09-17T01:56:31.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/835: getdents d1/d3/db/d18/d33/d83/db7/dd8 0 2024-09-17T01:56:31.193 INFO:tasks.workunit.client.0.smithi063.stdout:7/876: write d2/d15/d2f/d45/d82/df6/d17/d25/db0/fb2 [4526608,37835] 0 2024-09-17T01:56:31.194 INFO:tasks.workunit.client.0.smithi063.stdout:9/858: write d9/de/d20/d1b/d25/d73/fe3 [914794,9900] 0 2024-09-17T01:56:31.195 INFO:tasks.workunit.client.0.smithi063.stdout:6/853: read dc/d1b/f41 [295860,101264] 0 2024-09-17T01:56:31.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/877: mknod d2/d15/d2f/d45/d82/df6/d27/d33/dc0/c11e 0 2024-09-17T01:56:31.197 INFO:tasks.workunit.client.0.smithi063.stdout:9/859: mkdir d9/d8d/d2a/d40/dac/dc2/d132 0 2024-09-17T01:56:31.199 INFO:tasks.workunit.client.0.smithi063.stdout:3/884: dwrite df/d12/d3a/fed [0,4194304] 0 2024-09-17T01:56:31.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/878: mknod d2/d15/d2f/d45/d82/df6/d27/d33/dc0/c11f 0 2024-09-17T01:56:31.200 INFO:tasks.workunit.client.0.smithi063.stdout:5/915: dwrite d6/d37/d19/d76/d8f/de0/de5/d4f/fb9 [0,4194304] 0 2024-09-17T01:56:31.201 INFO:tasks.workunit.client.0.smithi063.stdout:6/854: link dc/d14/l2c dc/d14/d19/d20/d32/d52/d5a/l116 0 2024-09-17T01:56:31.202 INFO:tasks.workunit.client.0.smithi063.stdout:5/916: mknod d6/d35/dc1/d29/d36/d10c/c129 0 2024-09-17T01:56:31.202 INFO:tasks.workunit.client.0.smithi063.stdout:3/885: fsync df/d12/d43/d50/d58/fbd 0 2024-09-17T01:56:31.202 INFO:tasks.workunit.client.0.smithi063.stdout:6/855: mknod dc/d14/d18/d74/dd8/c117 0 2024-09-17T01:56:31.203 INFO:tasks.workunit.client.0.smithi063.stdout:3/886: dread - df/d12/d30/fe7 zero size 2024-09-17T01:56:31.205 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:31.205+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:31.205 INFO:tasks.workunit.client.0.smithi063.stdout:5/917: link d6/d9/d32/d8c/da7/ff2 d6/d35/dc1/d29/d36/f12a 0 2024-09-17T01:56:31.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/887: mkdir df/d12/d2d/ddc/df5/d131 0 2024-09-17T01:56:31.207 INFO:tasks.workunit.client.0.smithi063.stdout:5/918: chown d6/d37/d19/d76 16 1 2024-09-17T01:56:31.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/856: write dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/fc3 [287079,14445] 0 2024-09-17T01:56:31.209 INFO:tasks.workunit.client.0.smithi063.stdout:9/860: dwrite d9/d8d/d2a/d40/dac/dc2/dde/fe8 [0,4194304] 0 2024-09-17T01:56:31.209 INFO:tasks.workunit.client.0.smithi063.stdout:4/931: sync 2024-09-17T01:56:31.209 INFO:tasks.workunit.client.0.smithi063.stdout:7/879: sync 2024-09-17T01:56:31.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/888: write df/d12/d1e/d53/fc0 [960266,72156] 0 2024-09-17T01:56:31.210 INFO:tasks.workunit.client.0.smithi063.stdout:5/919: fsync d6/d35/dc1/d3f/dac/f122 0 2024-09-17T01:56:31.210 INFO:tasks.workunit.client.0.smithi063.stdout:0/836: dwrite d1/d3/db/d18/f30 [0,4194304] 0 2024-09-17T01:56:31.211 INFO:tasks.workunit.client.0.smithi063.stdout:8/756: dwrite d1/d7/d28/d2a/d37/f78 [0,4194304] 0 2024-09-17T01:56:31.211 INFO:tasks.workunit.client.0.smithi063.stdout:5/920: fdatasync d6/d35/f124 0 2024-09-17T01:56:31.211 INFO:tasks.workunit.client.0.smithi063.stdout:0/837: readlink d1/d1d/d74/lf1 0 2024-09-17T01:56:31.212 INFO:tasks.workunit.client.0.smithi063.stdout:3/889: write df/d12/d1e/d39/f91 [481911,118159] 0 2024-09-17T01:56:31.213 INFO:tasks.workunit.client.0.smithi063.stdout:7/880: rmdir d2/d15/d2f/d45/d82/df6/d22/db6 39 2024-09-17T01:56:31.213 INFO:tasks.workunit.client.0.smithi063.stdout:9/861: link d9/de/fa6 d9/d8d/d2a/d40/f133 0 2024-09-17T01:56:31.214 INFO:tasks.workunit.client.0.smithi063.stdout:4/932: rename de/d17/d1b/d9e/f109 to de/d17/d1b/dc7/d28/f129 0 2024-09-17T01:56:31.214 INFO:tasks.workunit.client.0.smithi063.stdout:9/862: fsync d9/de/dcf/f102 0 2024-09-17T01:56:31.215 INFO:tasks.workunit.client.0.smithi063.stdout:3/890: getdents df/d83 0 2024-09-17T01:56:31.215 INFO:tasks.workunit.client.0.smithi063.stdout:5/921: dread - d6/d37/d19/d76/d8f/de0/de5/d4f/d116/dc8/fe7 zero size 2024-09-17T01:56:31.215 INFO:tasks.workunit.client.0.smithi063.stdout:8/757: rename d1/d27/d81/l92 to d1/d27/d81/da4/dc7/lea 0 2024-09-17T01:56:31.215 INFO:tasks.workunit.client.0.smithi063.stdout:7/881: rmdir d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b 39 2024-09-17T01:56:31.215 INFO:tasks.workunit.client.0.smithi063.stdout:2/826: dread d3/d2a/f73 [0,4194304] 0 2024-09-17T01:56:31.216 INFO:tasks.workunit.client.0.smithi063.stdout:4/933: mkdir de/d17/d1b/dc7/d28/d8d/d12a 0 2024-09-17T01:56:31.216 INFO:tasks.workunit.client.0.smithi063.stdout:4/934: dread - de/d17/d36/dbe/d9a/f11b zero size 2024-09-17T01:56:31.217 INFO:tasks.workunit.client.0.smithi063.stdout:7/882: creat d2/d15/d2f/d52/d97/f120 x:0 0 0 2024-09-17T01:56:31.217 INFO:tasks.workunit.client.0.smithi063.stdout:5/922: mknod d6/d9/d32/d8c/da7/da9/df3/c12b 0 2024-09-17T01:56:31.217 INFO:tasks.workunit.client.0.smithi063.stdout:2/827: mknod d3/d28/c105 0 2024-09-17T01:56:31.217 INFO:tasks.workunit.client.0.smithi063.stdout:8/758: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f58 413 1 2024-09-17T01:56:31.217 INFO:tasks.workunit.client.0.smithi063.stdout:9/863: truncate d9/d8d/d2a/d40/dac/dc2/dde/fe8 5015428 0 2024-09-17T01:56:31.218 INFO:tasks.workunit.client.0.smithi063.stdout:7/883: read - d2/d15/d2f/d45/d82/df6/d27/d39/deb/f11c zero size 2024-09-17T01:56:31.220 INFO:tasks.workunit.client.0.smithi063.stdout:4/935: mkdir de/d17/d1b/dc7/d28/d8d/d12a/d12b 0 2024-09-17T01:56:31.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/864: write d9/d8d/d2a/d36/f84 [135597,102967] 0 2024-09-17T01:56:31.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/865: fdatasync d9/de/d20/d1b/d25/d73/fdd 0 2024-09-17T01:56:31.221 INFO:tasks.workunit.client.0.smithi063.stdout:3/891: truncate df/d12/d43/d50/d58/d97/fb7 680030 0 2024-09-17T01:56:31.223 INFO:tasks.workunit.client.0.smithi063.stdout:4/936: creat de/d17/d36/dbe/dbc/f12c x:0 0 0 2024-09-17T01:56:31.223 INFO:tasks.workunit.client.0.smithi063.stdout:3/892: rmdir df/d83 39 2024-09-17T01:56:31.223 INFO:tasks.workunit.client.0.smithi063.stdout:9/866: creat d9/de/d20/f134 x:0 0 0 2024-09-17T01:56:31.224 INFO:tasks.workunit.client.0.smithi063.stdout:3/893: fdatasync df/d28/f118 0 2024-09-17T01:56:31.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/937: dread - de/d17/d36/f100 zero size 2024-09-17T01:56:31.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/828: dwrite d3/d7/df/d43/f55 [4194304,4194304] 0 2024-09-17T01:56:31.224 INFO:tasks.workunit.client.0.smithi063.stdout:9/867: chown d9/de/d20/c7a 151 1 2024-09-17T01:56:31.226 INFO:tasks.workunit.client.0.smithi063.stdout:4/938: rename de/d17/d36/f7a to de/d17/df3/f12d 0 2024-09-17T01:56:31.226 INFO:tasks.workunit.client.0.smithi063.stdout:3/894: mkdir df/d12/d3a/df7/d116/d132 0 2024-09-17T01:56:31.226 INFO:tasks.workunit.client.0.smithi063.stdout:9/868: mknod d9/d8d/ddf/d10a/c135 0 2024-09-17T01:56:31.227 INFO:tasks.workunit.client.0.smithi063.stdout:7/884: dwrite d2/d15/d2f/d45/d82/df6/d22/d3a/f62 [4194304,4194304] 0 2024-09-17T01:56:31.227 INFO:tasks.workunit.client.0.smithi063.stdout:2/829: symlink d3/d28/l106 0 2024-09-17T01:56:31.227 INFO:tasks.workunit.client.0.smithi063.stdout:3/895: stat df/d12/d43/d50/d58/d97/daa/c10f 0 2024-09-17T01:56:31.228 INFO:tasks.workunit.client.0.smithi063.stdout:2/830: chown d3/d2a/dac/ff1 3863709 1 2024-09-17T01:56:31.228 INFO:tasks.workunit.client.0.smithi063.stdout:7/885: write d2/d15/d2f/d45/d48/f7f [839637,97695] 0 2024-09-17T01:56:31.230 INFO:tasks.workunit.client.0.smithi063.stdout:7/886: mknod d2/d15/d2f/d3e/d10e/dd4/c121 0 2024-09-17T01:56:31.230 INFO:tasks.workunit.client.0.smithi063.stdout:7/887: chown c0 3312869 1 2024-09-17T01:56:31.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/838: read d1/d3/db/d6e/d86/dcc/d53/d62/f9d [1549534,46462] 0 2024-09-17T01:56:31.234 INFO:tasks.workunit.client.0.smithi063.stdout:7/888: mknod d2/d15/d2f/d45/d82/df6/d27/d39/c122 0 2024-09-17T01:56:31.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/869: write d9/d8d/d2a/d40/f133 [1834285,46506] 0 2024-09-17T01:56:31.235 INFO:tasks.workunit.client.0.smithi063.stdout:0/839: mknod d1/d3/dc6/c112 0 2024-09-17T01:56:31.237 INFO:tasks.workunit.client.0.smithi063.stdout:9/870: fsync d9/de/dcf/fd2 0 2024-09-17T01:56:31.237 INFO:tasks.workunit.client.0.smithi063.stdout:7/889: chown d2/d15/d2f/f3d 188269621 1 2024-09-17T01:56:31.237 INFO:tasks.workunit.client.0.smithi063.stdout:3/896: dwrite df/d12/d43/d50/de6/f122 [0,4194304] 0 2024-09-17T01:56:31.239 INFO:tasks.workunit.client.0.smithi063.stdout:0/840: write d1/d3/db/f3e [1978102,106574] 0 2024-09-17T01:56:31.239 INFO:tasks.workunit.client.0.smithi063.stdout:6/857: dread dc/d14/fc4 [0,4194304] 0 2024-09-17T01:56:31.239 INFO:tasks.workunit.client.0.smithi063.stdout:2/831: dwrite d3/d7/d76/f77 [0,4194304] 0 2024-09-17T01:56:31.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/871: write d9/de/d20/f11b [362101,108972] 0 2024-09-17T01:56:31.240 INFO:tasks.workunit.client.0.smithi063.stdout:3/897: chown df/d12/d1e/d39/c6d 5 1 2024-09-17T01:56:31.241 INFO:tasks.workunit.client.0.smithi063.stdout:2/832: fsync d3/d7/df/d30/f104 0 2024-09-17T01:56:31.242 INFO:tasks.workunit.client.0.smithi063.stdout:6/858: mkdir dc/d14/d19/d118 0 2024-09-17T01:56:31.242 INFO:tasks.workunit.client.0.smithi063.stdout:9/872: creat d9/f136 x:0 0 0 2024-09-17T01:56:31.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/898: rmdir df/d12/d1e/d5e 39 2024-09-17T01:56:31.242 INFO:tasks.workunit.client.0.smithi063.stdout:7/890: mkdir d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/d123 0 2024-09-17T01:56:31.243 INFO:tasks.workunit.client.0.smithi063.stdout:2/833: mkdir d3/d28/d72/dd5/d107 0 2024-09-17T01:56:31.243 INFO:tasks.workunit.client.0.smithi063.stdout:0/841: mknod d1/d3/db/d6e/d86/dcc/d53/d62/c113 0 2024-09-17T01:56:31.243 INFO:tasks.workunit.client.0.smithi063.stdout:4/939: dwrite de/d17/f23 [0,4194304] 0 2024-09-17T01:56:31.243 INFO:tasks.workunit.client.0.smithi063.stdout:3/899: chown df/d12/d3a/c110 15028 1 2024-09-17T01:56:31.244 INFO:tasks.workunit.client.0.smithi063.stdout:4/940: read - de/d17/d36/dbe/dbc/f12c zero size 2024-09-17T01:56:31.246 INFO:tasks.workunit.client.0.smithi063.stdout:3/900: creat df/d12/d2d/ddc/f133 x:0 0 0 2024-09-17T01:56:31.246 INFO:tasks.workunit.client.0.smithi063.stdout:7/891: mknod d2/d15/d2f/d45/d82/df6/d27/d65/dd2/c124 0 2024-09-17T01:56:31.246 INFO:tasks.workunit.client.0.smithi063.stdout:4/941: rename de/d2d/d3c/f87 to de/d2d/d3c/dd0/f12e 0 2024-09-17T01:56:31.246 INFO:tasks.workunit.client.0.smithi063.stdout:2/834: mkdir d3/d7/d76/d108 0 2024-09-17T01:56:31.247 INFO:tasks.workunit.client.0.smithi063.stdout:4/942: rmdir de/de3 0 2024-09-17T01:56:31.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/901: write df/d12/d30/f47 [2042808,102266] 0 2024-09-17T01:56:31.248 INFO:tasks.workunit.client.0.smithi063.stdout:0/842: truncate d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/feb 843751 0 2024-09-17T01:56:31.249 INFO:tasks.workunit.client.0.smithi063.stdout:4/943: rename de/d17/d1b/dc7/d28/d8d/d12a to de/d2d/d3c/dd0/d12f 0 2024-09-17T01:56:31.249 INFO:tasks.workunit.client.0.smithi063.stdout:3/902: truncate df/d12/d1e/d39/f6c 254968 0 2024-09-17T01:56:31.250 INFO:tasks.workunit.client.0.smithi063.stdout:2/835: write d3/d7/fb8 [885694,60711] 0 2024-09-17T01:56:31.251 INFO:tasks.workunit.client.0.smithi063.stdout:2/836: mknod d3/d28/d72/c109 0 2024-09-17T01:56:31.251 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:31.252 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:31.252 INFO:tasks.workunit.client.0.smithi063.stdout:2/837: readlink d3/d7/df/d5a/l6b 0 2024-09-17T01:56:31.254 INFO:tasks.workunit.client.0.smithi063.stdout:7/892: dwrite d2/d15/d2f/d45/d82/df6/d67/f75 [0,4194304] 0 2024-09-17T01:56:31.255 INFO:tasks.workunit.client.0.smithi063.stdout:4/944: dwrite de/d2d/d52/d9c/f11e [0,4194304] 0 2024-09-17T01:56:31.255 INFO:tasks.workunit.client.0.smithi063.stdout:4/945: chown f8 1719 1 2024-09-17T01:56:31.257 INFO:tasks.workunit.client.0.smithi063.stdout:7/893: creat d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/f125 x:0 0 0 2024-09-17T01:56:31.258 INFO:tasks.workunit.client.0.smithi063.stdout:7/894: truncate d2/d15/d2f/d45/d82/df6/d22/d3a/f88 1565158 0 2024-09-17T01:56:31.259 INFO:tasks.workunit.client.0.smithi063.stdout:8/759: sync 2024-09-17T01:56:31.259 INFO:tasks.workunit.client.0.smithi063.stdout:9/873: sync 2024-09-17T01:56:31.260 INFO:tasks.workunit.client.0.smithi063.stdout:9/874: rename d9/de/d20/l76 to d9/d8d/d2a/d36/ded/l137 0 2024-09-17T01:56:31.261 INFO:tasks.workunit.client.0.smithi063.stdout:9/875: chown d9/d8d/d2a/d40/dac/dc2/dde/fe8 860 1 2024-09-17T01:56:31.261 INFO:tasks.workunit.client.0.smithi063.stdout:9/876: chown d9/de/d20/d1b/db7 12418 1 2024-09-17T01:56:31.263 INFO:tasks.workunit.client.0.smithi063.stdout:9/877: write d9/d8d/d2a/f35 [233185,131054] 0 2024-09-17T01:56:31.264 INFO:tasks.workunit.client.0.smithi063.stdout:9/878: unlink d9/de/d20/d1b/d25/c41 0 2024-09-17T01:56:31.265 INFO:tasks.workunit.client.0.smithi063.stdout:8/760: dwrite d1/f2 [4194304,4194304] 0 2024-09-17T01:56:31.265 INFO:tasks.workunit.client.0.smithi063.stdout:9/879: creat d9/de/d33/df5/f138 x:0 0 0 2024-09-17T01:56:31.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/946: fdatasync de/d17/f23 0 2024-09-17T01:56:31.266 INFO:tasks.workunit.client.0.smithi063.stdout:9/880: write d9/d8d/d2a/fcb [1032782,9350] 0 2024-09-17T01:56:31.267 INFO:tasks.workunit.client.0.smithi063.stdout:4/947: write de/d17/d36/dbe/f91 [4131430,27897] 0 2024-09-17T01:56:31.267 INFO:tasks.workunit.client.0.smithi063.stdout:9/881: stat d9/d8d/d2a 0 2024-09-17T01:56:31.267 INFO:tasks.workunit.client.0.smithi063.stdout:9/882: fdatasync d9/de/f2f 0 2024-09-17T01:56:31.268 INFO:tasks.workunit.client.0.smithi063.stdout:4/948: mknod de/d17/dc6/c130 0 2024-09-17T01:56:31.269 INFO:tasks.workunit.client.0.smithi063.stdout:2/838: sync 2024-09-17T01:56:31.269 INFO:tasks.workunit.client.0.smithi063.stdout:3/903: sync 2024-09-17T01:56:31.269 INFO:tasks.workunit.client.0.smithi063.stdout:4/949: read de/d2d/d52/d9c/fb9 [1246515,69986] 0 2024-09-17T01:56:31.270 INFO:tasks.workunit.client.0.smithi063.stdout:2/839: truncate d3/d28/d72/dd5/fe0 436714 0 2024-09-17T01:56:31.270 INFO:tasks.workunit.client.0.smithi063.stdout:3/904: truncate df/d12/d2d/fa1 143501 0 2024-09-17T01:56:31.270 INFO:tasks.workunit.client.0.smithi063.stdout:4/950: creat de/d17/d1b/dc7/d28/d8d/f131 x:0 0 0 2024-09-17T01:56:31.272 INFO:tasks.workunit.client.0.smithi063.stdout:3/905: creat df/d28/f134 x:0 0 0 2024-09-17T01:56:31.272 INFO:tasks.workunit.client.0.smithi063.stdout:2/840: write d3/d7/d38/da9/d102/fb0 [978522,50130] 0 2024-09-17T01:56:31.272 INFO:tasks.workunit.client.0.smithi063.stdout:8/761: truncate d1/fb5 409463 0 2024-09-17T01:56:31.272 INFO:tasks.workunit.client.0.smithi063.stdout:9/883: truncate d9/de/d20/d1b/d25/d73/fe3 98203 0 2024-09-17T01:56:31.272 INFO:tasks.workunit.client.0.smithi063.stdout:4/951: chown de/d17/d36/dbe/da6/ldc 376 1 2024-09-17T01:56:31.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/952: symlink de/d17/d36/l132 0 2024-09-17T01:56:31.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/841: chown d3/d7/d8d/lc7 0 1 2024-09-17T01:56:31.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/953: creat de/f133 x:0 0 0 2024-09-17T01:56:31.274 INFO:tasks.workunit.client.0.smithi063.stdout:8/762: getdents d1/d7/d28/d87 0 2024-09-17T01:56:31.274 INFO:tasks.workunit.client.0.smithi063.stdout:9/884: getdents d9/d8d/d2a/d40/dac/dc2 0 2024-09-17T01:56:31.274 INFO:tasks.workunit.client.0.smithi063.stdout:2/842: creat d3/f10a x:0 0 0 2024-09-17T01:56:31.275 INFO:tasks.workunit.client.0.smithi063.stdout:9/885: chown d9/de/d20/d37/d42/f6b 30106 1 2024-09-17T01:56:31.278 INFO:tasks.workunit.client.0.smithi063.stdout:3/906: dwrite df/d12/d43/d50/d58/f6b [0,4194304] 0 2024-09-17T01:56:31.279 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:31.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/907: fsync df/d12/d43/f69 0 2024-09-17T01:56:31.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/908: dread - df/d12/d43/d50/d58/d97/fdb zero size 2024-09-17T01:56:31.282 INFO:tasks.workunit.client.0.smithi063.stdout:4/954: dwrite de/d17/d36/dbe/da6/fba [0,4194304] 0 2024-09-17T01:56:31.282 INFO:tasks.workunit.client.0.smithi063.stdout:5/923: dread d6/d35/dc1/d69/f7a [0,4194304] 0 2024-09-17T01:56:31.283 INFO:tasks.workunit.client.0.smithi063.stdout:3/909: truncate df/d12/d43/d50/d58/d97/fb7 583391 0 2024-09-17T01:56:31.284 INFO:tasks.workunit.client.0.smithi063.stdout:4/955: truncate de/f57 3484002 0 2024-09-17T01:56:31.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/910: chown df/d12/d2d/l41 761812 1 2024-09-17T01:56:31.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/956: getdents de/d17/d36/de7 0 2024-09-17T01:56:31.286 INFO:tasks.workunit.client.0.smithi063.stdout:5/924: creat d6/d37/d19/d76/d8f/de0/de5/d4f/d116/f12c x:0 0 0 2024-09-17T01:56:31.287 INFO:tasks.workunit.client.0.smithi063.stdout:5/925: mkdir d6/d9/d32/dbb/d12d 0 2024-09-17T01:56:31.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/886: truncate d9/d8d/d2a/d36/f78 2602915 0 2024-09-17T01:56:31.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/926: write d6/d9/d13/d1d/f8b [676880,17991] 0 2024-09-17T01:56:31.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/887: link d9/d8d/d2a/d40/f71 d9/de/d20/d32/f139 0 2024-09-17T01:56:31.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/927: getdents d6/d9/d32 0 2024-09-17T01:56:31.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/957: dwrite de/f3b [0,4194304] 0 2024-09-17T01:56:31.292 INFO:tasks.workunit.client.0.smithi063.stdout:5/928: mkdir d6/d35/dc1/d29/d36/de1/d12e 0 2024-09-17T01:56:31.292 INFO:tasks.workunit.client.0.smithi063.stdout:0/843: dread d1/d3/db/d4b/f66 [0,4194304] 0 2024-09-17T01:56:31.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/888: creat d9/de/d20/f13a x:0 0 0 2024-09-17T01:56:31.293 INFO:tasks.workunit.client.0.smithi063.stdout:5/929: symlink d6/d35/dc1/d69/l12f 0 2024-09-17T01:56:31.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/958: write f8 [4633746,45067] 0 2024-09-17T01:56:31.294 INFO:tasks.workunit.client.0.smithi063.stdout:9/889: rmdir d9/d27 39 2024-09-17T01:56:31.297 INFO:tasks.workunit.client.0.smithi063.stdout:5/930: rmdir d6/d37/d19/d50 39 2024-09-17T01:56:31.297 INFO:tasks.workunit.client.0.smithi063.stdout:0/844: fdatasync d1/d3/db/d18/f5b 0 2024-09-17T01:56:31.297 INFO:tasks.workunit.client.0.smithi063.stdout:0/845: write d1/d3/db/d4b/d98/fab [670848,22388] 0 2024-09-17T01:56:31.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/890: mkdir d9/de/d20/d37/d42/d13b 0 2024-09-17T01:56:31.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/959: readlink de/d17/d36/l3f 0 2024-09-17T01:56:31.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/931: rmdir d6/d37/d19/d76/d8f/de0/de5/d31 39 2024-09-17T01:56:31.299 INFO:tasks.workunit.client.0.smithi063.stdout:0/846: mkdir d1/d1d/d74/d114 0 2024-09-17T01:56:31.299 INFO:tasks.workunit.client.0.smithi063.stdout:9/891: mkdir d9/de/d33/df5/d13c 0 2024-09-17T01:56:31.300 INFO:tasks.workunit.client.0.smithi063.stdout:8/763: dread d1/d7/d28/d2a/d37/d3a/f3c [0,4194304] 0 2024-09-17T01:56:31.300 INFO:tasks.workunit.client.0.smithi063.stdout:2/843: sync 2024-09-17T01:56:31.301 INFO:tasks.workunit.client.0.smithi063.stdout:6/859: dread dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/fc0 [0,4194304] 0 2024-09-17T01:56:31.302 INFO:tasks.workunit.client.0.smithi063.stdout:9/892: write d9/de/d20/d1b/d25/f4e [1479616,9147] 0 2024-09-17T01:56:31.303 INFO:tasks.workunit.client.0.smithi063.stdout:8/764: truncate d1/d7/d28/d2a/d37/fcd 1876004 0 2024-09-17T01:56:31.303 INFO:tasks.workunit.client.0.smithi063.stdout:2/844: symlink d3/d7/d8d/dc0/l10b 0 2024-09-17T01:56:31.303 INFO:tasks.workunit.client.0.smithi063.stdout:0/847: link d1/d3/db/d6e/d107/c10a d1/d3/d32/d63/c115 0 2024-09-17T01:56:31.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/960: dwrite de/d2d/d3c/ff4 [0,4194304] 0 2024-09-17T01:56:31.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/845: rmdir d3/d7/d38/da9/d102/de9 39 2024-09-17T01:56:31.306 INFO:tasks.workunit.client.0.smithi063.stdout:8/765: mknod d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/ceb 0 2024-09-17T01:56:31.306 INFO:tasks.workunit.client.0.smithi063.stdout:7/895: dread d2/d15/d2f/d45/d82/df6/d17/f79 [0,4194304] 0 2024-09-17T01:56:31.306 INFO:tasks.workunit.client.0.smithi063.stdout:0/848: creat d1/d1d/f116 x:0 0 0 2024-09-17T01:56:31.308 INFO:tasks.workunit.client.0.smithi063.stdout:7/896: write d2/d15/d2f/d45/d82/df6/d27/d39/f8a [4073003,53959] 0 2024-09-17T01:56:31.308 INFO:tasks.workunit.client.0.smithi063.stdout:8/766: symlink d1/d7/d28/d2a/d53/lec 0 2024-09-17T01:56:31.311 INFO:tasks.workunit.client.0.smithi063.stdout:8/767: mknod d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/ced 0 2024-09-17T01:56:31.312 INFO:tasks.workunit.client.0.smithi063.stdout:6/860: dread dc/d14/d19/d20/d32/d68/db4/dc6/de5/f105 [0,4194304] 0 2024-09-17T01:56:31.314 INFO:tasks.workunit.client.0.smithi063.stdout:8/768: chown d1/d7/d28/d2a/le8 44414 1 2024-09-17T01:56:31.314 INFO:tasks.workunit.client.0.smithi063.stdout:6/861: chown dc/d1b/f41 1 1 2024-09-17T01:56:31.314 INFO:tasks.workunit.client.0.smithi063.stdout:3/911: dread df/d12/d43/d50/d58/d97/daa/fe9 [0,4194304] 0 2024-09-17T01:56:31.316 INFO:tasks.workunit.client.0.smithi063.stdout:5/932: dwrite d6/d35/dc1/d3f/fce [0,4194304] 0 2024-09-17T01:56:31.316 INFO:tasks.workunit.client.0.smithi063.stdout:3/912: unlink df/d12/d43/d50/f86 0 2024-09-17T01:56:31.316 INFO:tasks.workunit.client.0.smithi063.stdout:0/849: dwrite d1/d3/db/d18/f95 [0,4194304] 0 2024-09-17T01:56:31.317 INFO:tasks.workunit.client.0.smithi063.stdout:3/913: stat df/d12/d43/d50/d58/d97/daa/c11f 0 2024-09-17T01:56:31.318 INFO:tasks.workunit.client.0.smithi063.stdout:0/850: fdatasync d1/d3/db/d4b/d82/fb4 0 2024-09-17T01:56:31.318 INFO:tasks.workunit.client.0.smithi063.stdout:6/862: getdents dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/de6 0 2024-09-17T01:56:31.318 INFO:tasks.workunit.client.0.smithi063.stdout:8/769: link d1/d7/c29 d1/d7/d28/d2a/cee 0 2024-09-17T01:56:31.318 INFO:tasks.workunit.client.0.smithi063.stdout:3/914: chown c6 56468680 1 2024-09-17T01:56:31.319 INFO:tasks.workunit.client.0.smithi063.stdout:0/851: mknod d1/d3/db/d4b/d98/d110/c117 0 2024-09-17T01:56:31.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/863: rename dc/d1b/ffe to dc/d14/d19/d20/d32/d52/f119 0 2024-09-17T01:56:31.320 INFO:tasks.workunit.client.0.smithi063.stdout:8/770: truncate d1/d7/d1d/f40 1456108 0 2024-09-17T01:56:31.321 INFO:tasks.workunit.client.0.smithi063.stdout:9/893: dread d9/de/f2f [0,4194304] 0 2024-09-17T01:56:31.321 INFO:tasks.workunit.client.0.smithi063.stdout:3/915: link df/d12/f16 df/d12/d1e/d39/f135 0 2024-09-17T01:56:31.321 INFO:tasks.workunit.client.0.smithi063.stdout:9/894: fdatasync d9/d8d/d2a/d36/ded/f123 0 2024-09-17T01:56:31.322 INFO:tasks.workunit.client.0.smithi063.stdout:8/771: rmdir d1/d7/d28/d2a/d37/d3a 39 2024-09-17T01:56:31.322 INFO:tasks.workunit.client.0.smithi063.stdout:3/916: write df/d12/d43/d50/dfb/fa9 [428360,93708] 0 2024-09-17T01:56:31.322 INFO:tasks.workunit.client.0.smithi063.stdout:9/895: write d9/faf [421971,40149] 0 2024-09-17T01:56:31.322 INFO:tasks.workunit.client.0.smithi063.stdout:6/864: rename dc/d1b/cca to dc/d14/d18/d74/c11a 0 2024-09-17T01:56:31.323 INFO:tasks.workunit.client.0.smithi063.stdout:6/865: dread - dc/d14/d65/feb zero size 2024-09-17T01:56:31.325 INFO:tasks.workunit.client.0.smithi063.stdout:9/896: rename d9/de/d33/df5/d103/fda to d9/d8d/d2a/d40/dac/d111/f13d 0 2024-09-17T01:56:31.325 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.329+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.327 INFO:tasks.workunit.client.0.smithi063.stdout:0/852: dwrite d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/ff5 [0,4194304] 0 2024-09-17T01:56:31.327 INFO:tasks.workunit.client.0.smithi063.stdout:6/866: symlink dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/de6/l11b 0 2024-09-17T01:56:31.329 INFO:tasks.workunit.client.0.smithi063.stdout:0/853: symlink d1/d3/db/d6e/d107/l118 0 2024-09-17T01:56:31.329 INFO:tasks.workunit.client.0.smithi063.stdout:6/867: write dc/f12 [4537731,17761] 0 2024-09-17T01:56:31.331 INFO:tasks.workunit.client.0.smithi063.stdout:0/854: creat d1/d3/db/d6e/f119 x:0 0 0 2024-09-17T01:56:31.331 INFO:tasks.workunit.client.0.smithi063.stdout:8/772: truncate d1/d7/d1d/f77 1878775 0 2024-09-17T01:56:31.331 INFO:tasks.workunit.client.0.smithi063.stdout:6/868: write dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/fdc [708677,44] 0 2024-09-17T01:56:31.332 INFO:tasks.workunit.client.0.smithi063.stdout:2/846: sync 2024-09-17T01:56:31.332 INFO:tasks.workunit.client.0.smithi063.stdout:8/773: sync 2024-09-17T01:56:31.332 INFO:tasks.workunit.client.0.smithi063.stdout:5/933: sync 2024-09-17T01:56:31.332 INFO:tasks.workunit.client.0.smithi063.stdout:6/869: fsync dc/d14/d18/d74/f9d 0 2024-09-17T01:56:31.332 INFO:tasks.workunit.client.0.smithi063.stdout:6/870: sync 2024-09-17T01:56:31.333 INFO:tasks.workunit.client.0.smithi063.stdout:8/774: write d1/f2 [4392665,87592] 0 2024-09-17T01:56:31.334 INFO:tasks.workunit.client.0.smithi063.stdout:0/855: symlink d1/d3/db/d18/d85/d92/dd4/l11a 0 2024-09-17T01:56:31.334 INFO:tasks.workunit.client.0.smithi063.stdout:5/934: rmdir d6/d9/d32/d8c/da7 39 2024-09-17T01:56:31.334 INFO:tasks.workunit.client.0.smithi063.stdout:6/871: symlink dc/d14/d18/d74/l11c 0 2024-09-17T01:56:31.336 INFO:tasks.workunit.client.0.smithi063.stdout:5/935: truncate d6/d37/d19/d68/fbe 4728104 0 2024-09-17T01:56:31.336 INFO:tasks.workunit.client.0.smithi063.stdout:0/856: creat d1/d3/db/f11b x:0 0 0 2024-09-17T01:56:31.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/872: rmdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1 39 2024-09-17T01:56:31.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/961: dread de/d17/d1b/dc7/d28/d30/f61 [0,4194304] 0 2024-09-17T01:56:31.338 INFO:tasks.workunit.client.0.smithi063.stdout:9/897: truncate d9/de/d20/d1b/f1f 1623935 0 2024-09-17T01:56:31.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/936: read - d6/d37/d19/d76/d8f/de0/de5/d4f/d116/dc8/fe7 zero size 2024-09-17T01:56:31.338 INFO:tasks.workunit.client.0.smithi063.stdout:5/937: sync 2024-09-17T01:56:31.339 INFO:tasks.workunit.client.0.smithi063.stdout:0/857: getdents d1/d3/db/d18/d33/d83/db7/dd8 0 2024-09-17T01:56:31.339 INFO:tasks.workunit.client.0.smithi063.stdout:0/858: sync 2024-09-17T01:56:31.340 INFO:tasks.workunit.client.0.smithi063.stdout:5/938: creat d6/d35/dc1/f130 x:0 0 0 2024-09-17T01:56:31.341 INFO:tasks.workunit.client.0.smithi063.stdout:2/847: dwrite d3/d7/df/f2f [0,4194304] 0 2024-09-17T01:56:31.341 INFO:tasks.workunit.client.0.smithi063.stdout:4/962: rename de/d17/d36/dbe/fdf to de/d17/d1b/dc7/f134 0 2024-09-17T01:56:31.342 INFO:tasks.workunit.client.0.smithi063.stdout:8/775: dread d1/d7/d28/f51 [0,4194304] 0 2024-09-17T01:56:31.343 INFO:tasks.workunit.client.0.smithi063.stdout:3/917: dread df/d83/fc4 [0,4194304] 0 2024-09-17T01:56:31.344 INFO:tasks.workunit.client.0.smithi063.stdout:2/848: chown d3/d7/feb 432 1 2024-09-17T01:56:31.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/897: dread d2/d15/d2f/d45/d82/df6/d27/f32 [0,4194304] 0 2024-09-17T01:56:31.344 INFO:tasks.workunit.client.0.smithi063.stdout:9/898: dread d9/de/d20/fa3 [0,4194304] 0 2024-09-17T01:56:31.347 INFO:tasks.workunit.client.0.smithi063.stdout:8/776: symlink d1/d7/d28/d2a/lef 0 2024-09-17T01:56:31.347 INFO:tasks.workunit.client.0.smithi063.stdout:5/939: rename d6/d37/d19/fcb to d6/d37/d19/d76/d8f/de0/de5/d4f/d116/f131 0 2024-09-17T01:56:31.347 INFO:tasks.workunit.client.0.smithi063.stdout:3/918: mknod df/d12/d43/c136 0 2024-09-17T01:56:31.348 INFO:tasks.workunit.client.0.smithi063.stdout:7/898: write d2/d15/d2f/d45/d82/df6/d27/d65/f6d [4762020,71271] 0 2024-09-17T01:56:31.348 INFO:tasks.workunit.client.0.smithi063.stdout:2/849: creat d3/d7/df/f10c x:0 0 0 2024-09-17T01:56:31.348 INFO:tasks.workunit.client.0.smithi063.stdout:9/899: chown d9/de/d20/d37/d42/f6b 52 1 2024-09-17T01:56:31.349 INFO:tasks.workunit.client.0.smithi063.stdout:8/777: write d1/d7/d28/d2a/d53/f55 [447431,14021] 0 2024-09-17T01:56:31.349 INFO:tasks.workunit.client.0.smithi063.stdout:2/850: dread - d3/d7/d38/da9/d102/fc3 zero size 2024-09-17T01:56:31.349 INFO:tasks.workunit.client.0.smithi063.stdout:3/919: link df/d83/fc4 df/d12/d3a/df7/f137 0 2024-09-17T01:56:31.350 INFO:tasks.workunit.client.0.smithi063.stdout:2/851: mknod d3/d7/df/d30/c10d 0 2024-09-17T01:56:31.351 INFO:tasks.workunit.client.0.smithi063.stdout:9/900: rename d9/de/d20/d1b/f6e to d9/de/d20/d37/f13e 0 2024-09-17T01:56:31.351 INFO:tasks.workunit.client.0.smithi063.stdout:3/920: rmdir df/d12/d43/d50/d58/d97/daa/db1/dd7 39 2024-09-17T01:56:31.351 INFO:tasks.workunit.client.0.smithi063.stdout:2/852: write d3/d7/d8d/dc0/fd8 [222452,71073] 0 2024-09-17T01:56:31.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/901: truncate d9/de/d33/ff0 937761 0 2024-09-17T01:56:31.352 INFO:tasks.workunit.client.0.smithi063.stdout:2/853: read d3/d7/f5b [3888472,102262] 0 2024-09-17T01:56:31.354 INFO:tasks.workunit.client.0.smithi063.stdout:8/778: write d1/d7/d28/d2a/d37/d3a/f3c [961946,52363] 0 2024-09-17T01:56:31.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/902: creat d9/de/d20/d1b/d25/d73/da4/f13f x:0 0 0 2024-09-17T01:56:31.354 INFO:tasks.workunit.client.0.smithi063.stdout:3/921: dread df/d12/d3a/f73 [0,4194304] 0 2024-09-17T01:56:31.356 INFO:tasks.workunit.client.0.smithi063.stdout:3/922: symlink df/l138 0 2024-09-17T01:56:31.356 INFO:tasks.workunit.client.0.smithi063.stdout:2/854: getdents d3/d7/d38/da9/d102/dfe 0 2024-09-17T01:56:31.356 INFO:tasks.workunit.client.0.smithi063.stdout:9/903: write d9/de/d20/fa3 [231678,81147] 0 2024-09-17T01:56:31.357 INFO:tasks.workunit.client.0.smithi063.stdout:7/899: dwrite d2/d15/d2f/d45/d82/df6/d22/f77 [0,4194304] 0 2024-09-17T01:56:31.359 INFO:tasks.workunit.client.0.smithi063.stdout:3/923: getdents df/d12/d1e/d5e 0 2024-09-17T01:56:31.360 INFO:tasks.workunit.client.0.smithi063.stdout:3/924: mkdir df/d12/d3a/d139 0 2024-09-17T01:56:31.360 INFO:tasks.workunit.client.0.smithi063.stdout:6/873: dread dc/d14/d19/d20/d32/d52/f5c [4194304,4194304] 0 2024-09-17T01:56:31.361 INFO:tasks.workunit.client.0.smithi063.stdout:3/925: chown df/d12/d30/db8 1657331905 1 2024-09-17T01:56:31.363 INFO:tasks.workunit.client.0.smithi063.stdout:0/859: dread d1/d3/db/d4b/d2f/d56/f57 [0,4194304] 0 2024-09-17T01:56:31.363 INFO:tasks.workunit.client.0.smithi063.stdout:3/926: chown df/d12/f16 42034698 1 2024-09-17T01:56:31.364 INFO:tasks.workunit.client.0.smithi063.stdout:6/874: creat dc/d14/d19/d20/d32/d52/d5a/f11d x:0 0 0 2024-09-17T01:56:31.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/855: dwrite d3/f8 [0,4194304] 0 2024-09-17T01:56:31.367 INFO:tasks.workunit.client.0.smithi063.stdout:4/963: dread de/d17/d36/d70/f8a [0,4194304] 0 2024-09-17T01:56:31.368 INFO:tasks.workunit.client.0.smithi063.stdout:8/779: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/fab [0,4194304] 0 2024-09-17T01:56:31.369 INFO:tasks.workunit.client.0.smithi063.stdout:3/927: mkdir df/d12/d43/d50/d58/db5/d13a 0 2024-09-17T01:56:31.369 INFO:tasks.workunit.client.0.smithi063.stdout:2/856: mkdir d3/d7/d38/da9/d102/dfe/d10e 0 2024-09-17T01:56:31.370 INFO:tasks.workunit.client.0.smithi063.stdout:8/780: read - d1/d7/d28/d87/fa8 zero size 2024-09-17T01:56:31.370 INFO:tasks.workunit.client.0.smithi063.stdout:4/964: chown de/d17/d1b/f4f 42088466 1 2024-09-17T01:56:31.370 INFO:tasks.workunit.client.0.smithi063.stdout:9/904: dwrite d9/d27/ff3 [0,4194304] 0 2024-09-17T01:56:31.371 INFO:tasks.workunit.client.0.smithi063.stdout:8/781: unlink d1/d27/f64 0 2024-09-17T01:56:31.371 INFO:tasks.workunit.client.0.smithi063.stdout:3/928: write df/d12/d43/d50/de6/fef [2891126,114311] 0 2024-09-17T01:56:31.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/965: stat de/d17/d36/dbe/l112 0 2024-09-17T01:56:31.373 INFO:tasks.workunit.client.0.smithi063.stdout:2/857: truncate d3/d7/df/d30/f90 480787 0 2024-09-17T01:56:31.373 INFO:tasks.workunit.client.0.smithi063.stdout:0/860: rename d1/d3/db/d6e/d86/dcc/d7c/d88/fe3 to d1/d3/db/d6e/d86/dcc/d53/d62/dcd/d100/f11c 0 2024-09-17T01:56:31.373 INFO:tasks.workunit.client.0.smithi063.stdout:9/905: creat d9/de/d20/d37/d42/f140 x:0 0 0 2024-09-17T01:56:31.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/966: fdatasync de/d17/d1b/dc7/d28/d98/ff5 0 2024-09-17T01:56:31.373 INFO:tasks.workunit.client.0.smithi063.stdout:2/858: rename d3/cc to d3/d7/df/d5a/c10f 0 2024-09-17T01:56:31.374 INFO:tasks.workunit.client.0.smithi063.stdout:9/906: mkdir d9/de/d20/d1b/d141 0 2024-09-17T01:56:31.374 INFO:tasks.workunit.client.0.smithi063.stdout:0/861: symlink d1/d3/db/d18/d33/d83/db7/dd8/l11d 0 2024-09-17T01:56:31.374 INFO:tasks.workunit.client.0.smithi063.stdout:9/907: chown d9/d8d 1129 1 2024-09-17T01:56:31.374 INFO:tasks.workunit.client.0.smithi063.stdout:2/859: symlink d3/d7/df/d43/l110 0 2024-09-17T01:56:31.375 INFO:tasks.workunit.client.0.smithi063.stdout:3/929: symlink df/d12/d30/db8/l13b 0 2024-09-17T01:56:31.375 INFO:tasks.workunit.client.0.smithi063.stdout:4/967: write de/d17/d36/dbe/dbc/fd8 [3628843,53891] 0 2024-09-17T01:56:31.376 INFO:tasks.workunit.client.0.smithi063.stdout:2/860: chown d3/d2a/f47 475852 1 2024-09-17T01:56:31.376 INFO:tasks.workunit.client.0.smithi063.stdout:0/862: rmdir d1/d3/db/d6e/d86 39 2024-09-17T01:56:31.377 INFO:tasks.workunit.client.0.smithi063.stdout:9/908: chown d9/d8d/d2a/f35 16110175 1 2024-09-17T01:56:31.377 INFO:tasks.workunit.client.0.smithi063.stdout:3/930: chown df/d12/d1e/l2c 0 1 2024-09-17T01:56:31.378 INFO:tasks.workunit.client.0.smithi063.stdout:4/968: chown de/f16 1158224 1 2024-09-17T01:56:31.378 INFO:tasks.workunit.client.0.smithi063.stdout:9/909: rmdir d9/d8d 39 2024-09-17T01:56:31.378 INFO:tasks.workunit.client.0.smithi063.stdout:2/861: symlink d3/d28/d72/dd5/de6/l111 0 2024-09-17T01:56:31.379 INFO:tasks.workunit.client.0.smithi063.stdout:0/863: fdatasync d1/d3/db/d6e/d86/fb1 0 2024-09-17T01:56:31.379 INFO:tasks.workunit.client.0.smithi063.stdout:9/910: mknod d9/d27/c142 0 2024-09-17T01:56:31.379 INFO:tasks.workunit.client.0.smithi063.stdout:8/782: dwrite d1/d7/f4c [4194304,4194304] 0 2024-09-17T01:56:31.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/940: dread d6/d9/f40 [0,4194304] 0 2024-09-17T01:56:31.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/862: fdatasync d3/d7/d38/da9/d102/f74 0 2024-09-17T01:56:31.385 INFO:tasks.workunit.client.0.smithi063.stdout:5/941: chown d6/d35/dc1/d3f/dac 531 1 2024-09-17T01:56:31.386 INFO:tasks.workunit.client.0.smithi063.stdout:6/875: dread dc/d14/d19/d20/d32/d52/d5a/d43/f6d [0,4194304] 0 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:9/911: mkdir d9/d8d/d2a/d40/dac/dc2/d132/d143 0 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/942: read d6/d35/dc1/d29/d36/f5b [6267662,3461] 0 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/863: creat d3/f112 x:0 0 0 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/969: dwrite de/f133 [0,4194304] 0 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:6/876: rmdir dc/d1b/d5e 39 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/864: write d3/f8 [4311328,48670] 0 2024-09-17T01:56:31.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/943: fsync d6/d37/d19/d76/d8f/de0/d117/ff7 0 2024-09-17T01:56:31.390 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:56:31.392 INFO:tasks.workunit.client.0.smithi063.stdout:9/912: truncate d9/de/d33/df5/f138 1025599 0 2024-09-17T01:56:31.393 INFO:tasks.workunit.client.0.smithi063.stdout:5/944: fdatasync d6/d35/dc1/d3f/fd4 0 2024-09-17T01:56:31.394 INFO:tasks.workunit.client.0.smithi063.stdout:6/877: creat dc/d14/d65/f11e x:0 0 0 2024-09-17T01:56:31.394 INFO:tasks.workunit.client.0.smithi063.stdout:4/970: creat de/d17/d1b/d124/f135 x:0 0 0 2024-09-17T01:56:31.394 INFO:tasks.workunit.client.0.smithi063.stdout:3/931: dwrite df/d12/d43/d50/d58/d97/daa/fde [0,4194304] 0 2024-09-17T01:56:31.395 INFO:tasks.workunit.client.0.smithi063.stdout:9/913: mkdir d9/dbf/d12d/d144 0 2024-09-17T01:56:31.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/914: truncate d9/d8d/d75/fdc 993253 0 2024-09-17T01:56:31.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/783: dwrite d1/d27/d82/fa9 [0,4194304] 0 2024-09-17T01:56:31.396 INFO:tasks.workunit.client.0.smithi063.stdout:3/932: write df/d12/d43/d50/d58/d97/daa/db1/dcc/fea [205996,51395] 0 2024-09-17T01:56:31.396 INFO:tasks.workunit.client.0.smithi063.stdout:6/878: truncate dc/d14/d19/d20/d32/d68/f7a 187999 0 2024-09-17T01:56:31.397 INFO:tasks.workunit.client.0.smithi063.stdout:3/933: truncate df/d12/d1e/f21 5124486 0 2024-09-17T01:56:31.401 INFO:tasks.workunit.client.0.smithi063.stdout:6/879: creat dc/d14/d2f/f11f x:0 0 0 2024-09-17T01:56:31.403 INFO:tasks.workunit.client.0.smithi063.stdout:8/784: creat d1/d27/d81/da4/dc7/ff0 x:0 0 0 2024-09-17T01:56:31.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/915: rename d9/de/d20/fa3 to d9/d8d/d2a/d36/ded/f145 0 2024-09-17T01:56:31.403 INFO:tasks.workunit.client.0.smithi063.stdout:2/865: getdents d3/dbc 0 2024-09-17T01:56:31.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/971: creat de/d2d/d3c/dd0/d12f/d12b/f136 x:0 0 0 2024-09-17T01:56:31.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/934: getdents df/d12/d3a/d7a 0 2024-09-17T01:56:31.405 INFO:tasks.workunit.client.0.smithi063.stdout:0/864: dread d1/f1e [0,4194304] 0 2024-09-17T01:56:31.406 INFO:tasks.workunit.client.0.smithi063.stdout:4/972: mknod de/d17/d36/dbe/c137 0 2024-09-17T01:56:31.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/866: creat d3/d7/d76/d108/f113 x:0 0 0 2024-09-17T01:56:31.406 INFO:tasks.workunit.client.0.smithi063.stdout:6/880: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/d102/d120 0 2024-09-17T01:56:31.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/916: symlink d9/de/d20/d1b/d25/d73/l146 0 2024-09-17T01:56:31.406 INFO:tasks.workunit.client.0.smithi063.stdout:3/935: write df/f26 [3384347,111947] 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:6/881: write f1 [2679208,80364] 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:8/785: dread d1/d7/d28/f51 [0,4194304] 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:4/973: creat de/d17/d36/d70/d77/f138 x:0 0 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:2/867: creat d3/d7/d8d/da4/f114 x:0 0 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/917: symlink d9/de/d20/l147 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:8/786: fsync d1/d7/d28/d2a/d53/f94 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:0/865: write d1/d3/db/d18/d85/da8/fcf [599912,25573] 0 2024-09-17T01:56:31.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/936: mknod df/d12/d1e/d53/d12c/c13c 0 2024-09-17T01:56:31.409 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.409+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.410 INFO:tasks.workunit.client.0.smithi063.stdout:0/866: stat d1/d3/d32/fe8 0 2024-09-17T01:56:31.410 INFO:tasks.workunit.client.0.smithi063.stdout:9/918: unlink d9/de/d20/c7a 0 2024-09-17T01:56:31.410 INFO:tasks.workunit.client.0.smithi063.stdout:6/882: creat dc/d14/d19/d20/d32/d52/d5a/d62/f121 x:0 0 0 2024-09-17T01:56:31.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/937: mknod df/d12/d3a/df7/d116/c13d 0 2024-09-17T01:56:31.410 INFO:tasks.workunit.client.0.smithi063.stdout:8/787: stat d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/c71 0 2024-09-17T01:56:31.410 INFO:tasks.workunit.client.0.smithi063.stdout:0/867: chown d1/d3/db/d4b/d2f/c90 26357868 1 2024-09-17T01:56:31.411 INFO:tasks.workunit.client.0.smithi063.stdout:6/883: write dc/d14/d18/d74/fb1 [434362,35288] 0 2024-09-17T01:56:31.411 INFO:tasks.workunit.client.0.smithi063.stdout:3/938: creat df/d12/f13e x:0 0 0 2024-09-17T01:56:31.411 INFO:tasks.workunit.client.0.smithi063.stdout:7/900: dread d2/d98/fbb [0,4194304] 0 2024-09-17T01:56:31.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/788: fsync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f3b 0 2024-09-17T01:56:31.413 INFO:tasks.workunit.client.0.smithi063.stdout:7/901: creat d2/d15/d2f/d45/d82/f126 x:0 0 0 2024-09-17T01:56:31.413 INFO:tasks.workunit.client.0.smithi063.stdout:6/884: link dc/d1b/f4b dc/d14/d18/d74/dc8/f122 0 2024-09-17T01:56:31.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/939: chown df/d12/d1e/d53/l78 63520353 1 2024-09-17T01:56:31.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/789: fsync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f2d 0 2024-09-17T01:56:31.416 INFO:tasks.workunit.client.0.smithi063.stdout:3/940: rmdir df/d12/d30/dd1 0 2024-09-17T01:56:31.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/919: dwrite d9/d8d/d2a/d36/f6f [4194304,4194304] 0 2024-09-17T01:56:31.419 INFO:tasks.workunit.client.0.smithi063.stdout:0/868: dwrite d1/d3/db/d6e/d86/dcc/d7c/db6/fdf [0,4194304] 0 2024-09-17T01:56:31.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/885: fsync dc/d14/d19/d20/d32/d52/d5a/d62/f121 0 2024-09-17T01:56:31.423 INFO:tasks.workunit.client.0.smithi063.stdout:2/868: truncate d3/d2a/fad 2837450 0 2024-09-17T01:56:31.423 INFO:tasks.workunit.client.0.smithi063.stdout:9/920: rmdir d9/de/d20/d1b/d25 39 2024-09-17T01:56:31.424 INFO:tasks.workunit.client.0.smithi063.stdout:8/790: dwrite d1/d7/d28/f45 [0,4194304] 0 2024-09-17T01:56:31.424 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:31.425 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:31.425 INFO:tasks.workunit.client.0.smithi063.stdout:0/869: creat d1/d3/d32/d63/f11e x:0 0 0 2024-09-17T01:56:31.426 INFO:tasks.workunit.client.0.smithi063.stdout:2/869: write d3/d7/d38/da9/fed [1287984,44200] 0 2024-09-17T01:56:31.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/886: dread - dc/d14/d18/d74/f9d zero size 2024-09-17T01:56:31.427 INFO:tasks.workunit.client.0.smithi063.stdout:2/870: chown d3/f91 11661171 1 2024-09-17T01:56:31.427 INFO:tasks.workunit.client.0.smithi063.stdout:9/921: mknod d9/de/dcf/c148 0 2024-09-17T01:56:31.428 INFO:tasks.workunit.client.0.smithi063.stdout:8/791: link d1/d7/d28/c95 d1/d7/d28/d2a/d37/d3a/cf1 0 2024-09-17T01:56:31.428 INFO:tasks.workunit.client.0.smithi063.stdout:2/871: fsync d3/d2a/dac/fff 0 2024-09-17T01:56:31.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/941: dwrite df/d12/d43/d50/de6/f117 [0,4194304] 0 2024-09-17T01:56:31.429 INFO:tasks.workunit.client.0.smithi063.stdout:9/922: fsync d9/de/d20/d37/d42/d7f/fb5 0 2024-09-17T01:56:31.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/792: truncate d1/d7/d28/d2a/d53/f94 767684 0 2024-09-17T01:56:31.431 INFO:tasks.workunit.client.0.smithi063.stdout:3/942: rmdir df/d12/d43/d50 39 2024-09-17T01:56:31.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/872: creat d3/d7/df/d30/f115 x:0 0 0 2024-09-17T01:56:31.432 INFO:tasks.workunit.client.0.smithi063.stdout:6/887: truncate dc/d14/d19/d20/d32/f54 1527748 0 2024-09-17T01:56:31.432 INFO:tasks.workunit.client.0.smithi063.stdout:3/943: write df/d12/d2d/f40 [1478074,80855] 0 2024-09-17T01:56:31.432 INFO:tasks.workunit.client.0.smithi063.stdout:6/888: chown dc/d14/d19/d20/d32/d52/d5a/d43/fe8 286 1 2024-09-17T01:56:31.432 INFO:tasks.workunit.client.0.smithi063.stdout:9/923: rename d9/de/d20/d37/d42/c99 to d9/d8d/d75/c149 0 2024-09-17T01:56:31.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/889: mknod dc/d14/d18/d74/dc8/c123 0 2024-09-17T01:56:31.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/924: creat d9/de/f14a x:0 0 0 2024-09-17T01:56:31.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/944: mknod df/d12/d43/d50/de6/c13f 0 2024-09-17T01:56:31.435 INFO:tasks.workunit.client.0.smithi063.stdout:9/925: symlink d9/d8d/l14b 0 2024-09-17T01:56:31.436 INFO:tasks.workunit.client.0.smithi063.stdout:0/870: read d1/d3/db/d18/d85/da8/ff4 [2167922,16147] 0 2024-09-17T01:56:31.436 INFO:tasks.workunit.client.0.smithi063.stdout:8/793: read d1/d7/d28/d2a/d44/f73 [2861703,114749] 0 2024-09-17T01:56:31.437 INFO:tasks.workunit.client.0.smithi063.stdout:2/873: dwrite d3/d7/d38/da9/d102/f59 [0,4194304] 0 2024-09-17T01:56:31.439 INFO:tasks.workunit.client.0.smithi063.stdout:8/794: mkdir d1/d7/d28/d87/df2 0 2024-09-17T01:56:31.440 INFO:tasks.workunit.client.0.smithi063.stdout:0/871: creat d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/f11f x:0 0 0 2024-09-17T01:56:31.440 INFO:tasks.workunit.client.0.smithi063.stdout:2/874: mknod d3/d28/d72/dd5/de6/c116 0 2024-09-17T01:56:31.441 INFO:tasks.workunit.client.0.smithi063.stdout:6/890: dwrite dc/d14/d19/f82 [0,4194304] 0 2024-09-17T01:56:31.441 INFO:tasks.workunit.client.0.smithi063.stdout:8/795: mkdir d1/d7/d28/d2a/d37/df3 0 2024-09-17T01:56:31.442 INFO:tasks.workunit.client.0.smithi063.stdout:0/872: mkdir d1/d3/db/d18/d85/d92/d120 0 2024-09-17T01:56:31.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:31.443 INFO:tasks.workunit.client.0.smithi063.stdout:8/796: fdatasync d1/d7/fcf 0 2024-09-17T01:56:31.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/875: getdents d3/d2a/dac 0 2024-09-17T01:56:31.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/926: dwrite d9/de/d20/d1b/d25/d73/fec [4194304,4194304] 0 2024-09-17T01:56:31.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/927: readlink d9/d27/dff/l62 0 2024-09-17T01:56:31.446 INFO:tasks.workunit.client.0.smithi063.stdout:8/797: fsync d1/d7/d28/d2a/d37/d3a/f3c 0 2024-09-17T01:56:31.447 INFO:tasks.workunit.client.0.smithi063.stdout:8/798: symlink d1/d27/lf4 0 2024-09-17T01:56:31.448 INFO:tasks.workunit.client.0.smithi063.stdout:6/891: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dde/dee/f124 x:0 0 0 2024-09-17T01:56:31.448 INFO:tasks.workunit.client.0.smithi063.stdout:9/928: link d9/de/d20/d1b/d25/l3e d9/d8d/d2a/d36/ded/l14c 0 2024-09-17T01:56:31.449 INFO:tasks.workunit.client.0.smithi063.stdout:8/799: mknod d1/d7/d28/d2a/d44/cf5 0 2024-09-17T01:56:31.449 INFO:tasks.workunit.client.0.smithi063.stdout:8/800: dread - d1/d7/fcf zero size 2024-09-17T01:56:31.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/902: dread d2/d15/d2f/d45/d82/df6/d27/d65/f6d [0,4194304] 0 2024-09-17T01:56:31.450 INFO:tasks.workunit.client.0.smithi063.stdout:0/873: dwrite d1/d3/db/d4b/f37 [0,4194304] 0 2024-09-17T01:56:31.451 INFO:tasks.workunit.client.0.smithi063.stdout:0/874: readlink d1/d3/db/d4b/ld0 0 2024-09-17T01:56:31.452 INFO:tasks.workunit.client.0.smithi063.stdout:6/892: fsync dc/d14/d18/d74/fd2 0 2024-09-17T01:56:31.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/876: dwrite d3/f112 [0,4194304] 0 2024-09-17T01:56:31.454 INFO:tasks.workunit.client.0.smithi063.stdout:6/893: creat dc/d14/d65/f125 x:0 0 0 2024-09-17T01:56:31.455 INFO:tasks.workunit.client.0.smithi063.stdout:2/877: mkdir d3/d7/d38/da9/d117 0 2024-09-17T01:56:31.455 INFO:tasks.workunit.client.0.smithi063.stdout:6/894: creat dc/d14/d65/ddd/f126 x:0 0 0 2024-09-17T01:56:31.456 INFO:tasks.workunit.client.0.smithi063.stdout:2/878: creat d3/d28/d72/f118 x:0 0 0 2024-09-17T01:56:31.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/929: dwrite d9/d8d/d2a/d40/fc1 [4194304,4194304] 0 2024-09-17T01:56:31.457 INFO:tasks.workunit.client.0.smithi063.stdout:6/895: unlink dc/d14/d19/d20/d32/d52/d5a/fd4 0 2024-09-17T01:56:31.457 INFO:tasks.workunit.client.0.smithi063.stdout:2/879: stat d3/d7/d76/ca5 0 2024-09-17T01:56:31.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/930: fsync d9/d8d/d2a/d40/fea 0 2024-09-17T01:56:31.458 INFO:tasks.workunit.client.0.smithi063.stdout:6/896: write dc/d14/d19/d20/d32/d68/f6c [9278560,61950] 0 2024-09-17T01:56:31.460 INFO:tasks.workunit.client.0.smithi063.stdout:2/880: symlink d3/d7/d38/da9/l119 0 2024-09-17T01:56:31.460 INFO:tasks.workunit.client.0.smithi063.stdout:6/897: truncate dc/d14/d18/d91/f10b 803043 0 2024-09-17T01:56:31.460 INFO:tasks.workunit.client.0.smithi063.stdout:8/801: dwrite d1/d7/d1d/f77 [0,4194304] 0 2024-09-17T01:56:31.461 INFO:tasks.workunit.client.0.smithi063.stdout:2/881: truncate d3/d7/d8d/da4/fb1 715329 0 2024-09-17T01:56:31.461 INFO:tasks.workunit.client.0.smithi063.stdout:8/802: read - d1/d7/d28/d2a/d44/d6e/fe7 zero size 2024-09-17T01:56:31.463 INFO:tasks.workunit.client.0.smithi063.stdout:8/803: truncate d1/d7/d28/d2a/d37/d3a/daf/fb8 915599 0 2024-09-17T01:56:31.466 INFO:tasks.workunit.client.0.smithi063.stdout:9/931: mknod d9/de/d20/d37/d42/d13b/c14d 0 2024-09-17T01:56:31.466 INFO:tasks.workunit.client.0.smithi063.stdout:6/898: symlink dc/d14/d19/d20/d32/d52/d5a/d43/dc5/l127 0 2024-09-17T01:56:31.467 INFO:tasks.workunit.client.0.smithi063.stdout:8/804: symlink d1/d7/d28/d87/df2/lf6 0 2024-09-17T01:56:31.468 INFO:tasks.workunit.client.0.smithi063.stdout:8/805: readlink d1/d7/d28/d2a/lef 0 2024-09-17T01:56:31.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/932: write d9/de/d20/d37/d42/d7f/fb5 [136849,46705] 0 2024-09-17T01:56:31.469 INFO:tasks.workunit.client.0.smithi063.stdout:2/882: dwrite d3/d7/df/d43/f55 [0,4194304] 0 2024-09-17T01:56:31.470 INFO:tasks.workunit.client.0.smithi063.stdout:2/883: chown d3/d7/df/d43/ldc 347 1 2024-09-17T01:56:31.470 INFO:tasks.workunit.client.0.smithi063.stdout:2/884: stat d3/dbc/cd6 0 2024-09-17T01:56:31.472 INFO:tasks.workunit.client.0.smithi063.stdout:2/885: mkdir d3/d7/df/d11a 0 2024-09-17T01:56:31.472 INFO:tasks.workunit.client.0.smithi063.stdout:9/933: getdents d9/d8d/d2a/d36 0 2024-09-17T01:56:31.472 INFO:tasks.workunit.client.0.smithi063.stdout:2/886: read - d3/d7/df/f10c zero size 2024-09-17T01:56:31.475 INFO:tasks.workunit.client.0.smithi063.stdout:6/899: dwrite dc/d14/d19/d20/d32/d52/f5c [4194304,4194304] 0 2024-09-17T01:56:31.475 INFO:tasks.workunit.client.0.smithi063.stdout:2/887: truncate d3/d7/df/d30/f115 370553 0 2024-09-17T01:56:31.476 INFO:tasks.workunit.client.0.smithi063.stdout:8/806: read d1/d7/d28/d2a/d53/f94 [537981,92451] 0 2024-09-17T01:56:31.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/888: truncate d3/d7/df/d30/f8e 1668511 0 2024-09-17T01:56:31.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/807: fdatasync d1/d27/d81/fbf 0 2024-09-17T01:56:31.479 INFO:tasks.workunit.client.0.smithi063.stdout:9/934: dwrite d9/de/ff [4194304,4194304] 0 2024-09-17T01:56:31.480 INFO:tasks.workunit.client.0.smithi063.stdout:9/935: stat d9/de/d20/d1b/d25/fd9 0 2024-09-17T01:56:31.481 INFO:tasks.workunit.client.0.smithi063.stdout:9/936: fsync d9/de/d33/df5/d103/d113/f126 0 2024-09-17T01:56:31.482 INFO:tasks.workunit.client.0.smithi063.stdout:2/889: link d3/d7/df/d43/f3b d3/d7/d76/d108/f11b 0 2024-09-17T01:56:31.485 INFO:tasks.workunit.client.0.smithi063.stdout:2/890: rename d3/d28/d72/dd5/de6/c116 to d3/d7/df/c11c 0 2024-09-17T01:56:31.485 INFO:tasks.workunit.client.0.smithi063.stdout:6/900: dwrite dc/d14/d19/d20/d32/d52/d5a/d97/db8/ff4 [0,4194304] 0 2024-09-17T01:56:31.486 INFO:tasks.workunit.client.0.smithi063.stdout:6/901: stat dc/d14/f70 0 2024-09-17T01:56:31.487 INFO:tasks.workunit.client.0.smithi063.stdout:6/902: getdents dc/d14/d19/d20/d32/d52/d5a/d97/d104 0 2024-09-17T01:56:31.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/937: dwrite d9/d27/ff3 [0,4194304] 0 2024-09-17T01:56:31.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/891: write d3/d7/d76/d108/f11b [1856863,15096] 0 2024-09-17T01:56:31.489 INFO:tasks.workunit.client.0.smithi063.stdout:9/938: creat d9/de/d20/d1b/d25/d12a/f14e x:0 0 0 2024-09-17T01:56:31.490 INFO:tasks.workunit.client.0.smithi063.stdout:6/903: rename dc/d14/d65/ddd/f126 to dc/d14/d19/d20/d32/d52/d5a/dd0/f128 0 2024-09-17T01:56:31.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/892: unlink d3/dbc/lcc 0 2024-09-17T01:56:31.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/893: fdatasync d3/f91 0 2024-09-17T01:56:31.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/894: chown d3/d28/d72/ca7 0 1 2024-09-17T01:56:31.491 INFO:tasks.workunit.client.0.smithi063.stdout:2/895: write d3/d7/d38/da9/d102/fc3 [386426,2126] 0 2024-09-17T01:56:31.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/896: creat d3/d28/d72/dd5/d107/f11d x:0 0 0 2024-09-17T01:56:31.493 INFO:tasks.workunit.client.0.smithi063.stdout:2/897: mkdir d3/d28/d72/d11e 0 2024-09-17T01:56:31.494 INFO:tasks.workunit.client.0.smithi063.stdout:0/875: dread d1/d3/d1b/d50/ff3 [0,4194304] 0 2024-09-17T01:56:31.495 INFO:tasks.workunit.client.0.smithi063.stdout:0/876: write d1/d3/db/d18/f95 [1184207,124486] 0 2024-09-17T01:56:31.497 INFO:tasks.workunit.client.0.smithi063.stdout:0/877: read - d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/f11f zero size 2024-09-17T01:56:31.497 INFO:tasks.workunit.client.0.smithi063.stdout:2/898: dread d3/d2a/f8b [0,4194304] 0 2024-09-17T01:56:31.497 INFO:tasks.workunit.client.0.smithi063.stdout:0/878: write d1/d3/d10/f4e [2034353,98559] 0 2024-09-17T01:56:31.501 INFO:tasks.workunit.client.0.smithi063.stdout:0/879: dread d1/d3/db/d4b/f66 [0,4194304] 0 2024-09-17T01:56:31.501 INFO:tasks.workunit.client.0.smithi063.stdout:8/808: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f1b [0,4194304] 0 2024-09-17T01:56:31.502 INFO:tasks.workunit.client.0.smithi063.stdout:0/880: symlink d1/d3/db/d6e/d86/l121 0 2024-09-17T01:56:31.502 INFO:tasks.workunit.client.0.smithi063.stdout:8/809: mknod d1/d27/d81/cf7 0 2024-09-17T01:56:31.502 INFO:tasks.workunit.client.0.smithi063.stdout:6/904: dread f1 [4194304,4194304] 0 2024-09-17T01:56:31.504 INFO:tasks.workunit.client.0.smithi063.stdout:0/881: stat d1/d3/db/d6e/d86/dcc/d53/l70 0 2024-09-17T01:56:31.505 INFO:tasks.workunit.client.0.smithi063.stdout:0/882: creat d1/d3/db/f122 x:0 0 0 2024-09-17T01:56:31.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/905: chown dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/fc3 17069 1 2024-09-17T01:56:31.505 INFO:tasks.workunit.client.0.smithi063.stdout:0/883: symlink d1/d1d/d74/l123 0 2024-09-17T01:56:31.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/906: mknod dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/de6/c129 0 2024-09-17T01:56:31.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/907: fsync dc/d14/d65/f125 0 2024-09-17T01:56:31.507 INFO:tasks.workunit.client.0.smithi063.stdout:0/884: rename d1/d3/db/d4b/ld0 to d1/d3/db/d6e/d86/dcc/d53/d62/l124 0 2024-09-17T01:56:31.507 INFO:tasks.workunit.client.0.smithi063.stdout:2/899: dread d3/d7/d38/da9/d102/f51 [0,4194304] 0 2024-09-17T01:56:31.507 INFO:tasks.workunit.client.0.smithi063.stdout:6/908: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/d12a 0 2024-09-17T01:56:31.507 INFO:tasks.workunit.client.0.smithi063.stdout:8/810: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f3b [1663992,54209] 0 2024-09-17T01:56:31.508 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.509+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.508 INFO:tasks.workunit.client.0.smithi063.stdout:2/900: write d3/d7/df/d30/f104 [832550,36355] 0 2024-09-17T01:56:31.508 INFO:tasks.workunit.client.0.smithi063.stdout:8/811: mknod d1/d7/d1d/db7/cf8 0 2024-09-17T01:56:31.510 INFO:tasks.workunit.client.0.smithi063.stdout:8/812: getdents d1/d27/d81/da4 0 2024-09-17T01:56:31.511 INFO:tasks.workunit.client.0.smithi063.stdout:8/813: write d1/d7/d28/f42 [2293294,115439] 0 2024-09-17T01:56:31.511 INFO:tasks.workunit.client.0.smithi063.stdout:8/814: mkdir d1/d7/d28/d2a/d53/df9 0 2024-09-17T01:56:31.512 INFO:tasks.workunit.client.0.smithi063.stdout:2/901: dread d3/d7/d38/da9/d102/f59 [0,4194304] 0 2024-09-17T01:56:31.514 INFO:tasks.workunit.client.0.smithi063.stdout:2/902: truncate d3/d7/d76/f7a 1901890 0 2024-09-17T01:56:31.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/945: sync 2024-09-17T01:56:31.515 INFO:tasks.workunit.client.0.smithi063.stdout:2/903: dread - d3/d2a/dac/ff1 zero size 2024-09-17T01:56:31.515 INFO:tasks.workunit.client.0.smithi063.stdout:0/885: dwrite d1/d3/d10/f5a [0,4194304] 0 2024-09-17T01:56:31.516 INFO:tasks.workunit.client.0.smithi063.stdout:5/946: fdatasync d6/d37/d19/d68/f78 0 2024-09-17T01:56:31.517 INFO:tasks.workunit.client.0.smithi063.stdout:0/886: mknod d1/d1d/de4/c125 0 2024-09-17T01:56:31.518 INFO:tasks.workunit.client.0.smithi063.stdout:8/815: dwrite d1/d27/d82/f88 [0,4194304] 0 2024-09-17T01:56:31.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/887: mknod d1/d3/db/d4b/d82/c126 0 2024-09-17T01:56:31.519 INFO:tasks.workunit.client.0.smithi063.stdout:0/888: mkdir d1/d3/db/d18/d85/da8/d127 0 2024-09-17T01:56:31.520 INFO:tasks.workunit.client.0.smithi063.stdout:0/889: rmdir d1/d3 39 2024-09-17T01:56:31.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/816: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f33 to d1/ffa 0 2024-09-17T01:56:31.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/909: dread dc/d14/f70 [0,4194304] 0 2024-09-17T01:56:31.521 INFO:tasks.workunit.client.0.smithi063.stdout:8/817: unlink d1/d7/d28/c95 0 2024-09-17T01:56:31.522 INFO:tasks.workunit.client.0.smithi063.stdout:8/818: write d1/d7/f39 [189325,16710] 0 2024-09-17T01:56:31.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/904: read d3/d7/d38/f65 [1192966,28367] 0 2024-09-17T01:56:31.526 INFO:tasks.workunit.client.0.smithi063.stdout:0/890: dwrite d1/d1f/fe9 [0,4194304] 0 2024-09-17T01:56:31.527 INFO:tasks.workunit.client.0.smithi063.stdout:0/891: truncate d1/d3/db/f3e 4849861 0 2024-09-17T01:56:31.527 INFO:tasks.workunit.client.0.smithi063.stdout:6/910: dwrite dc/d14/d19/f2d [4194304,4194304] 0 2024-09-17T01:56:31.529 INFO:tasks.workunit.client.0.smithi063.stdout:0/892: write d1/d3/db/d18/d85/da8/fcf [25694,74402] 0 2024-09-17T01:56:31.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/893: creat d1/f128 x:0 0 0 2024-09-17T01:56:31.531 INFO:tasks.workunit.client.0.smithi063.stdout:8/819: write d1/d27/d81/fbf [1488701,16929] 0 2024-09-17T01:56:31.531 INFO:tasks.workunit.client.0.smithi063.stdout:2/905: dwrite d3/d7/df/f18 [0,4194304] 0 2024-09-17T01:56:31.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/820: creat d1/d7/d28/ffb x:0 0 0 2024-09-17T01:56:31.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/906: unlink d3/d7/d76/cca 0 2024-09-17T01:56:31.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/911: dread dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/fc0 [0,4194304] 0 2024-09-17T01:56:31.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/907: mknod d3/d7/df/d43/c11f 0 2024-09-17T01:56:31.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/821: truncate d1/d27/d81/da4/dc7/ff0 636309 0 2024-09-17T01:56:31.535 INFO:tasks.workunit.client.0.smithi063.stdout:6/912: write dc/d14/d19/d20/d66/fd5 [215585,41816] 0 2024-09-17T01:56:31.537 INFO:tasks.workunit.client.0.smithi063.stdout:8/822: rename d1/d7/l83 to d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/lfc 0 2024-09-17T01:56:31.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/913: getdents dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3 0 2024-09-17T01:56:31.539 INFO:tasks.workunit.client.0.smithi063.stdout:8/823: unlink d1/d7/d28/d2a/le8 0 2024-09-17T01:56:31.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/908: dwrite d3/d7/d38/da9/d102/fea [0,4194304] 0 2024-09-17T01:56:31.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/909: fsync d3/f10a 0 2024-09-17T01:56:31.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/914: dwrite dc/d14/d19/d20/d32/d68/fce [0,4194304] 0 2024-09-17T01:56:31.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/910: dwrite d3/f44 [0,4194304] 0 2024-09-17T01:56:31.552 INFO:tasks.workunit.client.0.smithi063.stdout:6/915: dwrite dc/d14/d19/d20/d32/d52/d5a/f40 [0,4194304] 0 2024-09-17T01:56:31.553 INFO:tasks.workunit.client.0.smithi063.stdout:6/916: stat dc/d14/d19/f82 0 2024-09-17T01:56:31.554 INFO:tasks.workunit.client.0.smithi063.stdout:6/917: mkdir dc/d14/d19/d20/d32/d68/d12b 0 2024-09-17T01:56:31.554 INFO:tasks.workunit.client.0.smithi063.stdout:2/911: dwrite d3/d7/df/d30/fb4 [0,4194304] 0 2024-09-17T01:56:31.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/918: link l8 dc/d14/d19/d20/d32/d52/d5a/d62/l12c 0 2024-09-17T01:56:31.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/919: dread - dc/d14/d18/fdb zero size 2024-09-17T01:56:31.558 INFO:tasks.workunit.client.0.smithi063.stdout:6/920: mkdir dc/d14/d19/d20/d32/d68/db4/d12d 0 2024-09-17T01:56:31.560 INFO:tasks.workunit.client.0.smithi063.stdout:2/912: dwrite d3/f44 [4194304,4194304] 0 2024-09-17T01:56:31.562 INFO:tasks.workunit.client.0.smithi063.stdout:2/913: dread d3/d7/df/d30/f115 [0,4194304] 0 2024-09-17T01:56:31.563 INFO:tasks.workunit.client.0.smithi063.stdout:2/914: chown d3/d7/d38/da9/d102/f59 0 1 2024-09-17T01:56:31.570 INFO:tasks.workunit.client.0.smithi063.stdout:2/915: dwrite d3/d7/d8d/da4/fbe [0,4194304] 0 2024-09-17T01:56:31.575 INFO:tasks.workunit.client.0.smithi063.stdout:0/894: dread d1/d3/dc6/f7e [0,4194304] 0 2024-09-17T01:56:31.576 INFO:tasks.workunit.client.0.smithi063.stdout:0/895: write d1/d3/db/d6e/d86/dcc/d7c/db6/fdf [1572311,100192] 0 2024-09-17T01:56:31.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/896: stat d1/d3/db/d18/d33/d83/laa 0 2024-09-17T01:56:31.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/897: mkdir d1/d3/db/d6e/d86/dcc/d53/d62/dcd/d129 0 2024-09-17T01:56:31.579 INFO:tasks.workunit.client.0.smithi063.stdout:0/898: chown d1/f1e 0 1 2024-09-17T01:56:31.579 INFO:tasks.workunit.client.0.smithi063.stdout:6/921: dread dc/d14/d19/d20/d32/f87 [0,4194304] 0 2024-09-17T01:56:31.580 INFO:tasks.workunit.client.0.smithi063.stdout:6/922: rmdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/d102 39 2024-09-17T01:56:31.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/916: dread d3/d7/fb8 [0,4194304] 0 2024-09-17T01:56:31.582 INFO:tasks.workunit.client.0.smithi063.stdout:6/923: getdents dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dde/dee 0 2024-09-17T01:56:31.583 INFO:tasks.workunit.client.0.smithi063.stdout:2/917: read d3/d7/df/f71 [803986,2765] 0 2024-09-17T01:56:31.583 INFO:tasks.workunit.client.0.smithi063.stdout:0/899: dread d1/d3/db/d18/d33/d83/db7/ffc [0,4194304] 0 2024-09-17T01:56:31.584 INFO:tasks.workunit.client.0.smithi063.stdout:6/924: read dc/d14/d19/d20/d32/d52/d5a/d97/db8/ff4 [2343789,79767] 0 2024-09-17T01:56:31.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/918: truncate d3/d7/d38/da9/d102/fae 4218567 0 2024-09-17T01:56:31.585 INFO:tasks.workunit.client.0.smithi063.stdout:4/974: sync 2024-09-17T01:56:31.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/925: sync 2024-09-17T01:56:31.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/919: write d3/d2a/dac/fff [870083,100820] 0 2024-09-17T01:56:31.586 INFO:tasks.workunit.client.0.smithi063.stdout:6/926: mkdir dc/d14/d2f/de7/d12e 0 2024-09-17T01:56:31.586 INFO:tasks.workunit.client.0.smithi063.stdout:2/920: stat d3/d7/d8d/dc0/lc2 0 2024-09-17T01:56:31.586 INFO:tasks.workunit.client.0.smithi063.stdout:4/975: unlink de/d17/d1b/dc7/d28/d98/lda 0 2024-09-17T01:56:31.587 INFO:tasks.workunit.client.0.smithi063.stdout:4/976: read - de/d17/d1b/dc7/d28/d8d/f105 zero size 2024-09-17T01:56:31.588 INFO:tasks.workunit.client.0.smithi063.stdout:2/921: truncate d3/d7/d38/da9/d102/fc3 437321 0 2024-09-17T01:56:31.588 INFO:tasks.workunit.client.0.smithi063.stdout:6/927: symlink dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/d102/d120/l12f 0 2024-09-17T01:56:31.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/977: getdents de/d17/d1b/dc7 0 2024-09-17T01:56:31.589 INFO:tasks.workunit.client.0.smithi063.stdout:6/928: write dc/d14/d19/f3d [610643,14994] 0 2024-09-17T01:56:31.589 INFO:tasks.workunit.client.0.smithi063.stdout:6/929: dread - dc/d14/d19/d20/d32/d68/ffd zero size 2024-09-17T01:56:31.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/978: getdents de/d2d/d3c/dd0/d12f 0 2024-09-17T01:56:31.590 INFO:tasks.workunit.client.0.smithi063.stdout:6/930: unlink dc/d14/d18/f64 0 2024-09-17T01:56:31.592 INFO:tasks.workunit.client.0.smithi063.stdout:6/931: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/dbc/f130 x:0 0 0 2024-09-17T01:56:31.593 INFO:tasks.workunit.client.0.smithi063.stdout:0/900: dread d1/d3/d1b/f29 [0,4194304] 0 2024-09-17T01:56:31.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/901: chown d1/d3/d1b 249903 1 2024-09-17T01:56:31.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/902: chown d1/d3/d1b/d50/d6c/le6 122 1 2024-09-17T01:56:31.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/932: dwrite dc/f1e [4194304,4194304] 0 2024-09-17T01:56:31.598 INFO:tasks.workunit.client.0.smithi063.stdout:6/933: creat dc/d14/d19/d20/d32/d68/d12b/f131 x:0 0 0 2024-09-17T01:56:31.604 INFO:tasks.workunit.client.0.smithi063.stdout:6/934: dwrite dc/d1b/f4b [0,4194304] 0 2024-09-17T01:56:31.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/935: fsync dc/d14/d19/d20/f108 0 2024-09-17T01:56:31.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/936: dread - dc/d14/d19/d20/d66/f85 zero size 2024-09-17T01:56:31.606 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:31.606 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:31.606 INFO:tasks.workunit.client.0.smithi063.stdout:6/937: dread - dc/d14/d19/d20/d32/d68/d9c/fab zero size 2024-09-17T01:56:31.607 INFO:tasks.workunit.client.0.smithi063.stdout:6/938: readlink dc/d14/d19/d20/d32/d52/d5a/d62/l95 0 2024-09-17T01:56:31.608 INFO:tasks.workunit.client.0.smithi063.stdout:6/939: mknod dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/c132 0 2024-09-17T01:56:31.609 INFO:tasks.workunit.client.0.smithi063.stdout:6/940: unlink f1 0 2024-09-17T01:56:31.609 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.613+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/941: getdents dc/d14/d18/d74/dc8 0 2024-09-17T01:56:31.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/942: readlink dc/d14/d19/l3c 0 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:9/939: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:3/945: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/824: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:5/947: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/903: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/922: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:4/979: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:0/903: sync 2024-09-17T01:56:31.615 INFO:tasks.workunit.client.0.smithi063.stdout:3/946: stat df/d28/l5c 0 2024-09-17T01:56:31.616 INFO:tasks.workunit.client.0.smithi063.stdout:8/825: mkdir d1/d7/d1d/dfd 0 2024-09-17T01:56:31.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/904: mknod d2/d15/d2f/dd3/c127 0 2024-09-17T01:56:31.617 INFO:tasks.workunit.client.0.smithi063.stdout:6/943: dwrite dc/d14/ffb [0,4194304] 0 2024-09-17T01:56:31.617 INFO:tasks.workunit.client.0.smithi063.stdout:0/904: readlink d1/d3/db/d6e/d86/dcc/d53/d62/l84 0 2024-09-17T01:56:31.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/905: write d2/d15/d2f/d45/d82/df6/d27/d39/d40/f6a [3490370,80318] 0 2024-09-17T01:56:31.619 INFO:tasks.workunit.client.0.smithi063.stdout:9/940: read d9/de/d33/f38 [2897280,82680] 0 2024-09-17T01:56:31.619 INFO:tasks.workunit.client.0.smithi063.stdout:2/923: symlink d3/d7/d8d/d100/l120 0 2024-09-17T01:56:31.620 INFO:tasks.workunit.client.0.smithi063.stdout:6/944: creat dc/d14/d19/d20/d66/def/f133 x:0 0 0 2024-09-17T01:56:31.620 INFO:tasks.workunit.client.0.smithi063.stdout:5/948: link d6/d35/dc1/d69/f7a d6/d37/d19/d68/f132 0 2024-09-17T01:56:31.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/826: mkdir d1/d7/d28/d2a/d37/d3a/daf/dfe 0 2024-09-17T01:56:31.620 INFO:tasks.workunit.client.0.smithi063.stdout:7/906: mkdir d2/d15/d2f/d3e/d10e/dd4/d128 0 2024-09-17T01:56:31.620 INFO:tasks.workunit.client.0.smithi063.stdout:4/980: getdents de/d17/d1b/d9b/d120 0 2024-09-17T01:56:31.620 INFO:tasks.workunit.client.0.smithi063.stdout:2/924: mknod d3/d7/df/d43/c121 0 2024-09-17T01:56:31.623 INFO:tasks.workunit.client.0.smithi063.stdout:5/949: write d6/d35/dc1/d29/d36/f11a [280601,35105] 0 2024-09-17T01:56:31.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/925: symlink d3/d7/d38/da9/d102/dfe/l122 0 2024-09-17T01:56:31.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/827: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/fab [1889697,37191] 0 2024-09-17T01:56:31.625 INFO:tasks.workunit.client.0.smithi063.stdout:7/907: rename d2/d15/d2f/d45/d82/df6/d27/d39/deb/l112 to d2/d98/dea/l129 0 2024-09-17T01:56:31.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:31.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/947: dwrite df/d83/fc4 [0,4194304] 0 2024-09-17T01:56:31.627 INFO:tasks.workunit.client.0.smithi063.stdout:0/905: dwrite d1/f19 [0,4194304] 0 2024-09-17T01:56:31.628 INFO:tasks.workunit.client.0.smithi063.stdout:7/908: write d2/d15/d2f/d45/d82/df6/ffa [97170,39679] 0 2024-09-17T01:56:31.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/948: write df/d12/d30/f32 [4517297,98355] 0 2024-09-17T01:56:31.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/981: truncate de/d17/df3/f12d 1109224 0 2024-09-17T01:56:31.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/982: sync 2024-09-17T01:56:31.630 INFO:tasks.workunit.client.0.smithi063.stdout:8/828: creat d1/d7/d28/d2a/d37/df3/fff x:0 0 0 2024-09-17T01:56:31.630 INFO:tasks.workunit.client.0.smithi063.stdout:6/945: rename dc/d14/d19/d20/d32/d52/d5a/l6e to dc/d1b/d5e/l134 0 2024-09-17T01:56:31.630 INFO:tasks.workunit.client.0.smithi063.stdout:0/906: mknod d1/d3/db/d18/d85/dae/c12a 0 2024-09-17T01:56:31.630 INFO:tasks.workunit.client.0.smithi063.stdout:9/941: dwrite d9/de/d20/d37/f106 [0,4194304] 0 2024-09-17T01:56:31.630 INFO:tasks.workunit.client.0.smithi063.stdout:4/983: symlink de/d2d/l139 0 2024-09-17T01:56:31.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/926: rename d3/d7/df/f71 to d3/d7/d38/f123 0 2024-09-17T01:56:31.631 INFO:tasks.workunit.client.0.smithi063.stdout:7/909: symlink d2/d15/d2f/d45/d82/df6/d27/d39/deb/l12a 0 2024-09-17T01:56:31.632 INFO:tasks.workunit.client.0.smithi063.stdout:3/949: write df/d12/d43/d50/de6/fef [2132253,101434] 0 2024-09-17T01:56:31.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/927: unlink d3/d7/df/f10c 0 2024-09-17T01:56:31.634 INFO:tasks.workunit.client.0.smithi063.stdout:3/950: chown df/d12/d30/d128 952782068 1 2024-09-17T01:56:31.634 INFO:tasks.workunit.client.0.smithi063.stdout:6/946: chown dc/d14/d19/d20/f71 21 1 2024-09-17T01:56:31.634 INFO:tasks.workunit.client.0.smithi063.stdout:8/829: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f100 x:0 0 0 2024-09-17T01:56:31.634 INFO:tasks.workunit.client.0.smithi063.stdout:6/947: sync 2024-09-17T01:56:31.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/928: mknod d3/d7/df/c124 0 2024-09-17T01:56:31.635 INFO:tasks.workunit.client.0.smithi063.stdout:7/910: creat d2/d15/d2f/d45/d82/df6/d22/d3a/f12b x:0 0 0 2024-09-17T01:56:31.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/929: creat d3/d7/d8d/da4/f125 x:0 0 0 2024-09-17T01:56:31.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/830: mknod d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/c101 0 2024-09-17T01:56:31.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/950: dwrite d6/f44 [0,4194304] 0 2024-09-17T01:56:31.637 INFO:tasks.workunit.client.0.smithi063.stdout:4/984: truncate de/d2d/d52/d9c/fb9 630780 0 2024-09-17T01:56:31.637 INFO:tasks.workunit.client.0.smithi063.stdout:7/911: mknod d2/d15/d2f/d45/d82/df6/d27/d65/dd2/d114/c12c 0 2024-09-17T01:56:31.638 INFO:tasks.workunit.client.0.smithi063.stdout:8/831: mkdir d1/d27/d81/da4/dc7/d102 0 2024-09-17T01:56:31.639 INFO:tasks.workunit.client.0.smithi063.stdout:6/948: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/f135 x:0 0 0 2024-09-17T01:56:31.639 INFO:tasks.workunit.client.0.smithi063.stdout:4/985: unlink de/d17/d1b/dc7/d28/f129 0 2024-09-17T01:56:31.639 INFO:tasks.workunit.client.0.smithi063.stdout:5/951: rmdir d6/d37/d19/d76/d8f/de0/de5/d31 39 2024-09-17T01:56:31.640 INFO:tasks.workunit.client.0.smithi063.stdout:8/832: readlink d1/d7/d1d/d9c/lba 0 2024-09-17T01:56:31.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/912: unlink d2/d15/d2f/d45/d82/df6/d27/d39/d40/f107 0 2024-09-17T01:56:31.643 INFO:tasks.workunit.client.0.smithi063.stdout:6/949: creat dc/d14/d18/d74/dd8/f136 x:0 0 0 2024-09-17T01:56:31.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/986: creat de/d17/d36/dbe/f13a x:0 0 0 2024-09-17T01:56:31.643 INFO:tasks.workunit.client.0.smithi063.stdout:9/942: dwrite d9/dbf/f10f [4194304,4194304] 0 2024-09-17T01:56:31.643 INFO:tasks.workunit.client.0.smithi063.stdout:5/952: mkdir d6/d9/d133 0 2024-09-17T01:56:31.643 INFO:tasks.workunit.client.0.smithi063.stdout:8/833: chown d1/d7/d28/d2a/ca7 14365 1 2024-09-17T01:56:31.644 INFO:tasks.workunit.client.0.smithi063.stdout:9/943: readlink d9/de/d33/l9f 0 2024-09-17T01:56:31.645 INFO:tasks.workunit.client.0.smithi063.stdout:4/987: creat de/d17/d36/dbe/da6/f13b x:0 0 0 2024-09-17T01:56:31.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/950: rename dc/d1b/d5e/f112 to dc/d14/d2f/de7/d12e/f137 0 2024-09-17T01:56:31.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/944: mknod d9/dbf/d12d/c14f 0 2024-09-17T01:56:31.646 INFO:tasks.workunit.client.0.smithi063.stdout:9/945: sync 2024-09-17T01:56:31.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/930: dwrite d3/d7/df/f18 [0,4194304] 0 2024-09-17T01:56:31.647 INFO:tasks.workunit.client.0.smithi063.stdout:7/913: dread d2/d15/d2f/d45/d82/df6/fce [0,4194304] 0 2024-09-17T01:56:31.647 INFO:tasks.workunit.client.0.smithi063.stdout:5/953: link d6/d35/dc1/d29/d36/f5e d6/d37/d19/d76/d8f/de0/de5/da4/f134 0 2024-09-17T01:56:31.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/931: symlink d3/d7/d8d/dc0/l126 0 2024-09-17T01:56:31.648 INFO:tasks.workunit.client.0.smithi063.stdout:4/988: truncate de/d17/d36/d70/d77/f138 939775 0 2024-09-17T01:56:31.648 INFO:tasks.workunit.client.0.smithi063.stdout:7/914: chown d2/d15/d2f/dd3/c116 14335 1 2024-09-17T01:56:31.649 INFO:tasks.workunit.client.0.smithi063.stdout:5/954: getdents d6/d37/d19/d50/d98/d113 0 2024-09-17T01:56:31.649 INFO:tasks.workunit.client.0.smithi063.stdout:2/932: mknod d3/d7/d38/da9/d117/c127 0 2024-09-17T01:56:31.650 INFO:tasks.workunit.client.0.smithi063.stdout:5/955: getdents d6/d9 0 2024-09-17T01:56:31.650 INFO:tasks.workunit.client.0.smithi063.stdout:7/915: mkdir d2/d15/d2f/d52/d12d 0 2024-09-17T01:56:31.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/956: creat d6/d35/dc1/d3f/dac/f135 x:0 0 0 2024-09-17T01:56:31.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/957: chown d6/l1a 7988509 1 2024-09-17T01:56:31.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/958: symlink d6/d9/d32/l136 0 2024-09-17T01:56:31.653 INFO:tasks.workunit.client.0.smithi063.stdout:4/989: dwrite de/f2e [0,4194304] 0 2024-09-17T01:56:31.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/916: creat d2/d15/d2f/d45/d82/df6/d17/f12e x:0 0 0 2024-09-17T01:56:31.654 INFO:tasks.workunit.client.0.smithi063.stdout:4/990: fdatasync de/d17/d1b/f6a 0 2024-09-17T01:56:31.655 INFO:tasks.workunit.client.0.smithi063.stdout:7/917: chown d2/d15/d2f/d45/d82/df6/d17/d25/db0 5594726 1 2024-09-17T01:56:31.655 INFO:tasks.workunit.client.0.smithi063.stdout:5/959: creat d6/d37/d19/d76/f137 x:0 0 0 2024-09-17T01:56:31.655 INFO:tasks.workunit.client.0.smithi063.stdout:4/991: stat de/d17/d36/d70/d77 0 2024-09-17T01:56:31.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/992: creat de/d17/d1b/dc7/d28/d8d/f13c x:0 0 0 2024-09-17T01:56:31.657 INFO:tasks.workunit.client.0.smithi063.stdout:7/918: mkdir d2/d15/d2f/d3e/d73/d12f 0 2024-09-17T01:56:31.657 INFO:tasks.workunit.client.0.smithi063.stdout:4/993: creat de/d2d/d52/d9c/f13d x:0 0 0 2024-09-17T01:56:31.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/919: symlink d2/d15/d2f/d45/d82/df6/l130 0 2024-09-17T01:56:31.658 INFO:tasks.workunit.client.0.smithi063.stdout:4/994: creat de/d17/df3/f13e x:0 0 0 2024-09-17T01:56:31.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/920: dread - d2/d15/d2f/d45/d82/df6/d27/fe8 zero size 2024-09-17T01:56:31.661 INFO:tasks.workunit.client.0.smithi063.stdout:7/921: dread - d2/d15/d2f/d45/d82/df6/d22/db6/fe3 zero size 2024-09-17T01:56:31.662 INFO:tasks.workunit.client.0.smithi063.stdout:7/922: write d2/fd [1506327,81400] 0 2024-09-17T01:56:31.664 INFO:tasks.workunit.client.0.smithi063.stdout:7/923: write d2/d15/d2f/d45/d82/df6/d27/d39/f46 [7796096,123854] 0 2024-09-17T01:56:31.666 INFO:tasks.workunit.client.0.smithi063.stdout:4/995: dwrite de/f38 [0,4194304] 0 2024-09-17T01:56:31.666 INFO:tasks.workunit.client.0.smithi063.stdout:8/834: dread d1/d7/d28/d2a/d37/d3a/d85/f93 [0,4194304] 0 2024-09-17T01:56:31.667 INFO:tasks.workunit.client.0.smithi063.stdout:2/933: read d3/d2a/f4c [544061,16941] 0 2024-09-17T01:56:31.668 INFO:tasks.workunit.client.0.smithi063.stdout:4/996: mkdir de/d17/d36/dbe/d128/d13f 0 2024-09-17T01:56:31.670 INFO:tasks.workunit.client.0.smithi063.stdout:9/946: dread d9/d27/f3a [0,4194304] 0 2024-09-17T01:56:31.670 INFO:tasks.workunit.client.0.smithi063.stdout:2/934: chown d3/d7/df/c6f 85 1 2024-09-17T01:56:31.672 INFO:tasks.workunit.client.0.smithi063.stdout:8/835: dread d1/d7/d1d/f1f [0,4194304] 0 2024-09-17T01:56:31.672 INFO:tasks.workunit.client.0.smithi063.stdout:5/960: dread d6/d35/dc1/d54/fd9 [0,4194304] 0 2024-09-17T01:56:31.673 INFO:tasks.workunit.client.0.smithi063.stdout:7/924: dwrite d2/f7d [0,4194304] 0 2024-09-17T01:56:31.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/947: creat d9/d8d/d75/f150 x:0 0 0 2024-09-17T01:56:31.674 INFO:tasks.workunit.client.0.smithi063.stdout:7/925: symlink d2/d15/d2f/d3e/l131 0 2024-09-17T01:56:31.675 INFO:tasks.workunit.client.0.smithi063.stdout:5/961: mknod d6/d35/c138 0 2024-09-17T01:56:31.676 INFO:tasks.workunit.client.0.smithi063.stdout:4/997: dwrite de/d17/d1b/dc7/d28/d30/f116 [0,4194304] 0 2024-09-17T01:56:31.677 INFO:tasks.workunit.client.0.smithi063.stdout:5/962: write d6/d37/d19/d76/d8f/de0/de5/fb7 [628870,35634] 0 2024-09-17T01:56:31.678 INFO:tasks.workunit.client.0.smithi063.stdout:8/836: truncate d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f2d 1854607 0 2024-09-17T01:56:31.678 INFO:tasks.workunit.client.0.smithi063.stdout:4/998: symlink de/l140 0 2024-09-17T01:56:31.678 INFO:tasks.workunit.client.0.smithi063.stdout:7/926: link d2/fd d2/d15/d2f/d45/d82/df6/d27/d65/dd2/d114/f132 0 2024-09-17T01:56:31.680 INFO:tasks.workunit.client.0.smithi063.stdout:4/999: readlink de/d2d/d3c/l6f 0 2024-09-17T01:56:31.680 INFO:tasks.workunit.client.0.smithi063.stdout:8/837: symlink d1/d27/d81/da4/dc7/l103 0 2024-09-17T01:56:31.680 INFO:tasks.workunit.client.0.smithi063.stdout:5/963: fsync d6/d35/dc1/d29/d36/f97 0 2024-09-17T01:56:31.680 INFO:tasks.workunit.client.0.smithi063.stdout:8/838: readlink d1/d7/d28/d2a/lad 0 2024-09-17T01:56:31.682 INFO:tasks.workunit.client.0.smithi063.stdout:2/935: dwrite d3/d2a/f8b [0,4194304] 0 2024-09-17T01:56:31.682 INFO:tasks.workunit.client.0.smithi063.stdout:9/948: dwrite d9/de/dcf/fd2 [0,4194304] 0 2024-09-17T01:56:31.683 INFO:tasks.workunit.client.0.smithi063.stdout:2/936: stat d3/d7/d38/f6c 0 2024-09-17T01:56:31.684 INFO:tasks.workunit.client.0.smithi063.stdout:7/927: rename d2/d15/d2f/d45/d82/df6/d27/d65/dd2/d114 to d2/d15/d2f/d3e/d73/d96/d133 0 2024-09-17T01:56:31.685 INFO:tasks.workunit.client.0.smithi063.stdout:2/937: fdatasync d3/d7/df/d43/f69 0 2024-09-17T01:56:31.685 INFO:tasks.workunit.client.0.smithi063.stdout:9/949: symlink d9/d8d/d2a/d40/dac/dc2/d132/d143/l151 0 2024-09-17T01:56:31.685 INFO:tasks.workunit.client.0.smithi063.stdout:8/839: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/f104 x:0 0 0 2024-09-17T01:56:31.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/928: creat d2/d15/d2f/de7/f134 x:0 0 0 2024-09-17T01:56:31.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/929: chown d2/d15/d2f/d3e/d10e/dca/f111 397345 1 2024-09-17T01:56:31.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/950: creat d9/de/d20/d1b/d141/f152 x:0 0 0 2024-09-17T01:56:31.687 INFO:tasks.workunit.client.0.smithi063.stdout:8/840: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f52 [710955,104195] 0 2024-09-17T01:56:31.687 INFO:tasks.workunit.client.0.smithi063.stdout:8/841: fsync d1/d27/d82/fe1 0 2024-09-17T01:56:31.688 INFO:tasks.workunit.client.0.smithi063.stdout:8/842: sync 2024-09-17T01:56:31.688 INFO:tasks.workunit.client.0.smithi063.stdout:9/951: creat d9/de/d20/d1b/d25/f153 x:0 0 0 2024-09-17T01:56:31.689 INFO:tasks.workunit.client.0.smithi063.stdout:7/930: link d2/d15/d2f/d3e/d10e/dd4/f115 d2/d15/d2f/d3e/d10e/f135 0 2024-09-17T01:56:31.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/938: dwrite d3/d7/d38/f45 [0,4194304] 0 2024-09-17T01:56:31.691 INFO:tasks.workunit.client.0.smithi063.stdout:3/951: dread df/d12/d43/f69 [0,4194304] 0 2024-09-17T01:56:31.693 INFO:tasks.workunit.client.0.smithi063.stdout:7/931: dread d2/d15/d2f/d45/fab [0,4194304] 0 2024-09-17T01:56:31.693 INFO:tasks.workunit.client.0.smithi063.stdout:3/952: truncate df/d12/d43/d50/dfb/fa9 750475 0 2024-09-17T01:56:31.694 INFO:tasks.workunit.client.0.smithi063.stdout:3/953: unlink df/fd0 0 2024-09-17T01:56:31.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/843: truncate d1/d7/d28/d2a/d44/f73 798676 0 2024-09-17T01:56:31.694 INFO:tasks.workunit.client.0.smithi063.stdout:2/939: write d3/d7/df/fcb [719600,19475] 0 2024-09-17T01:56:31.695 INFO:tasks.workunit.client.0.smithi063.stdout:2/940: chown d3/d28/lf4 255 1 2024-09-17T01:56:31.696 INFO:tasks.workunit.client.0.smithi063.stdout:9/952: dwrite d9/de/d20/d37/d42/d7f/fb5 [0,4194304] 0 2024-09-17T01:56:31.696 INFO:tasks.workunit.client.0.smithi063.stdout:2/941: fdatasync d3/d2a/dac/fe5 0 2024-09-17T01:56:31.696 INFO:tasks.workunit.client.0.smithi063.stdout:7/932: mknod d2/d15/d2f/d45/d82/df6/d27/d65/c136 0 2024-09-17T01:56:31.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/954: rmdir df/d12/d2d/ddc/df5 39 2024-09-17T01:56:31.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/955: getdents df/d12/d1e/d5e 0 2024-09-17T01:56:31.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/956: fsync df/d12/f80 0 2024-09-17T01:56:31.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/953: write d9/d8d/d2a/d36/f78 [1161925,5782] 0 2024-09-17T01:56:31.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/933: rename d2/d15/d2f/d45/d48/lcc to d2/d15/d2f/d45/d82/df6/d27/d65/dd2/l137 0 2024-09-17T01:56:31.703 INFO:tasks.workunit.client.0.smithi063.stdout:9/954: creat d9/de/f154 x:0 0 0 2024-09-17T01:56:31.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/957: mkdir df/d12/d2d/ddc/df5/d140 0 2024-09-17T01:56:31.704 INFO:tasks.workunit.client.0.smithi063.stdout:2/942: dwrite d3/d7/d76/f77 [0,4194304] 0 2024-09-17T01:56:31.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/955: unlink d9/de/d20/d37/d42/d13b/c14d 0 2024-09-17T01:56:31.705 INFO:tasks.workunit.client.0.smithi063.stdout:2/943: symlink d3/d28/l128 0 2024-09-17T01:56:31.705 INFO:tasks.workunit.client.0.smithi063.stdout:7/934: truncate d2/d15/d2f/d3e/fe6 4377986 0 2024-09-17T01:56:31.709 INFO:tasks.workunit.client.0.smithi063.stdout:8/844: dwrite d1/d27/f4b [0,4194304] 0 2024-09-17T01:56:31.709 INFO:tasks.workunit.client.0.smithi063.stdout:2/944: chown d3/d2a/fd3 2080 1 2024-09-17T01:56:31.709 INFO:tasks.workunit.client.0.smithi063.stdout:9/956: write d9/d8d/d2a/f112 [380483,45136] 0 2024-09-17T01:56:31.709 INFO:tasks.workunit.client.0.smithi063.stdout:2/945: fdatasync d3/d7/df/fcb 0 2024-09-17T01:56:31.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/907: dread d1/d3/d32/fcb [0,4194304] 0 2024-09-17T01:56:31.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/908: chown d1/d1d/da5 39051293 1 2024-09-17T01:56:31.710 INFO:tasks.workunit.client.0.smithi063.stdout:8/845: unlink d1/d7/d28/d2a/d59/l6d 0 2024-09-17T01:56:31.710 INFO:tasks.workunit.client.0.smithi063.stdout:7/935: mkdir d2/d15/d2f/d45/d82/df6/d22/d3a/d138 0 2024-09-17T01:56:31.710 INFO:tasks.workunit.client.0.smithi063.stdout:9/957: symlink d9/d8d/d2a/d40/dac/dc2/dde/l155 0 2024-09-17T01:56:31.710 INFO:tasks.workunit.client.0.smithi063.stdout:2/946: getdents d3/d2a/dac 0 2024-09-17T01:56:31.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/958: readlink d9/de/d20/d37/lbd 0 2024-09-17T01:56:31.711 INFO:tasks.workunit.client.0.smithi063.stdout:7/936: symlink d2/d15/d2f/d45/d82/df6/l139 0 2024-09-17T01:56:31.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/959: readlink d9/d8d/d2a/l2e 0 2024-09-17T01:56:31.711 INFO:tasks.workunit.client.0.smithi063.stdout:8/846: rename d1/d7/d28/d2a/d37 to d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/d105 22 2024-09-17T01:56:31.712 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.713+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/958: dwrite df/f1c [0,4194304] 0 2024-09-17T01:56:31.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/959: write df/d12/d43/f4d [1481093,88220] 0 2024-09-17T01:56:31.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/960: rename d9/de/d20/d1b/d25/d73/fec to d9/d8d/d2a/d36/ded/f156 0 2024-09-17T01:56:31.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/947: link d3/d7/df/d30/ccf d3/d7/df/d30/c129 0 2024-09-17T01:56:31.713 INFO:tasks.workunit.client.0.smithi063.stdout:7/937: link d2/d15/d2f/d45/d82/df6/c7a d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/d123/c13a 0 2024-09-17T01:56:31.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/960: chown df/d12/d30/d8a/d9d/f123 29270746 1 2024-09-17T01:56:31.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/948: mknod d3/d28/d72/dd5/d107/c12a 0 2024-09-17T01:56:31.714 INFO:tasks.workunit.client.0.smithi063.stdout:9/961: mknod d9/d8d/d2a/d40/dac/c157 0 2024-09-17T01:56:31.714 INFO:tasks.workunit.client.0.smithi063.stdout:8/847: mknod d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/c106 0 2024-09-17T01:56:31.715 INFO:tasks.workunit.client.0.smithi063.stdout:3/961: unlink df/d12/d30/c11a 0 2024-09-17T01:56:31.715 INFO:tasks.workunit.client.0.smithi063.stdout:3/962: stat df/d83/f119 0 2024-09-17T01:56:31.722 INFO:tasks.workunit.client.0.smithi063.stdout:3/963: dwrite df/d12/d30/d8a/d9d/f12a [0,4194304] 0 2024-09-17T01:56:31.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/964: creat df/d12/d1e/d39/f141 x:0 0 0 2024-09-17T01:56:31.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/909: truncate d1/d3/db/d18/d85/da8/fad 3579603 0 2024-09-17T01:56:31.730 INFO:tasks.workunit.client.0.smithi063.stdout:7/938: dwrite d2/d15/d2f/d45/d82/df6/d27/d33/d7b/fa5 [0,4194304] 0 2024-09-17T01:56:31.730 INFO:tasks.workunit.client.0.smithi063.stdout:2/949: dread d3/d7/d76/d108/f11b [0,4194304] 0 2024-09-17T01:56:31.731 INFO:tasks.workunit.client.0.smithi063.stdout:8/848: dread d1/d7/f4e [0,4194304] 0 2024-09-17T01:56:31.734 INFO:tasks.workunit.client.0.smithi063.stdout:3/965: dwrite df/d12/d43/d50/d58/d97/daa/db1/dcc/f120 [0,4194304] 0 2024-09-17T01:56:31.734 INFO:tasks.workunit.client.0.smithi063.stdout:7/939: mkdir d2/d15/d2f/d45/d82/df6/d27/d39/deb/d13b 0 2024-09-17T01:56:31.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/910: dwrite d1/d3/db/d4b/d98/ddd/ff9 [0,4194304] 0 2024-09-17T01:56:31.736 INFO:tasks.workunit.client.0.smithi063.stdout:2/950: write d3/d2a/fa0 [520167,60184] 0 2024-09-17T01:56:31.736 INFO:tasks.workunit.client.0.smithi063.stdout:9/962: dread d9/d27/f3b [4194304,4194304] 0 2024-09-17T01:56:31.737 INFO:tasks.workunit.client.0.smithi063.stdout:3/966: creat df/d12/d43/d50/d58/db5/f142 x:0 0 0 2024-09-17T01:56:31.737 INFO:tasks.workunit.client.0.smithi063.stdout:9/963: chown l3 0 1 2024-09-17T01:56:31.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/951: mknod d3/d7/df/d43/c12b 0 2024-09-17T01:56:31.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/849: truncate d1/d7/d28/f42 4085589 0 2024-09-17T01:56:31.738 INFO:tasks.workunit.client.0.smithi063.stdout:7/940: creat d2/d15/d2f/d3e/d73/dcd/f13c x:0 0 0 2024-09-17T01:56:31.739 INFO:tasks.workunit.client.0.smithi063.stdout:9/964: write d9/de/f2f [588301,75591] 0 2024-09-17T01:56:31.739 INFO:tasks.workunit.client.0.smithi063.stdout:2/952: stat d3/dbc/cc1 0 2024-09-17T01:56:31.739 INFO:tasks.workunit.client.0.smithi063.stdout:0/911: creat d1/d3/db/d6e/d86/dcc/f12b x:0 0 0 2024-09-17T01:56:31.740 INFO:tasks.workunit.client.0.smithi063.stdout:2/953: readlink d3/d7/d8d/lbf 0 2024-09-17T01:56:31.741 INFO:tasks.workunit.client.0.smithi063.stdout:0/912: write d1/d3/db/d18/d33/f2e [865491,44306] 0 2024-09-17T01:56:31.741 INFO:tasks.workunit.client.0.smithi063.stdout:3/967: link df/d12/d1e/d53/d12c/c13c df/d12/d43/d50/d58/db5/d107/c143 0 2024-09-17T01:56:31.742 INFO:tasks.workunit.client.0.smithi063.stdout:8/850: mkdir d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/de6/d107 0 2024-09-17T01:56:31.742 INFO:tasks.workunit.client.0.smithi063.stdout:0/913: fsync d1/d3/db/d18/d33/f36 0 2024-09-17T01:56:31.742 INFO:tasks.workunit.client.0.smithi063.stdout:6/951: dread dc/d14/d18/f31 [0,4194304] 0 2024-09-17T01:56:31.743 INFO:tasks.workunit.client.0.smithi063.stdout:9/965: rename d9/d8d/d2a/d40/dac/dc2/d132/d143/l151 to d9/de/d33/df5/d103/d113/l158 0 2024-09-17T01:56:31.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/968: chown df/d12/d30/d8a/cc2 11261 1 2024-09-17T01:56:31.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/964: dread d6/d35/dc1/d69/f7a [0,4194304] 0 2024-09-17T01:56:31.744 INFO:tasks.workunit.client.0.smithi063.stdout:6/952: creat dc/d14/d18/d91/f138 x:0 0 0 2024-09-17T01:56:31.744 INFO:tasks.workunit.client.0.smithi063.stdout:3/969: chown df/d12/d1e/f21 2320566 1 2024-09-17T01:56:31.744 INFO:tasks.workunit.client.0.smithi063.stdout:0/914: readlink d1/d3/db/d6e/d86/dcc/d53/d62/l124 0 2024-09-17T01:56:31.745 INFO:tasks.workunit.client.0.smithi063.stdout:7/941: dread d2/d15/d2f/d52/f94 [0,4194304] 0 2024-09-17T01:56:31.745 INFO:tasks.workunit.client.0.smithi063.stdout:9/966: rmdir d9/de/d33/df5/d103/d113 39 2024-09-17T01:56:31.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/953: symlink dc/d14/d18/d74/l139 0 2024-09-17T01:56:31.745 INFO:tasks.workunit.client.0.smithi063.stdout:3/970: mknod df/d12/d30/d11b/c144 0 2024-09-17T01:56:31.745 INFO:tasks.workunit.client.0.smithi063.stdout:5/965: symlink d6/d37/d19/d50/l139 0 2024-09-17T01:56:31.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/966: mkdir d6/d35/dc1/d54/d13a 0 2024-09-17T01:56:31.747 INFO:tasks.workunit.client.0.smithi063.stdout:6/954: write dc/d14/d65/f125 [955427,32524] 0 2024-09-17T01:56:31.747 INFO:tasks.workunit.client.0.smithi063.stdout:3/971: creat df/d12/d1e/d53/dca/f145 x:0 0 0 2024-09-17T01:56:31.748 INFO:tasks.workunit.client.0.smithi063.stdout:7/942: getdents d2/d15/d2f/d45/d82/df6/d27 0 2024-09-17T01:56:31.748 INFO:tasks.workunit.client.0.smithi063.stdout:6/955: dread - dc/d14/d2f/fed zero size 2024-09-17T01:56:31.749 INFO:tasks.workunit.client.0.smithi063.stdout:3/972: mknod df/c146 0 2024-09-17T01:56:31.751 INFO:tasks.workunit.client.0.smithi063.stdout:0/915: dread d1/d3/db/d18/d85/da8/ff4 [0,4194304] 0 2024-09-17T01:56:31.752 INFO:tasks.workunit.client.0.smithi063.stdout:7/943: write d2/d15/d2f/d45/d82/df6/d27/d39/f42 [6975120,85060] 0 2024-09-17T01:56:31.753 INFO:tasks.workunit.client.0.smithi063.stdout:8/851: dwrite d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f100 [0,4194304] 0 2024-09-17T01:56:31.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/967: rename d6/d37/d19/d76/d8f/de0/de5/d4f/fb9 to d6/d37/d19/d76/d8f/de0/de5/d4f/ddd/f13b 0 2024-09-17T01:56:31.753 INFO:tasks.workunit.client.0.smithi063.stdout:6/956: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/f13a x:0 0 0 2024-09-17T01:56:31.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/916: symlink d1/d1d/d74/l12c 0 2024-09-17T01:56:31.755 INFO:tasks.workunit.client.0.smithi063.stdout:2/954: dread d3/d7/d38/f123 [0,4194304] 0 2024-09-17T01:56:31.755 INFO:tasks.workunit.client.0.smithi063.stdout:5/968: symlink d6/d35/dc1/d54/d13a/l13c 0 2024-09-17T01:56:31.755 INFO:tasks.workunit.client.0.smithi063.stdout:9/967: dwrite d9/de/d33/df5/ffe [0,4194304] 0 2024-09-17T01:56:31.756 INFO:tasks.workunit.client.0.smithi063.stdout:6/957: fsync dc/d14/d18/f31 0 2024-09-17T01:56:31.756 INFO:tasks.workunit.client.0.smithi063.stdout:9/968: stat f7 0 2024-09-17T01:56:31.756 INFO:tasks.workunit.client.0.smithi063.stdout:2/955: write d3/d7/d38/f45 [1892822,7714] 0 2024-09-17T01:56:31.757 INFO:tasks.workunit.client.0.smithi063.stdout:7/944: rename d2/d15/d2f/d45/d82/df6/l8 to d2/df4/l13d 0 2024-09-17T01:56:31.757 INFO:tasks.workunit.client.0.smithi063.stdout:0/917: mknod d1/d1d/d6d/c12d 0 2024-09-17T01:56:31.758 INFO:tasks.workunit.client.0.smithi063.stdout:5/969: mkdir d6/d35/dc1/d29/d36/d10c/d13d 0 2024-09-17T01:56:31.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/958: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/d12a/f13b x:0 0 0 2024-09-17T01:56:31.760 INFO:tasks.workunit.client.0.smithi063.stdout:9/969: creat d9/de/d20/d37/d42/f159 x:0 0 0 2024-09-17T01:56:31.761 INFO:tasks.workunit.client.0.smithi063.stdout:3/973: dwrite df/d12/d43/d50/d58/d97/daa/db1/dfd/d106/f12e [0,4194304] 0 2024-09-17T01:56:31.761 INFO:tasks.workunit.client.0.smithi063.stdout:0/918: creat d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/f12e x:0 0 0 2024-09-17T01:56:31.761 INFO:tasks.workunit.client.0.smithi063.stdout:9/970: stat d9/d27/ca0 0 2024-09-17T01:56:31.762 INFO:tasks.workunit.client.0.smithi063.stdout:8/852: dread d1/d7/d28/d2a/d53/f94 [0,4194304] 0 2024-09-17T01:56:31.765 INFO:tasks.workunit.client.0.smithi063.stdout:8/853: mkdir d1/d7/d28/d2a/d37/d3a/d85/d108 0 2024-09-17T01:56:31.765 INFO:tasks.workunit.client.0.smithi063.stdout:9/971: mknod d9/d8d/ddf/d10a/d122/c15a 0 2024-09-17T01:56:31.767 INFO:tasks.workunit.client.0.smithi063.stdout:8/854: getdents d1/d7/d1d 0 2024-09-17T01:56:31.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/959: truncate dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/fc3 155544 0 2024-09-17T01:56:31.768 INFO:tasks.workunit.client.0.smithi063.stdout:9/972: getdents d9/d8d/ddf/d10a 0 2024-09-17T01:56:31.768 INFO:tasks.workunit.client.0.smithi063.stdout:0/919: dwrite d1/d3/d1b/d50/ff3 [4194304,4194304] 0 2024-09-17T01:56:31.770 INFO:tasks.workunit.client.0.smithi063.stdout:6/960: chown dc/d14/d19/d20/d32/d52/d5a/d43 277 1 2024-09-17T01:56:31.771 INFO:tasks.workunit.client.0.smithi063.stdout:2/956: dwrite d3/d7/d38/da9/d102/f53 [0,4194304] 0 2024-09-17T01:56:31.771 INFO:tasks.workunit.client.0.smithi063.stdout:8/855: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/fc8 [727332,14411] 0 2024-09-17T01:56:31.772 INFO:tasks.workunit.client.0.smithi063.stdout:8/856: chown d1/d27/d81/lac 1250 1 2024-09-17T01:56:31.772 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:31.772 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:31.773 INFO:tasks.workunit.client.0.smithi063.stdout:7/945: dwrite d2/d15/d2f/d45/d82/df6/d27/d65/fc5 [0,4194304] 0 2024-09-17T01:56:31.773 INFO:tasks.workunit.client.0.smithi063.stdout:9/973: creat d9/de/d33/f15b x:0 0 0 2024-09-17T01:56:31.773 INFO:tasks.workunit.client.0.smithi063.stdout:2/957: creat d3/dbc/f12c x:0 0 0 2024-09-17T01:56:31.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/961: mkdir dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/d13c 0 2024-09-17T01:56:31.774 INFO:tasks.workunit.client.0.smithi063.stdout:7/946: symlink d2/d98/dea/l13e 0 2024-09-17T01:56:31.774 INFO:tasks.workunit.client.0.smithi063.stdout:6/962: stat dc/d14/d18/d74/dc8/c123 0 2024-09-17T01:56:31.774 INFO:tasks.workunit.client.0.smithi063.stdout:9/974: fsync d9/de/d20/d37/f8e 0 2024-09-17T01:56:31.774 INFO:tasks.workunit.client.0.smithi063.stdout:2/958: chown d3/d7/f34 3657377 1 2024-09-17T01:56:31.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/963: rmdir dc/d14/d18/d91 39 2024-09-17T01:56:31.775 INFO:tasks.workunit.client.0.smithi063.stdout:7/947: read d2/d15/d2f/d45/d82/df6/ffa [104063,115826] 0 2024-09-17T01:56:31.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/959: chown d3/d2a/dac/fe5 3 1 2024-09-17T01:56:31.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/975: write d9/de/d20/d32/fd1 [1304772,74128] 0 2024-09-17T01:56:31.776 INFO:tasks.workunit.client.0.smithi063.stdout:8/857: rename d1/d7/d28/d2a/cee to d1/d7/d28/d2a/d37/c109 0 2024-09-17T01:56:31.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/964: chown dc/d14/d19/d20/d66/fd5 58 1 2024-09-17T01:56:31.776 INFO:tasks.workunit.client.0.smithi063.stdout:9/976: dread - d9/de/dcf/ff4 zero size 2024-09-17T01:56:31.776 INFO:tasks.workunit.client.0.smithi063.stdout:2/960: dread - d3/d7/df/d43/fd4 zero size 2024-09-17T01:56:31.777 INFO:tasks.workunit.client.0.smithi063.stdout:9/977: unlink d9/de/dcf/f12c 0 2024-09-17T01:56:31.777 INFO:tasks.workunit.client.0.smithi063.stdout:8/858: truncate d1/f16 5529035 0 2024-09-17T01:56:31.777 INFO:tasks.workunit.client.0.smithi063.stdout:7/948: mknod d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/da6/c13f 0 2024-09-17T01:56:31.778 INFO:tasks.workunit.client.0.smithi063.stdout:6/965: creat dc/d14/d19/d20/d32/d52/d5a/dd0/dd6/d8f/da1/dd3/f13d x:0 0 0 2024-09-17T01:56:31.778 INFO:tasks.workunit.client.0.smithi063.stdout:8/859: readlink d1/d7/d28/d2a/d37/d3a/d75/le3 0 2024-09-17T01:56:31.778 INFO:tasks.workunit.client.0.smithi063.stdout:9/978: symlink d9/de/d20/d1b/d25/d73/d121/l15c 0 2024-09-17T01:56:31.778 INFO:tasks.workunit.client.0.smithi063.stdout:7/949: creat d2/d15/d2f/d52/d97/f140 x:0 0 0 2024-09-17T01:56:31.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/860: creat d1/d27/f10a x:0 0 0 2024-09-17T01:56:31.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/861: dread - d1/d27/d82/fd9 zero size 2024-09-17T01:56:31.779 INFO:tasks.workunit.client.0.smithi063.stdout:6/966: creat dc/d14/d19/d20/d32/d68/d12b/f13e x:0 0 0 2024-09-17T01:56:31.780 INFO:tasks.workunit.client.0.smithi063.stdout:0/920: truncate d1/d3/db/d4b/d98/ddd/ffb 1460463 0 2024-09-17T01:56:31.780 INFO:tasks.workunit.client.0.smithi063.stdout:7/950: write d2/d15/d2f/d45/d82/df6/d27/d39/deb/fe9 [1324469,92398] 0 2024-09-17T01:56:31.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/967: readlink l8 0 2024-09-17T01:56:31.781 INFO:tasks.workunit.client.0.smithi063.stdout:9/979: creat d9/de/d20/d37/f15d x:0 0 0 2024-09-17T01:56:31.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/968: fdatasync dc/f12 0 2024-09-17T01:56:31.781 INFO:tasks.workunit.client.0.smithi063.stdout:9/980: creat d9/de/d20/d37/d42/d13b/f15e x:0 0 0 2024-09-17T01:56:31.781 INFO:tasks.workunit.client.0.smithi063.stdout:7/951: creat d2/d15/d2f/f141 x:0 0 0 2024-09-17T01:56:31.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/981: write d9/de/d33/ff0 [1033144,119007] 0 2024-09-17T01:56:31.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/952: mkdir d2/d15/d2f/d45/d82/df6/d142 0 2024-09-17T01:56:31.786 INFO:tasks.workunit.client.0.smithi063.stdout:7/953: symlink d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/da6/l143 0 2024-09-17T01:56:31.789 INFO:tasks.workunit.client.0.smithi063.stdout:0/921: dwrite d1/d3/d10/f5a [0,4194304] 0 2024-09-17T01:56:31.790 INFO:tasks.workunit.client.0.smithi063.stdout:6/969: dwrite dc/d14/d19/f7b [0,4194304] 0 2024-09-17T01:56:31.790 INFO:tasks.workunit.client.0.smithi063.stdout:8/862: dwrite d1/d7/d28/d2a/d53/f55 [0,4194304] 0 2024-09-17T01:56:31.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/922: fdatasync d1/d3/db/d18/d33/f36 0 2024-09-17T01:56:31.792 INFO:tasks.workunit.client.0.smithi063.stdout:9/982: dwrite d9/de/d20/d1b/d25/ff6 [4194304,4194304] 0 2024-09-17T01:56:31.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:31.794 INFO:tasks.workunit.client.0.smithi063.stdout:8/863: mkdir d1/d7/d28/d2a/d37/df3/d10b 0 2024-09-17T01:56:31.794 INFO:tasks.workunit.client.0.smithi063.stdout:6/970: rename dc/d14/d19/d20 to dc/d1b/d5e/d13f 0 2024-09-17T01:56:31.794 INFO:tasks.workunit.client.0.smithi063.stdout:9/983: creat d9/d8d/d2a/d40/f15f x:0 0 0 2024-09-17T01:56:31.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/923: symlink d1/d3/db/d4b/de0/l12f 0 2024-09-17T01:56:31.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/924: rmdir d1/d3/db/d4b/d98/ddd 39 2024-09-17T01:56:31.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/864: write d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/f104 [905590,77879] 0 2024-09-17T01:56:31.800 INFO:tasks.workunit.client.0.smithi063.stdout:9/984: rename d9/de/f154 to d9/de/d33/df5/d103/d113/f160 0 2024-09-17T01:56:31.801 INFO:tasks.workunit.client.0.smithi063.stdout:0/925: dread - d1/d1d/d6d/f106 zero size 2024-09-17T01:56:31.802 INFO:tasks.workunit.client.0.smithi063.stdout:9/985: readlink d9/de/d20/d37/lc0 0 2024-09-17T01:56:31.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/961: dread d3/f112 [0,4194304] 0 2024-09-17T01:56:31.803 INFO:tasks.workunit.client.0.smithi063.stdout:7/954: dwrite d2/d15/d2f/d45/d82/df6/d27/f32 [0,4194304] 0 2024-09-17T01:56:31.804 INFO:tasks.workunit.client.0.smithi063.stdout:9/986: mknod d9/c161 0 2024-09-17T01:56:31.806 INFO:tasks.workunit.client.0.smithi063.stdout:6/971: dwrite dc/d14/d18/d74/f88 [4194304,4194304] 0 2024-09-17T01:56:31.806 INFO:tasks.workunit.client.0.smithi063.stdout:7/955: write d2/d15/f6b [4811259,108351] 0 2024-09-17T01:56:31.806 INFO:tasks.workunit.client.0.smithi063.stdout:9/987: creat d9/d8d/d2a/d36/ded/f162 x:0 0 0 2024-09-17T01:56:31.807 INFO:tasks.workunit.client.0.smithi063.stdout:6/972: fsync dc/f12 0 2024-09-17T01:56:31.808 INFO:tasks.workunit.client.0.smithi063.stdout:9/988: truncate d9/faf 1008008 0 2024-09-17T01:56:31.808 INFO:tasks.workunit.client.0.smithi063.stdout:6/973: chown dc/d14/d18/d74/fe9 5063017 1 2024-09-17T01:56:31.809 INFO:tasks.workunit.client.0.smithi063.stdout:0/926: dwrite d1/d1f/f77 [0,4194304] 0 2024-09-17T01:56:31.809 INFO:tasks.workunit.client.0.smithi063.stdout:7/956: write d2/d15/d2f/d45/d82/df6/d17/d25/f11d [1048053,84207] 0 2024-09-17T01:56:31.809 INFO:tasks.workunit.client.0.smithi063.stdout:9/989: chown d9/d8d/d2a/d40/dac/d111/f13d 16379782 1 2024-09-17T01:56:31.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/970: sync 2024-09-17T01:56:31.811 INFO:tasks.workunit.client.0.smithi063.stdout:7/957: readlink d2/d15/l1a 0 2024-09-17T01:56:31.811 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.813+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.812 INFO:tasks.workunit.client.0.smithi063.stdout:9/990: unlink d9/d8d/d2a/d36/f9d 0 2024-09-17T01:56:31.812 INFO:tasks.workunit.client.0.smithi063.stdout:7/958: chown d2/d15/d2f/d45/d82/df6/d27/d8f/ca2 14067729 1 2024-09-17T01:56:31.813 INFO:tasks.workunit.client.0.smithi063.stdout:9/991: chown d9/d27/c142 16606 1 2024-09-17T01:56:31.813 INFO:tasks.workunit.client.0.smithi063.stdout:5/971: write d6/d37/d19/d76/d8f/de0/de5/d4f/d116/fdc [894238,97165] 0 2024-09-17T01:56:31.814 INFO:tasks.workunit.client.0.smithi063.stdout:5/972: write d6/d35/dc1/d3f/dac/fe8 [638570,100602] 0 2024-09-17T01:56:31.814 INFO:tasks.workunit.client.0.smithi063.stdout:7/959: rename d2/d98/dea/f102 to d2/d15/d2f/d45/d82/df6/f144 0 2024-09-17T01:56:31.815 INFO:tasks.workunit.client.0.smithi063.stdout:7/960: symlink d2/d15/d2f/d45/d82/l145 0 2024-09-17T01:56:31.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/973: rename d6/d35/dc1/d3a/l70 to d6/d35/dc1/d29/d36/de1/df1/l13e 0 2024-09-17T01:56:31.816 INFO:tasks.workunit.client.0.smithi063.stdout:0/927: write f0 [2775613,63145] 0 2024-09-17T01:56:31.817 INFO:tasks.workunit.client.0.smithi063.stdout:9/992: write d9/d8d/d2a/d36/ded/ff2 [1040128,81253] 0 2024-09-17T01:56:31.817 INFO:tasks.workunit.client.0.smithi063.stdout:7/961: dread - d2/d15/d2f/d3e/d10e/dd4/f103 zero size 2024-09-17T01:56:31.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/974: mknod d6/d9/d133/c13f 0 2024-09-17T01:56:31.817 INFO:tasks.workunit.client.0.smithi063.stdout:0/928: fsync d1/d1d/f99 0 2024-09-17T01:56:31.818 INFO:tasks.workunit.client.0.smithi063.stdout:9/993: rmdir d9/d8d/d2a 39 2024-09-17T01:56:31.819 INFO:tasks.workunit.client.0.smithi063.stdout:5/975: link d6/d35/l48 d6/d35/dc1/l140 0 2024-09-17T01:56:31.819 INFO:tasks.workunit.client.0.smithi063.stdout:7/962: rename d2/d15/d2f/d45/d82/df6/d22/d3a/ld6 to d2/d15/d2f/dd3/l146 0 2024-09-17T01:56:31.820 INFO:tasks.workunit.client.0.smithi063.stdout:9/994: rename d9/f5b to d9/de/d20/d1b/d25/d73/d121/f163 0 2024-09-17T01:56:31.820 INFO:tasks.workunit.client.0.smithi063.stdout:2/962: dread d3/d2a/dac/fff [0,4194304] 0 2024-09-17T01:56:31.821 INFO:tasks.workunit.client.0.smithi063.stdout:2/963: rmdir d3/d7/d76/d108 39 2024-09-17T01:56:31.821 INFO:tasks.workunit.client.0.smithi063.stdout:9/995: mkdir d9/de/d164 0 2024-09-17T01:56:31.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/963: symlink d2/d15/d2f/d3e/d73/d12f/l147 0 2024-09-17T01:56:31.821 INFO:tasks.workunit.client.0.smithi063.stdout:2/964: fdatasync d3/d7/df/fcb 0 2024-09-17T01:56:31.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/974: dread dc/d1b/f41 [0,4194304] 0 2024-09-17T01:56:31.822 INFO:tasks.workunit.client.0.smithi063.stdout:6/975: symlink dc/d1b/l140 0 2024-09-17T01:56:31.823 INFO:tasks.workunit.client.0.smithi063.stdout:2/965: symlink d3/d7/df/d30/l12d 0 2024-09-17T01:56:31.824 INFO:tasks.workunit.client.0.smithi063.stdout:6/976: fdatasync dc/d14/d18/fdb 0 2024-09-17T01:56:31.824 INFO:tasks.workunit.client.0.smithi063.stdout:2/966: creat d3/d7/d8d/dc0/f12e x:0 0 0 2024-09-17T01:56:31.824 INFO:tasks.workunit.client.0.smithi063.stdout:6/977: chown dc/d14/d18/le4 101 1 2024-09-17T01:56:31.825 INFO:tasks.workunit.client.0.smithi063.stdout:6/978: readlink dc/d1b/d5e/l134 0 2024-09-17T01:56:31.826 INFO:tasks.workunit.client.0.smithi063.stdout:2/967: truncate d3/d7/d8d/fc8 4120424 0 2024-09-17T01:56:31.829 INFO:tasks.workunit.client.0.smithi063.stdout:9/996: dwrite d9/d8d/d2a/d40/f71 [0,4194304] 0 2024-09-17T01:56:31.831 INFO:tasks.workunit.client.0.smithi063.stdout:7/964: dwrite d2/d15/d2f/d3e/d10e/dca/fd1 [0,4194304] 0 2024-09-17T01:56:31.832 INFO:tasks.workunit.client.0.smithi063.stdout:8/865: dread d1/f2 [4194304,4194304] 0 2024-09-17T01:56:31.832 INFO:tasks.workunit.client.0.smithi063.stdout:9/997: write d9/de/f2f [6738708,107989] 0 2024-09-17T01:56:31.833 INFO:tasks.workunit.client.0.smithi063.stdout:7/965: dread - d2/d15/d2f/d3e/d10e/dd4/f103 zero size 2024-09-17T01:56:31.834 INFO:tasks.workunit.client.0.smithi063.stdout:8/866: symlink d1/d7/d28/d2a/d37/d3a/d75/dc2/l10c 0 2024-09-17T01:56:31.835 INFO:tasks.workunit.client.0.smithi063.stdout:3/974: sync 2024-09-17T01:56:31.835 INFO:tasks.workunit.client.0.smithi063.stdout:2/968: dwrite d3/d7/df/d30/f104 [0,4194304] 0 2024-09-17T01:56:31.835 INFO:tasks.workunit.client.0.smithi063.stdout:7/966: read - d2/d15/d2f/d3e/d10e/dd4/f103 zero size 2024-09-17T01:56:31.837 INFO:tasks.workunit.client.0.smithi063.stdout:2/969: write d3/d7/d38/da9/d102/f53 [4818437,80246] 0 2024-09-17T01:56:31.837 INFO:tasks.workunit.client.0.smithi063.stdout:7/967: creat d2/d15/d2f/d45/d48/f148 x:0 0 0 2024-09-17T01:56:31.837 INFO:tasks.workunit.client.0.smithi063.stdout:3/975: rename df/d28/c34 to df/d12/d3a/d139/c147 0 2024-09-17T01:56:31.838 INFO:tasks.workunit.client.0.smithi063.stdout:2/970: mknod d3/dbc/c12f 0 2024-09-17T01:56:31.838 INFO:tasks.workunit.client.0.smithi063.stdout:0/929: dread d1/d3/db/f39 [0,4194304] 0 2024-09-17T01:56:31.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/971: unlink d3/d7/cfb 0 2024-09-17T01:56:31.839 INFO:tasks.workunit.client.0.smithi063.stdout:6/979: dread dc/d1b/d5e/d13f/d32/d52/d5a/dd0/dd6/d8f/da1/fbb [0,4194304] 0 2024-09-17T01:56:31.839 INFO:tasks.workunit.client.0.smithi063.stdout:8/867: rename d1/d27/d82/fe1 to d1/d7/d1d/d9c/db2/f10d 0 2024-09-17T01:56:31.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/972: chown d3/d28/lce 8082213 1 2024-09-17T01:56:31.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/930: mkdir d1/d1d/d6d/db0/d130 0 2024-09-17T01:56:31.840 INFO:tasks.workunit.client.0.smithi063.stdout:8/868: mkdir d1/d7/d28/d2a/d37/df3/d10b/d10e 0 2024-09-17T01:56:31.841 INFO:tasks.workunit.client.0.smithi063.stdout:7/968: rename d2/d15/d2f/d3e/d73/d96 to d2/d15/d2f/d45/d82/df6/d27/d65/d149 0 2024-09-17T01:56:31.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/973: creat d3/f130 x:0 0 0 2024-09-17T01:56:31.842 INFO:tasks.workunit.client.0.smithi063.stdout:2/974: dread - d3/d7/df/fd7 zero size 2024-09-17T01:56:31.842 INFO:tasks.workunit.client.0.smithi063.stdout:6/980: unlink dc/d1b/d5e/d13f/d32/d52/d5a/c9e 0 2024-09-17T01:56:31.842 INFO:tasks.workunit.client.0.smithi063.stdout:8/869: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/c101 371884999 1 2024-09-17T01:56:31.842 INFO:tasks.workunit.client.0.smithi063.stdout:2/975: mkdir d3/d7/df/d43/d131 0 2024-09-17T01:56:31.844 INFO:tasks.workunit.client.0.smithi063.stdout:7/969: getdents d2/d15/d2f/d45/d82/df6/de4/d10f 0 2024-09-17T01:56:31.844 INFO:tasks.workunit.client.0.smithi063.stdout:6/981: write dc/d14/d2f/f5b [3367047,9607] 0 2024-09-17T01:56:31.844 INFO:tasks.workunit.client.0.smithi063.stdout:2/976: write d3/f91 [37405,58916] 0 2024-09-17T01:56:31.844 INFO:tasks.workunit.client.0.smithi063.stdout:6/982: fsync dc/f12 0 2024-09-17T01:56:31.845 INFO:tasks.workunit.client.0.smithi063.stdout:2/977: stat d3/d7/feb 0 2024-09-17T01:56:31.845 INFO:tasks.workunit.client.0.smithi063.stdout:7/970: write d2/d15/d2f/d45/d82/df6/d17/d25/f9f [1035209,46406] 0 2024-09-17T01:56:31.846 INFO:tasks.workunit.client.0.smithi063.stdout:2/978: rename d3/d7/d76/f77 to d3/d7/d76/d108/f132 0 2024-09-17T01:56:31.847 INFO:tasks.workunit.client.0.smithi063.stdout:6/983: mknod dc/d1b/d5e/d13f/d32/d52/d5a/dd0/dd6/d8f/dbc/c141 0 2024-09-17T01:56:31.847 INFO:tasks.workunit.client.0.smithi063.stdout:7/971: write d2/d15/d2f/d45/d82/df6/d67/f7c [2385535,33515] 0 2024-09-17T01:56:31.848 INFO:tasks.workunit.client.0.smithi063.stdout:2/979: fdatasync d3/d7/df/d43/fd4 0 2024-09-17T01:56:31.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/998: dread d9/de/d20/d1b/f1f [0,4194304] 0 2024-09-17T01:56:31.849 INFO:tasks.workunit.client.0.smithi063.stdout:0/931: dread d1/d3/db/f13 [0,4194304] 0 2024-09-17T01:56:31.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/972: symlink d2/d15/d2f/d45/d82/df6/d27/d8f/l14a 0 2024-09-17T01:56:31.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/976: dread d6/d9/f28 [0,4194304] 0 2024-09-17T01:56:31.851 INFO:tasks.workunit.client.0.smithi063.stdout:9/999: write d9/d8d/d2a/d40/dac/fe0 [6716860,6265] 0 2024-09-17T01:56:31.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/932: mkdir d1/d3/db/d6e/d86/dcc/d53/d131 0 2024-09-17T01:56:31.853 INFO:tasks.workunit.client.0.smithi063.stdout:6/984: write dc/d1b/d5e/d13f/d32/d52/d5a/dd0/dd6/d8f/da1/fbb [619413,63444] 0 2024-09-17T01:56:31.853 INFO:tasks.workunit.client.0.smithi063.stdout:8/870: dwrite d1/d7/d28/f50 [0,4194304] 0 2024-09-17T01:56:31.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/973: unlink d2/d15/d2f/de7/f8c 0 2024-09-17T01:56:31.853 INFO:tasks.workunit.client.0.smithi063.stdout:5/977: write d6/d35/dc1/d3f/dac/fe8 [451422,84675] 0 2024-09-17T01:56:31.854 INFO:tasks.workunit.client.0.smithi063.stdout:0/933: chown d1/d3/db/d6e/d86/dcc/d53/d62/c6f 2051854 1 2024-09-17T01:56:31.854 INFO:tasks.workunit.client.0.smithi063.stdout:8/871: fdatasync d1/d27/d82/fd9 0 2024-09-17T01:56:31.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/980: write d3/d7/d38/da9/d102/f51 [2865879,96414] 0 2024-09-17T01:56:31.856 INFO:tasks.workunit.client.0.smithi063.stdout:6/985: chown dc/c24 1554 1 2024-09-17T01:56:31.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/974: creat d2/d15/d2f/d45/d82/df6/de4/f14b x:0 0 0 2024-09-17T01:56:31.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/872: readlink d1/d7/d1d/d9c/ld0 0 2024-09-17T01:56:31.856 INFO:tasks.workunit.client.0.smithi063.stdout:5/978: chown d6/d35/dc1/d29/ca1 35 1 2024-09-17T01:56:31.856 INFO:tasks.workunit.client.0.smithi063.stdout:0/934: write d1/d3/db/d6e/d86/dcc/d53/d62/f9d [2145860,4673] 0 2024-09-17T01:56:31.857 INFO:tasks.workunit.client.0.smithi063.stdout:5/979: truncate d6/d9/d13/d1d/f21 1269795 0 2024-09-17T01:56:31.857 INFO:tasks.workunit.client.0.smithi063.stdout:7/975: readlink d2/d98/dea/l129 0 2024-09-17T01:56:31.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/873: creat d1/d7/d28/d2a/d37/df3/d10b/d10e/f10f x:0 0 0 2024-09-17T01:56:31.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/874: rmdir d1/d7/d1d/dfd 0 2024-09-17T01:56:31.861 INFO:tasks.workunit.client.0.smithi063.stdout:3/976: dread df/d12/d43/d50/d58/f6b [0,4194304] 0 2024-09-17T01:56:31.863 INFO:tasks.workunit.client.0.smithi063.stdout:6/986: dwrite dc/d1b/ffa [0,4194304] 0 2024-09-17T01:56:31.865 INFO:tasks.workunit.client.0.smithi063.stdout:5/980: dwrite d6/d35/dc1/d29/d36/fb6 [0,4194304] 0 2024-09-17T01:56:31.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/875: dwrite d1/f5c [0,4194304] 0 2024-09-17T01:56:31.867 INFO:tasks.workunit.client.0.smithi063.stdout:5/981: creat d6/d35/dc1/d54/f141 x:0 0 0 2024-09-17T01:56:31.871 INFO:tasks.workunit.client.0.smithi063.stdout:6/987: dwrite dc/d14/d18/d74/f88 [8388608,4194304] 0 2024-09-17T01:56:31.873 INFO:tasks.workunit.client.0.smithi063.stdout:6/988: symlink dc/d14/d2f/de7/d12e/l142 0 2024-09-17T01:56:31.874 INFO:tasks.workunit.client.0.smithi063.stdout:6/989: rename dc/d1b/d5e/d13f/d32/d52/d5a/dd0/dd6/d8f/da1/dde to dc/d14/d18/d74/d143 0 2024-09-17T01:56:31.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/990: readlink dc/d1b/d5e/d13f/d32/d52/d5a/d62/l95 0 2024-09-17T01:56:31.877 INFO:tasks.workunit.client.0.smithi063.stdout:8/876: dwrite d1/d7/d28/d2a/d37/df3/d10b/d10e/f10f [0,4194304] 0 2024-09-17T01:56:31.877 INFO:tasks.workunit.client.0.smithi063.stdout:6/991: unlink dc/d1b/d5e/d13f/c3f 0 2024-09-17T01:56:31.882 INFO:tasks.workunit.client.0.smithi063.stdout:8/877: dread d1/d7/d28/d2a/d37/df3/d10b/d10e/f10f [0,4194304] 0 2024-09-17T01:56:31.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/976: dread d2/d15/d2f/d3e/d73/dcd/ffe [0,4194304] 0 2024-09-17T01:56:31.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/982: dread d6/d9/d32/f8e [0,4194304] 0 2024-09-17T01:56:31.883 INFO:tasks.workunit.client.0.smithi063.stdout:8/878: getdents d1/d7/d28/d2a/d37/d3a/d85/d108 0 2024-09-17T01:56:31.883 INFO:tasks.workunit.client.0.smithi063.stdout:0/935: dread d1/d3/db/d18/d33/f67 [0,4194304] 0 2024-09-17T01:56:31.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/977: creat d2/d15/d2f/d45/d82/df6/d17/d25/db0/f14c x:0 0 0 2024-09-17T01:56:31.884 INFO:tasks.workunit.client.0.smithi063.stdout:8/879: rmdir d1/d27/d81/da4/dc7 39 2024-09-17T01:56:31.884 INFO:tasks.workunit.client.0.smithi063.stdout:8/880: chown d1/d7/d28/d2a/d37/d3a/d85 2585118 1 2024-09-17T01:56:31.887 INFO:tasks.workunit.client.0.smithi063.stdout:0/936: dread d1/d3/db/f42 [0,4194304] 0 2024-09-17T01:56:31.888 INFO:tasks.workunit.client.0.smithi063.stdout:0/937: dread - d1/d1d/d6d/fe7 zero size 2024-09-17T01:56:31.889 INFO:tasks.workunit.client.0.smithi063.stdout:5/983: dwrite d6/d35/dc1/d29/d36/f7d [0,4194304] 0 2024-09-17T01:56:31.891 INFO:tasks.workunit.client.0.smithi063.stdout:0/938: rename d1/d3/db/d18/d33/d83/laa to d1/d3/db/d6e/d86/dcc/d53/d62/l132 0 2024-09-17T01:56:31.892 INFO:tasks.workunit.client.0.smithi063.stdout:3/977: dread df/d12/d2d/f4c [0,4194304] 0 2024-09-17T01:56:31.892 INFO:tasks.workunit.client.0.smithi063.stdout:7/978: dwrite d2/d15/d2f/d45/d82/df6/d67/f119 [0,4194304] 0 2024-09-17T01:56:31.894 INFO:tasks.workunit.client.0.smithi063.stdout:8/881: write d1/f10 [5154180,87408] 0 2024-09-17T01:56:31.894 INFO:tasks.workunit.client.0.smithi063.stdout:7/979: write d2/d15/d2f/d52/f94 [1557882,25952] 0 2024-09-17T01:56:31.895 INFO:tasks.workunit.client.0.smithi063.stdout:8/882: fdatasync d1/d7/d28/d2a/d37/d3a/d85/f93 0 2024-09-17T01:56:31.896 INFO:tasks.workunit.client.0.smithi063.stdout:7/980: chown d2/d15/d2f/d45/d82/df6/d27/d39/f46 15593 1 2024-09-17T01:56:31.897 INFO:tasks.workunit.client.0.smithi063.stdout:8/883: creat d1/d7/d28/d2a/d37/d3a/daf/dfe/f110 x:0 0 0 2024-09-17T01:56:31.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/981: rename d2/d15/d2f/d45/d82/df6/d27/d39/deb/f11c to d2/d15/d2f/db9/f14d 0 2024-09-17T01:56:31.898 INFO:tasks.workunit.client.0.smithi063.stdout:8/884: dread - d1/d7/d28/d2a/d37/d3a/d75/fc1 zero size 2024-09-17T01:56:31.898 INFO:tasks.workunit.client.0.smithi063.stdout:0/939: truncate d1/d3/db/d18/d33/f71 3985451 0 2024-09-17T01:56:31.898 INFO:tasks.workunit.client.0.smithi063.stdout:7/982: dread - d2/d15/d2f/d45/d82/df6/d22/d3a/f12b zero size 2024-09-17T01:56:31.899 INFO:tasks.workunit.client.0.smithi063.stdout:3/978: read df/d12/d3a/fed [1466463,76885] 0 2024-09-17T01:56:31.899 INFO:tasks.workunit.client.0.smithi063.stdout:8/885: fdatasync d1/d7/d28/d87/f8e 0 2024-09-17T01:56:31.899 INFO:tasks.workunit.client.0.smithi063.stdout:7/983: creat d2/d15/d2f/d3e/d10e/dd4/d128/f14e x:0 0 0 2024-09-17T01:56:31.900 INFO:tasks.workunit.client.0.smithi063.stdout:0/940: link d1/d3/d1b/d50/ff3 d1/d3/db/d6e/d86/dcc/f133 0 2024-09-17T01:56:31.900 INFO:tasks.workunit.client.0.smithi063.stdout:8/886: write d1/d27/d81/da4/dc7/ff0 [463195,62298] 0 2024-09-17T01:56:31.901 INFO:tasks.workunit.client.0.smithi063.stdout:7/984: chown d2/d15/d2f/d45/d82/df6/l26 15821750 1 2024-09-17T01:56:31.904 INFO:tasks.workunit.client.0.smithi063.stdout:3/979: dwrite df/d12/d3a/df7/f137 [0,4194304] 0 2024-09-17T01:56:31.906 INFO:tasks.workunit.client.0.smithi063.stdout:3/980: mknod df/d12/d3a/d7a/c148 0 2024-09-17T01:56:31.907 INFO:tasks.workunit.client.0.smithi063.stdout:7/985: dwrite d2/d15/d2f/dd3/fdc [4194304,4194304] 0 2024-09-17T01:56:31.908 INFO:tasks.workunit.client.0.smithi063.stdout:3/981: rmdir df/d12/d43/d50/d58/db5/d13a 0 2024-09-17T01:56:31.909 INFO:tasks.workunit.client.0.smithi063.stdout:3/982: chown l8 306002 1 2024-09-17T01:56:31.909 INFO:tasks.workunit.client.0.smithi063.stdout:3/983: stat df/d12/d2d/f12f 0 2024-09-17T01:56:31.910 INFO:tasks.workunit.client.0.smithi063.stdout:3/984: creat df/d12/d30/db8/f149 x:0 0 0 2024-09-17T01:56:31.913 INFO:tasks.workunit.client.0.smithi063.stdout:3/985: symlink df/d12/d1e/d53/l14a 0 2024-09-17T01:56:31.913 INFO:tasks.workunit.client.0.smithi063.stdout:5/984: dread d6/d37/d19/de4/ff8 [0,4194304] 0 2024-09-17T01:56:31.913 INFO:tasks.workunit.client.0.smithi063.stdout:3/986: symlink df/d12/d30/d8a/d9d/l14b 0 2024-09-17T01:56:31.914 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:31.917+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:31.914 INFO:tasks.workunit.client.0.smithi063.stdout:5/985: chown d6/d37/d19/d50/d98/da0/lc5 1171824 1 2024-09-17T01:56:31.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/986: fsync d6/d37/d19/d76/d8f/de0/de5/d4f/d116/f131 0 2024-09-17T01:56:31.916 INFO:tasks.workunit.client.0.smithi063.stdout:7/986: dwrite d2/d15/d2f/d45/d82/df6/d27/d33/d7b/fa5 [0,4194304] 0 2024-09-17T01:56:31.917 INFO:tasks.workunit.client.0.smithi063.stdout:5/987: mkdir d6/d35/dc1/d3a/d142 0 2024-09-17T01:56:31.918 INFO:tasks.workunit.client.0.smithi063.stdout:7/987: symlink d2/d15/d2f/d45/d82/df6/d27/d33/d7b/l14f 0 2024-09-17T01:56:31.919 INFO:tasks.workunit.client.0.smithi063.stdout:2/981: sync 2024-09-17T01:56:31.919 INFO:tasks.workunit.client.0.smithi063.stdout:8/887: sync 2024-09-17T01:56:31.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/988: write d6/d37/d19/d76/d8f/de0/de5/fb7 [222107,78793] 0 2024-09-17T01:56:31.920 INFO:tasks.workunit.client.0.smithi063.stdout:2/982: stat d3/d7/df/d43/ldc 0 2024-09-17T01:56:31.920 INFO:tasks.workunit.client.0.smithi063.stdout:8/888: stat d1/d7/d28/f9f 0 2024-09-17T01:56:31.920 INFO:tasks.workunit.client.0.smithi063.stdout:2/983: chown d3/d28/l80 918 1 2024-09-17T01:56:31.920 INFO:tasks.workunit.client.0.smithi063.stdout:5/989: fsync d6/d9/d13/f10e 0 2024-09-17T01:56:31.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/889: symlink d1/d7/d28/d2a/d37/d3a/d85/l111 0 2024-09-17T01:56:31.922 INFO:tasks.workunit.client.0.smithi063.stdout:8/890: link d1/d7/d28/d2a/d44/cf5 d1/d7/d28/d2a/d44/c112 0 2024-09-17T01:56:31.922 INFO:tasks.workunit.client.0.smithi063.stdout:8/891: chown d1/d7/d28/d87/df2 66574217 1 2024-09-17T01:56:31.924 INFO:tasks.workunit.client.0.smithi063.stdout:8/892: creat d1/d7/d28/d2a/d37/d3a/d85/d108/f113 x:0 0 0 2024-09-17T01:56:31.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/984: dwrite d3/d7/d38/da9/d102/f74 [0,4194304] 0 2024-09-17T01:56:31.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/985: read d3/d7/d38/f45 [3418317,24943] 0 2024-09-17T01:56:31.929 INFO:tasks.workunit.client.0.smithi063.stdout:2/986: rmdir d3/d28/d72/dd5 39 2024-09-17T01:56:31.931 INFO:tasks.workunit.client.0.smithi063.stdout:8/893: dwrite d1/d7/d28/d2a/d37/d3a/d85/fd5 [0,4194304] 0 2024-09-17T01:56:31.933 INFO:tasks.workunit.client.0.smithi063.stdout:8/894: truncate d1/d7/d28/d2a/d4d/fde 51189 0 2024-09-17T01:56:31.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/990: dread d6/d37/d19/d50/f100 [0,4194304] 0 2024-09-17T01:56:31.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/895: link d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49/f23 d1/d7/f114 0 2024-09-17T01:56:31.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/896: symlink d1/d7/d1d/d9c/l115 0 2024-09-17T01:56:31.937 INFO:tasks.workunit.client.0.smithi063.stdout:8/897: mknod d1/d7/d28/d2a/d37/d3a/d75/dc2/c116 0 2024-09-17T01:56:31.938 INFO:tasks.workunit.client.0.smithi063.stdout:8/898: read - d1/d7/d28/d2a/d37/df3/fff zero size 2024-09-17T01:56:31.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/899: readlink d1/d7/d28/d2a/d37/d3a/l60 0 2024-09-17T01:56:31.939 INFO:tasks.workunit.client.0.smithi063.stdout:5/991: dwrite d6/d35/dc1/f9e [0,4194304] 0 2024-09-17T01:56:31.940 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:31.940 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:31.944 INFO:tasks.workunit.client.0.smithi063.stdout:0/941: dread d1/d3/db/d6e/d86/dcc/d53/f8b [0,4194304] 0 2024-09-17T01:56:31.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/942: chown d1/d3/db/d6e/d86/dcc/d53/d62/l124 1059 1 2024-09-17T01:56:31.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/992: sync 2024-09-17T01:56:31.945 INFO:tasks.workunit.client.0.smithi063.stdout:3/987: sync 2024-09-17T01:56:31.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/992: sync 2024-09-17T01:56:31.946 INFO:tasks.workunit.client.0.smithi063.stdout:2/987: sync 2024-09-17T01:56:31.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/900: dwrite d1/d7/d1d/f40 [0,4194304] 0 2024-09-17T01:56:31.947 INFO:tasks.workunit.client.0.smithi063.stdout:0/943: creat d1/d1d/d74/d9a/f134 x:0 0 0 2024-09-17T01:56:31.947 INFO:tasks.workunit.client.0.smithi063.stdout:5/993: chown d6/d9/d13/c65 383315 1 2024-09-17T01:56:31.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/993: read - dc/d1b/d5e/d13f/d32/d68/d9c/fab zero size 2024-09-17T01:56:31.947 INFO:tasks.workunit.client.0.smithi063.stdout:8/901: creat d1/d27/d82/f117 x:0 0 0 2024-09-17T01:56:31.948 INFO:tasks.workunit.client.0.smithi063.stdout:3/988: creat df/d12/d43/d50/d58/d97/daa/db1/dcc/d124/f14c x:0 0 0 2024-09-17T01:56:31.948 INFO:tasks.workunit.client.0.smithi063.stdout:0/944: write d1/d3/d1b/d50/f68 [420826,19861] 0 2024-09-17T01:56:31.948 INFO:tasks.workunit.client.0.smithi063.stdout:5/994: write d6/d35/dc1/d29/d36/f97 [1640839,66236] 0 2024-09-17T01:56:31.948 INFO:tasks.workunit.client.0.smithi063.stdout:6/994: truncate dc/d14/d2f/f51 1488774 0 2024-09-17T01:56:31.948 INFO:tasks.workunit.client.0.smithi063.stdout:3/989: write df/d12/d1e/d39/f6c [952694,82021] 0 2024-09-17T01:56:31.949 INFO:tasks.workunit.client.0.smithi063.stdout:0/945: creat d1/d3/db/d18/d33/d83/f135 x:0 0 0 2024-09-17T01:56:31.949 INFO:tasks.workunit.client.0.smithi063.stdout:6/995: readlink dc/d1b/d5e/d13f/d32/l67 0 2024-09-17T01:56:31.950 INFO:tasks.workunit.client.0.smithi063.stdout:5/995: getdents d6/d35/dc1/d69 0 2024-09-17T01:56:31.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/990: creat df/d12/d43/d50/d58/db5/f14d x:0 0 0 2024-09-17T01:56:31.950 INFO:tasks.workunit.client.0.smithi063.stdout:0/946: creat d1/d3/db/d4b/d2f/f136 x:0 0 0 2024-09-17T01:56:31.951 INFO:tasks.workunit.client.0.smithi063.stdout:6/996: fsync dc/d14/f70 0 2024-09-17T01:56:31.951 INFO:tasks.workunit.client.0.smithi063.stdout:3/991: creat df/d12/d43/d50/d58/d97/daa/db1/dcc/f14e x:0 0 0 2024-09-17T01:56:31.952 INFO:tasks.workunit.client.0.smithi063.stdout:5/996: link d6/d9/d133/c13f d6/d37/d19/d76/d8f/de0/de5/da4/c143 0 2024-09-17T01:56:31.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/947: link d1/d3/d10/f81 d1/d3/d10/f137 0 2024-09-17T01:56:31.953 INFO:tasks.workunit.client.0.smithi063.stdout:3/992: fsync df/d12/d30/d11b/f121 0 2024-09-17T01:56:31.953 INFO:tasks.workunit.client.0.smithi063.stdout:6/997: getdents dc/d14/d2f/de7 0 2024-09-17T01:56:31.954 INFO:tasks.workunit.client.0.smithi063.stdout:5/997: creat d6/d35/dc1/d3a/f144 x:0 0 0 2024-09-17T01:56:31.955 INFO:tasks.workunit.client.0.smithi063.stdout:3/993: mknod df/d12/d3a/c14f 0 2024-09-17T01:56:31.956 INFO:tasks.workunit.client.0.smithi063.stdout:0/948: getdents d1/d3/db/d18/d33/d83/db7/dd8 0 2024-09-17T01:56:31.956 INFO:tasks.workunit.client.0.smithi063.stdout:6/998: read dc/d14/d18/d91/f10b [117001,62278] 0 2024-09-17T01:56:31.959 INFO:tasks.workunit.client.0.smithi063.stdout:0/949: rename d1/d3/db/d6e/d86/dcc/la1 to d1/d3/db/d4b/d98/ddd/l138 0 2024-09-17T01:56:31.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:31.962 INFO:tasks.workunit.client.0.smithi063.stdout:8/902: dread d1/d7/d28/d2a/d37/d3a/d75/fdd [0,4194304] 0 2024-09-17T01:56:31.962 INFO:tasks.workunit.client.0.smithi063.stdout:0/950: creat d1/d3/db/d6e/f139 x:0 0 0 2024-09-17T01:56:31.963 INFO:tasks.workunit.client.0.smithi063.stdout:5/998: dwrite d6/d9/d32/d8c/fc9 [0,4194304] 0 2024-09-17T01:56:31.963 INFO:tasks.workunit.client.0.smithi063.stdout:6/999: dread dc/d14/d19/f7b [0,4194304] 0 2024-09-17T01:56:31.964 INFO:tasks.workunit.client.0.smithi063.stdout:0/951: rmdir d1/d3/d10 39 2024-09-17T01:56:31.965 INFO:tasks.workunit.client.0.smithi063.stdout:3/994: dwrite df/d12/d43/d50/dfb/dbb/fdd [0,4194304] 0 2024-09-17T01:56:31.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/988: dread d2/d15/d2f/d45/d82/df6/d27/d39/f46 [0,4194304] 0 2024-09-17T01:56:31.966 INFO:tasks.workunit.client.0.smithi063.stdout:0/952: chown d1/d3/db/d6e/d86/dcc/d7c/l10b 10066 1 2024-09-17T01:56:31.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/989: sync 2024-09-17T01:56:31.966 INFO:tasks.workunit.client.0.smithi063.stdout:3/995: fdatasync df/d12/d30/db8/f149 0 2024-09-17T01:56:31.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/999: mknod d6/d37/d19/d50/d92/c145 0 2024-09-17T01:56:31.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-09-17T01:56:31.968 INFO:tasks.workunit.client.0.smithi063.stdout:0/953: chown d1/d3/db/c5e 1376091 1 2024-09-17T01:56:31.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/996: write df/d28/f118 [666567,39311] 0 2024-09-17T01:56:31.968 INFO:tasks.workunit.client.0.smithi063.stdout:7/990: rmdir d2/d15/d2f 39 2024-09-17T01:56:31.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/997: rmdir df/d12/d43/d50 39 2024-09-17T01:56:31.969 INFO:tasks.workunit.client.0.smithi063.stdout:0/954: creat d1/d3/db/d4b/d98/f13a x:0 0 0 2024-09-17T01:56:31.969 INFO:tasks.workunit.client.0.smithi063.stdout:7/991: write d2/d15/d2f/f64 [744225,11495] 0 2024-09-17T01:56:31.971 INFO:tasks.workunit.client.0.smithi063.stdout:2/988: dread d3/d7/d38/da9/d102/f46 [0,4194304] 0 2024-09-17T01:56:31.971 INFO:tasks.workunit.client.0.smithi063.stdout:2/989: truncate d3/d7/d8d/da4/fe8 145643 0 2024-09-17T01:56:31.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/992: link d2/d15/d2f/d45/d82/df6/d27/d65/c136 d2/d15/d2f/d45/d48/c150 0 2024-09-17T01:56:31.972 INFO:tasks.workunit.client.0.smithi063.stdout:8/903: truncate d1/d27/d81/da4/dc7/ff0 614422 0 2024-09-17T01:56:31.972 INFO:tasks.workunit.client.0.smithi063.stdout:8/904: creat d1/d7/d28/d2a/d44/d6e/f118 x:0 0 0 2024-09-17T01:56:31.974 INFO:tasks.workunit.client.0.smithi063.stdout:2/990: write d3/f4 [1956596,70016] 0 2024-09-17T01:56:31.974 INFO:tasks.workunit.client.0.smithi063.stdout:0/955: write d1/d3/db/f42 [4079660,16396] 0 2024-09-17T01:56:31.974 INFO:tasks.workunit.client.0.smithi063.stdout:8/905: rename d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/d49 to d1/d7/d119 0 2024-09-17T01:56:31.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/956: fdatasync d1/d3/db/d6e/d86/dcc/f133 0 2024-09-17T01:56:31.976 INFO:tasks.workunit.client.0.smithi063.stdout:0/957: sync 2024-09-17T01:56:31.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/991: truncate d3/d28/d72/dd5/fde 795662 0 2024-09-17T01:56:31.976 INFO:tasks.workunit.client.0.smithi063.stdout:8/906: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/f11a x:0 0 0 2024-09-17T01:56:31.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/992: sync 2024-09-17T01:56:31.977 INFO:tasks.workunit.client.0.smithi063.stdout:0/958: symlink d1/d3/d1b/d50/d6c/l13b 0 2024-09-17T01:56:31.977 INFO:tasks.workunit.client.0.smithi063.stdout:8/907: symlink d1/d27/d81/da4/l11b 0 2024-09-17T01:56:31.978 INFO:tasks.workunit.client.0.smithi063.stdout:8/908: read d1/d7/d28/d2a/d37/d3a/d85/fd5 [980242,74238] 0 2024-09-17T01:56:31.981 INFO:tasks.workunit.client.0.smithi063.stdout:3/998: dread df/d12/d1e/d39/f91 [0,4194304] 0 2024-09-17T01:56:31.982 INFO:tasks.workunit.client.0.smithi063.stdout:2/993: dwrite d3/d2a/f3d [0,4194304] 0 2024-09-17T01:56:31.985 INFO:tasks.workunit.client.0.smithi063.stdout:3/999: creat df/d12/d43/d50/d58/f150 x:0 0 0 2024-09-17T01:56:31.985 INFO:tasks.workunit.client.0.smithi063.stdout:2/994: unlink d3/d7/d76/l9e 0 2024-09-17T01:56:31.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/995: mkdir d3/d7/d8d/d133 0 2024-09-17T01:56:31.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/996: symlink d3/d7/d38/l134 0 2024-09-17T01:56:31.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/909: dwrite d1/d7/d28/d2a/d44/f73 [0,4194304] 0 2024-09-17T01:56:31.988 INFO:tasks.workunit.client.0.smithi063.stdout:8/910: write d1/d7/d28/faa [717247,31831] 0 2024-09-17T01:56:31.988 INFO:tasks.workunit.client.0.smithi063.stdout:8/911: sync 2024-09-17T01:56:31.989 INFO:tasks.workunit.client.0.smithi063.stdout:8/912: stat d1/d7/d28/d2a/d44 0 2024-09-17T01:56:31.989 INFO:tasks.workunit.client.0.smithi063.stdout:0/959: dread d1/d3/db/d4b/d98/ddd/ffb [0,4194304] 0 2024-09-17T01:56:31.990 INFO:tasks.workunit.client.0.smithi063.stdout:8/913: fdatasync d1/d27/d81/da4/fe0 0 2024-09-17T01:56:31.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/993: dread d2/d15/d2f/de7/fae [0,4194304] 0 2024-09-17T01:56:31.991 INFO:tasks.workunit.client.0.smithi063.stdout:0/960: mknod d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/c13c 0 2024-09-17T01:56:31.994 INFO:tasks.workunit.client.0.smithi063.stdout:2/997: dwrite d3/d7/df/d43/f55 [4194304,4194304] 0 2024-09-17T01:56:31.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/994: dread d2/d15/d2f/d45/d82/df6/ffa [0,4194304] 0 2024-09-17T01:56:31.996 INFO:tasks.workunit.client.0.smithi063.stdout:7/995: creat d2/d15/d2f/d45/d82/df6/d22/d3a/f151 x:0 0 0 2024-09-17T01:56:31.996 INFO:tasks.workunit.client.0.smithi063.stdout:2/998: link d3/d7/d38/l134 d3/d2a/dac/l135 0 2024-09-17T01:56:31.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/999: creat d3/dbc/f136 x:0 0 0 2024-09-17T01:56:31.997 INFO:tasks.workunit.client.0.smithi063.stdout:7/996: creat d2/d15/d2f/d3e/d73/f152 x:0 0 0 2024-09-17T01:56:31.998 INFO:tasks.workunit.client.0.smithi063.stdout:7/997: getdents d2/d98/dea 0 2024-09-17T01:56:31.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/998: rmdir d2/d15/d2f/d45/d82/df6/d27/d33/d7b/d9b/da6 39 2024-09-17T01:56:31.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/999: write d2/fb [4454905,9644] 0 2024-09-17T01:56:32.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/961: dread d1/d3/db/d18/d33/d83/fac [0,4194304] 0 2024-09-17T01:56:32.004 INFO:tasks.workunit.client.0.smithi063.stdout:8/914: dread d1/d7/d28/d2a/d37/d3a/f3c [0,4194304] 0 2024-09-17T01:56:32.006 INFO:tasks.workunit.client.0.smithi063.stdout:8/915: rename d1/d7/d28/d2a/d53/lb0 to d1/d27/d81/da4/dc7/d102/l11c 0 2024-09-17T01:56:32.006 INFO:tasks.workunit.client.0.smithi063.stdout:8/916: fsync d1/f16 0 2024-09-17T01:56:32.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/917: write d1/d7/d28/d2a/d37/d3a/d75/d9a/fa2 [5114547,19965] 0 2024-09-17T01:56:32.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/918: read - d1/d7/d28/d2a/d44/d6e/f118 zero size 2024-09-17T01:56:32.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/962: dwrite d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda/f12e [0,4194304] 0 2024-09-17T01:56:32.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/963: stat d1/d3/db/d6e/d86/dcc/fca 0 2024-09-17T01:56:32.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/964: write d1/d3/db/d18/d33/d83/f135 [8390,64148] 0 2024-09-17T01:56:32.011 INFO:tasks.workunit.client.0.smithi063.stdout:8/919: fsync d1/ffa 0 2024-09-17T01:56:32.011 INFO:tasks.workunit.client.0.smithi063.stdout:0/965: chown d1/d3/d1b/d50/ff3 4687158 1 2024-09-17T01:56:32.013 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.013+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.016 INFO:tasks.workunit.client.0.smithi063.stdout:0/966: dwrite d1/d3/db/d18/d33/d83/db7/ffc [0,4194304] 0 2024-09-17T01:56:32.018 INFO:tasks.workunit.client.0.smithi063.stdout:0/967: truncate d1/d3/db/d4b/d2f/d56/f57 5213831 0 2024-09-17T01:56:32.028 INFO:tasks.workunit.client.0.smithi063.stdout:8/920: dread d1/d7/d28/d2a/f5b [0,4194304] 0 2024-09-17T01:56:32.041 INFO:tasks.workunit.client.0.smithi063.stdout:8/921: dread d1/d7/d1d/f7f [0,4194304] 0 2024-09-17T01:56:32.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/922: chown d1/d7/d28/d2a/d59/fdb 4154 1 2024-09-17T01:56:32.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/923: mknod d1/d7/d28/d2a/d37/d3a/d75/dc2/c11d 0 2024-09-17T01:56:32.043 INFO:tasks.workunit.client.0.smithi063.stdout:8/924: write d1/d7/d28/d2a/d53/f55 [4906536,105186] 0 2024-09-17T01:56:32.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/925: dwrite d1/d7/d119/f61 [0,4194304] 0 2024-09-17T01:56:32.049 INFO:tasks.workunit.client.0.smithi063.stdout:8/926: mkdir d1/d7/d28/d2a/d44/d11e 0 2024-09-17T01:56:32.050 INFO:tasks.workunit.client.0.smithi063.stdout:8/927: write d1/d7/d28/d2a/d37/df3/fff [160517,110385] 0 2024-09-17T01:56:32.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/968: sync 2024-09-17T01:56:32.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/969: fsync d1/f1e 0 2024-09-17T01:56:32.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/928: dread d1/d7/d1d/f40 [0,4194304] 0 2024-09-17T01:56:32.060 INFO:tasks.workunit.client.0.smithi063.stdout:8/929: truncate d1/d7/d1d/f1f 2896 0 2024-09-17T01:56:32.061 INFO:tasks.workunit.client.0.smithi063.stdout:8/930: unlink d1/d7/d119/f1b 0 2024-09-17T01:56:32.062 INFO:tasks.workunit.client.0.smithi063.stdout:8/931: rename d1/d7/d119/f3b to d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f11f 0 2024-09-17T01:56:32.063 INFO:tasks.workunit.client.0.smithi063.stdout:8/932: rename d1/d7/d28/d2a/ca7 to d1/d27/d81/da4/dc7/d102/c120 0 2024-09-17T01:56:32.064 INFO:tasks.workunit.client.0.smithi063.stdout:8/933: chown d1/fb5 13 1 2024-09-17T01:56:32.068 INFO:tasks.workunit.client.0.smithi063.stdout:8/934: dwrite d1/d7/d28/ffb [0,4194304] 0 2024-09-17T01:56:32.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/935: dread d1/f5c [0,4194304] 0 2024-09-17T01:56:32.073 INFO:tasks.workunit.client.0.smithi063.stdout:8/936: write d1/f5c [89342,121054] 0 2024-09-17T01:56:32.074 INFO:tasks.workunit.client.0.smithi063.stdout:8/937: symlink d1/d7/d28/d2a/d37/d3a/daf/dfe/l121 0 2024-09-17T01:56:32.079 INFO:tasks.workunit.client.0.smithi063.stdout:8/938: dwrite d1/d7/f39 [0,4194304] 0 2024-09-17T01:56:32.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/939: chown d1/d7/d1d/d9c 335009886 1 2024-09-17T01:56:32.080 INFO:tasks.workunit.client.0.smithi063.stdout:0/970: dread d1/d3/db/d4b/f22 [0,4194304] 0 2024-09-17T01:56:32.086 INFO:tasks.workunit.client.0.smithi063.stdout:8/940: truncate d1/d27/d81/fbf 744228 0 2024-09-17T01:56:32.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/971: truncate d1/d3/d10/f5a 4257258 0 2024-09-17T01:56:32.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/972: truncate d1/d3/db/d4b/fbb 598433 0 2024-09-17T01:56:32.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/941: link d1/d7/d28/d2a/d37/d3a/d85/lca d1/d7/d28/d2a/d37/df3/d10b/l122 0 2024-09-17T01:56:32.088 INFO:tasks.workunit.client.0.smithi063.stdout:0/973: getdents d1/d3/d32/d63 0 2024-09-17T01:56:32.088 INFO:tasks.workunit.client.0.smithi063.stdout:8/942: symlink d1/d7/d28/d2a/d59/l123 0 2024-09-17T01:56:32.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/974: rmdir d1/d3/db/d6e/d86/dcc/d53/d62/dcd/dda 39 2024-09-17T01:56:32.089 INFO:tasks.workunit.client.0.smithi063.stdout:8/943: chown d1/d7/d28/d2a/d44/c56 26013174 1 2024-09-17T01:56:32.089 INFO:tasks.workunit.client.0.smithi063.stdout:8/944: chown d1/d7/d28/ffb 257367805 1 2024-09-17T01:56:32.090 INFO:tasks.workunit.client.0.smithi063.stdout:8/945: truncate d1/d27/f10a 479403 0 2024-09-17T01:56:32.090 INFO:tasks.workunit.client.0.smithi063.stdout:8/946: stat d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/ced 0 2024-09-17T01:56:32.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/947: readlink d1/d27/d81/da4/dc7/l103 0 2024-09-17T01:56:32.096 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:32.096 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:32.109 INFO:tasks.workunit.client.0.smithi063.stdout:8/948: dread d1/d7/d28/d2a/d53/f55 [0,4194304] 0 2024-09-17T01:56:32.110 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:32.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/949: chown d1/d7/d28/c48 240 1 2024-09-17T01:56:32.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/950: rmdir d1 39 2024-09-17T01:56:32.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/951: truncate d1/d7/d28/f45 561818 0 2024-09-17T01:56:32.118 INFO:tasks.workunit.client.0.smithi063.stdout:0/975: sync 2024-09-17T01:56:32.118 INFO:tasks.workunit.client.0.smithi063.stdout:8/952: dread d1/d7/d28/ffb [0,4194304] 0 2024-09-17T01:56:32.119 INFO:tasks.workunit.client.0.smithi063.stdout:8/953: chown d1/d7/d28/d87/f8e 1 1 2024-09-17T01:56:32.119 INFO:tasks.workunit.client.0.smithi063.stdout:0/976: creat d1/d3/db/d4b/d7d/d10c/f13d x:0 0 0 2024-09-17T01:56:32.120 INFO:tasks.workunit.client.0.smithi063.stdout:0/977: stat d1/d3/d1b/d50/ff3 0 2024-09-17T01:56:32.120 INFO:tasks.workunit.client.0.smithi063.stdout:0/978: stat d1/d3/db/d4b/de0/l10d 0 2024-09-17T01:56:32.121 INFO:tasks.workunit.client.0.smithi063.stdout:8/954: dread d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f11f [0,4194304] 0 2024-09-17T01:56:32.121 INFO:tasks.workunit.client.0.smithi063.stdout:0/979: chown d1/d3/db/d18/d85/d92/dd4/de2 24847 1 2024-09-17T01:56:32.121 INFO:tasks.workunit.client.0.smithi063.stdout:8/955: chown d1/d7/d1d/f7f 980528 1 2024-09-17T01:56:32.122 INFO:tasks.workunit.client.0.smithi063.stdout:0/980: write d1/d3/d1b/f10f [209864,18676] 0 2024-09-17T01:56:32.122 INFO:tasks.workunit.client.0.smithi063.stdout:8/956: creat d1/d7/d28/d2a/d4d/f124 x:0 0 0 2024-09-17T01:56:32.123 INFO:tasks.workunit.client.0.smithi063.stdout:8/957: dread - d1/d7/d28/d2a/d44/d6e/f118 zero size 2024-09-17T01:56:32.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/958: creat d1/d7/d28/f125 x:0 0 0 2024-09-17T01:56:32.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/959: truncate d1/ffa 4087787 0 2024-09-17T01:56:32.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/960: symlink d1/d7/d1d/db7/l126 0 2024-09-17T01:56:32.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/961: rmdir d1/d7/d28/d2a/d37/d3a/d85 39 2024-09-17T01:56:32.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/962: fdatasync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f52 0 2024-09-17T01:56:32.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/963: dread - d1/d7/d28/d2a/d37/d3a/d75/dc2/fe2 zero size 2024-09-17T01:56:32.146 INFO:tasks.workunit.client.0.smithi063.stdout:8/964: dread d1/d7/d1d/f5f [0,4194304] 0 2024-09-17T01:56:32.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/965: fsync d1/d7/d28/d2a/d37/d3a/d75/d9a/d62/d66/f11a 0 2024-09-17T01:56:32.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/966: fsync d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f100 0 2024-09-17T01:56:32.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/967: chown d1/c11 135874 1 2024-09-17T01:56:32.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/968: creat d1/d7/f127 x:0 0 0 2024-09-17T01:56:32.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/969: stat d1/d7/d28/d2a/d37/fbd 0 2024-09-17T01:56:32.151 INFO:tasks.workunit.client.0.smithi063.stdout:8/970: creat d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f128 x:0 0 0 2024-09-17T01:56:32.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/971: dread d1/d7/d119/f61 [0,4194304] 0 2024-09-17T01:56:32.156 INFO:tasks.workunit.client.0.smithi063.stdout:8/972: symlink d1/d7/d1d/d9c/l129 0 2024-09-17T01:56:32.157 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:32.161+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:32.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/973: creat d1/d7/d28/d2a/d53/df9/f12a x:0 0 0 2024-09-17T01:56:32.168 INFO:tasks.workunit.client.0.smithi063.stdout:0/981: sync 2024-09-17T01:56:32.215 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.217+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.226 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:32.226 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:32.240 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:32.303 INFO:tasks.workunit.client.0.smithi063.stdout:8/974: write d1/d7/d28/d2a/f8d [443001,15794] 0 2024-09-17T01:56:32.305 INFO:tasks.workunit.client.0.smithi063.stdout:8/975: dread - d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/f128 zero size 2024-09-17T01:56:32.308 INFO:tasks.workunit.client.0.smithi063.stdout:8/976: readlink d1/d7/d28/d2a/d37/d3a/d75/d9a/lc4 0 2024-09-17T01:56:32.310 INFO:tasks.workunit.client.0.smithi063.stdout:8/977: creat d1/d7/d28/d2a/d4d/f12b x:0 0 0 2024-09-17T01:56:32.315 INFO:tasks.workunit.client.0.smithi063.stdout:0/982: dwrite d1/d3/db/d18/d85/da8/ff4 [0,4194304] 0 2024-09-17T01:56:32.315 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.317+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.317 INFO:tasks.workunit.client.0.smithi063.stdout:0/983: dread - d1/d3/db/d6e/d86/dcc/fca zero size 2024-09-17T01:56:32.337 INFO:tasks.workunit.client.0.smithi063.stdout:8/978: dread d1/d7/d28/d2a/d44/d6e/fda [0,4194304] 0 2024-09-17T01:56:32.339 INFO:tasks.workunit.client.0.smithi063.stdout:8/979: write d1/d7/d1d/f5f [4497636,66131] 0 2024-09-17T01:56:32.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/980: write d1/f70 [2591529,120719] 0 2024-09-17T01:56:32.343 INFO:tasks.workunit.client.0.smithi063.stdout:8/981: write d1/d7/f114 [555584,59570] 0 2024-09-17T01:56:32.404 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:32.404 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:32.416 INFO:tasks.workunit.client.0.smithi063.stdout:0/984: dwrite d1/d3/d32/f69 [0,4194304] 0 2024-09-17T01:56:32.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/982: dwrite d1/d7/d28/f42 [4194304,4194304] 0 2024-09-17T01:56:32.416 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:32.417+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:32.417 INFO:tasks.workunit.client.0.smithi063.stdout:0/985: chown d1/d1d/de4 7271183 1 2024-09-17T01:56:32.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:32.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/983: chown d1/d27/d81/da4/dc7/l103 10022 1 2024-09-17T01:56:32.420 INFO:tasks.workunit.client.0.smithi063.stdout:8/984: dread - d1/d7/d28/d87/fa8 zero size 2024-09-17T01:56:32.425 INFO:tasks.workunit.client.0.smithi063.stdout:8/985: chown d1/d7/d28/d2a/d37/d3a/f3c 1 1 2024-09-17T01:56:32.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/986: dread d1/d3/db/d6e/d86/dcc/d7c/fdb [0,4194304] 0 2024-09-17T01:56:32.439 INFO:tasks.workunit.client.0.smithi063.stdout:0/987: write d1/d3/db/d18/d33/d83/db7/ffc [4639087,70927] 0 2024-09-17T01:56:32.439 INFO:tasks.workunit.client.0.smithi063.stdout:8/986: dwrite d1/d7/d1d/f7f [0,4194304] 0 2024-09-17T01:56:32.441 INFO:tasks.workunit.client.0.smithi063.stdout:8/987: truncate d1/f5c 4525955 0 2024-09-17T01:56:32.443 INFO:tasks.workunit.client.0.smithi063.stdout:8/988: read d1/d7/f4e [978763,116682] 0 2024-09-17T01:56:32.445 INFO:tasks.workunit.client.0.smithi063.stdout:0/988: mkdir d1/d3/db/d6e/d86/dcc/d7c/d13e 0 2024-09-17T01:56:32.446 INFO:tasks.workunit.client.0.smithi063.stdout:0/989: fsync d1/d1f/f77 0 2024-09-17T01:56:32.448 INFO:tasks.workunit.client.0.smithi063.stdout:0/990: fdatasync d1/d3/db/d4b/d2f/f136 0 2024-09-17T01:56:32.450 INFO:tasks.workunit.client.0.smithi063.stdout:0/991: rename d1/d3/d1b/d50 to d1/d1f/d13f 0 2024-09-17T01:56:32.453 INFO:tasks.workunit.client.0.smithi063.stdout:0/992: write d1/d3/db/d4b/d98/fab [3951502,99933] 0 2024-09-17T01:56:32.458 INFO:tasks.workunit.client.0.smithi063.stdout:0/993: write d1/d3/d1b/f2a [502616,11653] 0 2024-09-17T01:56:32.458 INFO:tasks.workunit.client.0.smithi063.stdout:8/989: dwrite d1/d7/d119/fd4 [0,4194304] 0 2024-09-17T01:56:32.465 INFO:tasks.workunit.client.0.smithi063.stdout:8/990: mknod d1/d7/d28/d2a/d37/d3a/d75/dc2/c12c 0 2024-09-17T01:56:32.465 INFO:tasks.workunit.client.0.smithi063.stdout:0/994: readlink d1/d3/db/d18/d33/la3 0 2024-09-17T01:56:32.467 INFO:tasks.workunit.client.0.smithi063.stdout:0/995: mkdir d1/d3/db/d6e/d86/d140 0 2024-09-17T01:56:32.469 INFO:tasks.workunit.client.0.smithi063.stdout:0/996: mkdir d1/d3/db/d18/d85/d92/dd4/de2/d141 0 2024-09-17T01:56:32.471 INFO:tasks.workunit.client.0.smithi063.stdout:0/997: symlink d1/d3/db/d6e/d86/d140/l142 0 2024-09-17T01:56:32.472 INFO:tasks.workunit.client.0.smithi063.stdout:8/991: truncate d1/d7/d28/d2a/d59/fdc 1323201 0 2024-09-17T01:56:32.476 INFO:tasks.workunit.client.0.smithi063.stdout:0/998: rename d1/d3/db/d18/d33/d83/f135 to d1/d3/db/d6e/d86/dcc/d53/d62/dcd/d100/f143 0 2024-09-17T01:56:32.478 INFO:tasks.workunit.client.0.smithi063.stdout:0/999: creat d1/d3/db/d4b/d2f/d56/f144 x:0 0 0 2024-09-17T01:56:32.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/992: truncate d1/d7/d28/ffb 2314406 0 2024-09-17T01:56:32.480 INFO:tasks.workunit.client.0.smithi063.stdout:8/993: chown d1/d7/d28/d2a/d4d/lc5 4 1 2024-09-17T01:56:32.482 INFO:tasks.workunit.client.0.smithi063.stdout:8/994: creat d1/d7/d28/d2a/d44/d6e/f12d x:0 0 0 2024-09-17T01:56:32.484 INFO:tasks.workunit.client.0.smithi063.stdout:8/995: truncate d1/d7/d28/f125 15965 0 2024-09-17T01:56:32.487 INFO:tasks.workunit.client.0.smithi063.stdout:8/996: write d1/f16 [4320905,58688] 0 2024-09-17T01:56:32.501 INFO:tasks.workunit.client.0.smithi063.stdout:8/997: dwrite d1/d27/d81/da4/fe0 [0,4194304] 0 2024-09-17T01:56:32.504 INFO:tasks.workunit.client.0.smithi063.stdout:8/998: chown d1/d7/d28/d2a/d37/d3a/d75/d9a/d41/c46 57805856 1 2024-09-17T01:56:32.509 INFO:tasks.workunit.client.0.smithi063.stdout:8/999: symlink d1/d7/d28/d2a/d4d/l12e 0 2024-09-17T01:56:32.512 INFO:tasks.workunit.client.0.smithi063.stderr:+ rm -rf -- ./tmp.bsDRrR7LpP 2024-09-17T01:56:32.517 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.517+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.552 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:32.552 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:32.567 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:32.617 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:32.621+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:32.719 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.721+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.743 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:32.743 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:32.758 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:32.846 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.849+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:32.921 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:32.921+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:32.925 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:32.925 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:32.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:33.022 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.025+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:33.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:33.073 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:33.073 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:33.073 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:33.073 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:33.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:33.089 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:33.093 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:33.093 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:33.129 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.133+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:33.224 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.225+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:33.250 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:33.250 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:33.250 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:33.250 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:33.265 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:33.325 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:33.325+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:33.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:56:33.425 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:33.425+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.882176238, 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:33.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.439 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:33.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.877374561, 2024-09-17T01:56:33.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:33.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:33.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.874302063, 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.448 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:33.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.872365908000001, 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.454 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:33.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:33.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.870384203, 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:33.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:33.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.86713065, 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.466 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.470 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:33.471 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.856686132, 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.472 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.473 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:33.474 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:33.476 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.477 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.847517352000001, 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:33.479 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.480 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.482 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:33.483 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.843487995, 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:33.484 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.486 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:33.487 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.488 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.489 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.837162438, 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.490 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:33.492 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:33.493 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:33.494 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.833971793, 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.496 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.498 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.499 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.500 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.501 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.832816142, 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.502 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.503 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:33.504 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:33.505 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.506 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.830742803, 2024-09-17T01:56:33.507 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:33.508 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.509 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:33.510 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:33.511 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.512 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.513 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.823641974999999, 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.514 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.515 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:33.516 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.517 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.518 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.519 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.818392984999999, 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.520 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.521 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.522 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.523 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:33.524 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.525 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.817198958000001, 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:33.526 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:33.527 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.528 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.529 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:33.530 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.810594524999999, 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.533 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:33.534 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.535 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.536 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.537 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.538 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.808212927, 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.539 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:33.540 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.541 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.542 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.544 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.805110089999999, 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.545 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:33.546 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:33.547 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.548 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:33.549 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:33.551 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.551 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.552 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 13.799257645000001, 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:33.553 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:33.554 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:33.555 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.556 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.557 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:33.558 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:33.560 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:33.560 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.565+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:33.661 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.665+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:33.698 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:33.698 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:33.699 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:33.713 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:33.763 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:33.765+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:33.838 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:33.839 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:33.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:33.862 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.865+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:33.965 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:33.969+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:34.028 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.654423773000001, 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.029 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:34.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:34.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:34.035 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.456427692, 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.036 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:34.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.455544439000001, 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.042 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:34.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:34.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.453544920000001, 2024-09-17T01:56:34.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:34.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:34.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.45248821, 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.449409878000001, 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.447504361, 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:34.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:34.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.445270664000001, 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.079 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.444334528000001, 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:34.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.42238203, 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:34.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:34.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:34.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.419336022, 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:34.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:34.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.414143615, 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.408784070999999, 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:34.104 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:34.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.404311496, 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:34.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.392799287000001, 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.117 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:34.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:34.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.384848097000001, 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:34.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:34.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.380529645999999, 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:34.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:34.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.3757894, 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:34.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:34.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.373307712000001, 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:34.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:34.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.372312489, 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:34.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:34.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:34.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:34.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:34.153 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:34.154 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:34.155 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:34.157+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:34.256 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:34.257+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3350 3.18 3:1cc859d9:::200.00000012:head [write 1232713~149138 [fadvise_dontneed] in=149138b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.295340+0000", 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0028991820000000001, 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0029199289999999999, 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295340+0000", 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295340+0000", 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295342+0000", 2024-09-17T01:56:34.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.86e-06 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295475+0000", 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013318499999999999 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295499+0000", 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4615000000000001e-05 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295512+0000", 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3055e-05 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295591+0000", 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8441000000000003e-05 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295673+0000", 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1784000000000002e-05 2024-09-17T01:56:34.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.295796+0000", 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012310700000000001 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297737+0000", 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0019413130000000001 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3352 3.12 3:4e8d747e:::100000030bd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.296645+0000", 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0015935980000000001, 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0016619250000000001, 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296645+0000", 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296645+0000", 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296647+0000", 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.42e-06 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296653+0000", 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.7660000000000001e-06 2024-09-17T01:56:34.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296681+0000", 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7810999999999999e-05 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296692+0000", 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0689e-05 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296868+0000", 2024-09-17T01:56:34.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017574100000000001 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297170+0000", 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000301957 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3355 3.5 3:a3e7a473:::1000000313a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.296760+0000", 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0014784780000000001, 2024-09-17T01:56:34.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015880219999999999, 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296760+0000", 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296760+0000", 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296761+0000", 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8700000000000004e-07 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296765+0000", 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.1919999999999998e-06 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296779+0000", 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3426e-05 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296787+0000", 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1629999999999996e-06 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296928+0000", 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000140474 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297219+0000", 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029116400000000001 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3356 4.23 4:c476f8a8:::1000000313d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.296825+0000", 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0014135199999999999, 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001556104, 2024-09-17T01:56:34.306 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296825+0000", 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296825+0000", 2024-09-17T01:56:34.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296826+0000", 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.16e-07 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296835+0000", 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.6459999999999999e-06 2024-09-17T01:56:34.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296847+0000", 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1899000000000001e-05 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296855+0000", 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.1089999999999998e-06 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.309 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296959+0000", 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000104348 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297225+0000", 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00026541599999999998 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3358 4.21 4:846c3d91:::10000003145.00000001:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.310 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.296874+0000", 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.001364954, 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0015400590000000001, 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296874+0000", 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296874+0000", 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296875+0000", 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.7300000000000004e-07 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296879+0000", 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.5889999999999996e-06 2024-09-17T01:56:34.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296901+0000", 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1171000000000001e-05 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296918+0000", 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7793000000000001e-05 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297062+0000", 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014338299999999999 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297295+0000", 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00023357900000000001 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297551+0000", 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025603799999999999 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.314 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3360 4.1b 4:dbe36648:::10000003145.00000003:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.296982+0000", 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.001256861, 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0014681259999999999, 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296982+0000", 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296982+0000", 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296984+0000", 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0229999999999999e-06 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.296992+0000", 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8930000000000005e-06 2024-09-17T01:56:34.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297014+0000", 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2211000000000001e-05 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297031+0000", 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297182+0000", 2024-09-17T01:56:34.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015110199999999999 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297473+0000", 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00029133499999999999 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3361 4.b 4:d049ddd6:::10000003145.00000004:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.297761+0000", 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.000477713, 2024-09-17T01:56:34.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00073371199999999997, 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297761+0000", 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297761+0000", 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297763+0000", 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.886e-06 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297773+0000", 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.0073e-05 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297799+0000", 2024-09-17T01:56:34.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5941000000000001e-05 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297819+0000", 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0055e-05 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298000+0000", 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00018062699999999999 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298309+0000", 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030928900000000003 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3366 4.12 4:4ae3e1b5:::10000003155.00000001:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.297849+0000", 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.00038993799999999999, 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00068008999999999995, 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.322 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297849+0000", 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297849+0000", 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297850+0000", 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2869999999999999e-06 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297857+0000", 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5220000000000004e-06 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297877+0000", 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9822000000000001e-05 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297891+0000", 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4705000000000001e-05 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298025+0000", 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000133805 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298225+0000", 2024-09-17T01:56:34.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000200306 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for subops from 1", 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298507+0000", 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000281465 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3368 4.7 4.43a9ddc7 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.326 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.297924+0000", 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.00031463800000000001, 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000642689, 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "queued for pg", 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297924+0000", 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297924+0000", 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297926+0000", 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4360000000000001e-06 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297932+0000", 2024-09-17T01:56:34.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3539999999999996e-06 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297951+0000", 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8824000000000001e-05 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.297969+0000", 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8624999999999999e-05 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:3371 4.2d 4:b4857863:::1000000317d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:34.298004+0000", 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.000234742, 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00058929800000000004, 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:34.330 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298004+0000", 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298004+0000", 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298005+0000", 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1999999999999999e-06 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298011+0000", 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5269999999999998e-06 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298029+0000", 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8291000000000002e-05 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.332 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298045+0000", 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6166000000000001e-05 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298173+0000", 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012775500000000001 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:34.298446+0000", 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000272682 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.333 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.334 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.334 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:34.334 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 10 2024-09-17T01:56:34.334 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:34.335 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:34.358 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:34.357+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:34.399 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:56:34.457 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:34.457+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:34.543 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:34.543 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:34.543 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:34.544 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:34.544 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:34.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:34.559 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:34.561+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:34.659 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:34.661+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.17994756, 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.175145883000001, 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.172073384999999, 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.17013723, 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.168155525, 2024-09-17T01:56:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.164901971999999, 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.154457453999999, 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.145288674, 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.141259316999999, 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.134933759999999, 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.131743115000001, 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.130587464, 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.128514125000001, 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.121413297, 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.116164307, 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.11497028, 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.108365847, 2024-09-17T01:56:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.105984249, 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.102881412, 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.841 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:34.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:34.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.847 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 15.097028967, 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:34.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:34.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:34.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:34.853 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:34.854 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:34.855 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:34.856 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:34.857+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:34.956 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:34.957+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:34.993 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:34.993 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:34.993 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:34.993 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:35.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:35.057 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:35.061+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:35.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:35.134 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:35.134 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:35.134 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:35.134 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:35.134 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:35.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:35.157 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:35.161+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:35.258 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:35.261+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:35.260 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:35.260 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:35.277 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:35.277 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.903397723000001, 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:35.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:35.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.705401642, 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:35.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:35.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.290 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.704518389, 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:35.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.296 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.70251887, 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.70146216, 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:35.302 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:35.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:35.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:35.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:35.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.698383828000001, 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:35.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.696478311, 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.315 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:35.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.320 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.694244614, 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:35.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.693308478000001, 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.327 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:35.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:35.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.67135598, 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.333 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:35.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:35.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.668309971999999, 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.339 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:35.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:35.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:35.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.663117565, 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.657758020999999, 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:35.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:35.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.653285446, 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.357 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:35.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.641773237000001, 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.363 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:35.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.633822047000001, 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.369 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:35.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.374 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.629503595999999, 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:35.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:35.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.380 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.62476335, 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:35.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:35.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.622281662000001, 2024-09-17T01:56:35.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:35.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:35.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:35.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:35.392 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.621286439, 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:35.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:35.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:35.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:35.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:35.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:35.399 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:35.400 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:35.401 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:35.402 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:35.401+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:35.402 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:35.402 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:35.403 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:35.403 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:35.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-17T01:56:35.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:56:35.403 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T01:56:35.403 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-09-17T01:56:35.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T01:56:35.501 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:35.505+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:35.520 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:35.521 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:35.535 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:35.602 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:35.605+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:35.703 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:35.705+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:35.704 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:35.704 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:35.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:35.804 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:35.805+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:35.834 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:35.834 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:35.848 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:35.905 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:35.909+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:35.988 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:35.988 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:36.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:36.005 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.009+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.106 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.109+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.133 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:36.133 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:36.149 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:36.246 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.249+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.309 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:36.313+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:36.342 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:36.342 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:36.358 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:56:36.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T01:56:36.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T01:56:36.411 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:36.413+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:36.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:56:36.511 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.513+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.511 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:36.511 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:36.525 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:36.612 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.613+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.697 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:36.697 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:36.713 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.713+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.713 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:36.813 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.813+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.838 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:36.838 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:36.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:36.914 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:36.917+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:36.985 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:36.986 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:37.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:37.042 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:37.045+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:37.116 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.116+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.159 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:37.160 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:37.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:37.216 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.216+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.294 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:37.294 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:37.312 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:37.363 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.364+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:37.412 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:56:37.419 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:37.421+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:37.484 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:37.484 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:37.498 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:37.541 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.544+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.553 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:37.553 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:37.574 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:37.578 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:37.578 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:37.618 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.620+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.664 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:37.664 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:37.664 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:37.665 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:37.665 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:37.678 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:37.721 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.724+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-09-17T01:56:37.821 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:37.820+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:37.844 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.291046023, 2024-09-17T01:56:37.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:37.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:37.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:37.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:37.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.850 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:37.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:37.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:37.854 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.286244346, 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.855 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:37.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:37.860 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.283171847999999, 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.861 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:37.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.866 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.281235692999999, 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.867 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:37.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:37.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:37.872 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.279253988000001, 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:37.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:37.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:37.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.276000435, 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.879 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:37.882 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:37.883 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.884 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.265555917, 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.885 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.886 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:37.887 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.888 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.889 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.890 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.256387137000001, 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.891 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.892 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.894 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.895 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:37.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.252357780000001, 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.897 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:37.899 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.900 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.901 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.902 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.246032223, 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.903 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.904 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:37.905 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.906 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:37.908 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.242841578, 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.909 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:37.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:37.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.913 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.914 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.241685926999999, 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:37.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.916 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:37.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:37.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.919 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.239612588, 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:37.921 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.922 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:37.923 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:37.924 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.925 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.926 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.232511760000001, 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.927 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.928 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.929 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:37.930 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:37.931 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:37.932 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.227262769999999, 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.933 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.934 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.935 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.936 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.938 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.226068742999999, 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.939 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.940 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:37.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:37.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:37.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:37.944 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.219464309999999, 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.945 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:37.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:37.948 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.949 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.950 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.217082712, 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.951 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.952 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:37.953 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:37.954 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.955 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.956 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.213979875, 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:37.957 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.959 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:37.960 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:37.961 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.962 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 18.208127430000001, 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:37.963 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:37.964 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:37.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:37.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:37.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:37.968 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:37.970 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:37.970 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:37.973+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:38.071 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:38.072+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:38.110 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:38.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7308 3.1d 3:bec9163d:::200.00000015:head [write 2385953~13248 [fadvise_dontneed] in=13248b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:38.108360+0000", 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0054778659999999996, 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055250120000000002, 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108360+0000", 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108360+0000", 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108362+0000", 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0959999999999999e-06 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108386+0000", 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4817e-05 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108416+0000", 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9536e-05 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108433+0000", 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7456e-05 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108557+0000", 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012405000000000001 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:38.108824+0000", 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000266691 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-17T01:56:38.114 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:38.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:38.171 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:38.173+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:38.251 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:38.251 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:38.251 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:38.251 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:38.252 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:38.267 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:38.273 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:38.272+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:38.374 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:38.376+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:38.439 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.067465982000002, 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:38.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:38.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.869469900999999, 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:38.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:38.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.452 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.868586648000001, 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:38.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.866587128999999, 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:38.459 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:38.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.865530418999999, 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:38.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:38.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:38.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.862452087000001, 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:38.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:38.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.86054657, 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:38.479 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:38.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:38.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:38.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.485 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.858312872999999, 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:38.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:38.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:38.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.857376736999999, 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.492 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.497 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.835424238999998, 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:38.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.832378231, 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:38.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:38.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:38.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:38.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.827185824000001, 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:38.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:38.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.82182628, 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:38.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:38.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.817353704999999, 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:38.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.805841495999999, 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.527 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:38.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:38.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.797890305999999, 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:38.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:38.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.793571855, 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:38.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:38.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.788831608999999, 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.545 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:38.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:38.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:38.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.786349920999999, 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:38.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:38.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.785354697999999, 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.558 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:38.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:38.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:38.564 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:38.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:38.566 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:38.568+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:38.667 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:38.668+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:38.700 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:38.700 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:38.700 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:38.700 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:38.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:38.805 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:38.808+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:38.870 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:38.873+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:38.881 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:38.881 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:38.881 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:38.882 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:38.882 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:38.895 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:38.998 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:39.000+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:39.070 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:39.073+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:39.084 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:39.084 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.528615595000002, 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.085 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:39.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:39.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.091 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.523813917999998, 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:39.094 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:39.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.097 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.52074142, 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:39.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.518805265000001, 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.104 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:39.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.106 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:39.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:39.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.516823559999999, 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.110 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.112 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:39.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.513570006999998, 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:39.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.119 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:39.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.503125488999999, 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.122 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.127 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.493956708999999, 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:39.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:39.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.489927351999999, 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:39.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:39.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.139 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.483601794999998, 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:39.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:39.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.480411149999998, 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.146 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:39.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:39.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.479255499000001, 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.152 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:39.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.477182160000002, 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.158 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.160 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:39.161 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:39.162 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.163 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.470081331999999, 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.164 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.165 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.166 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.167 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:39.168 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:39.169 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.464832342000001, 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.170 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:39.171 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.172 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.173 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.174 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:39.175 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.463638315000001, 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.176 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.177 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.178 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.180 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:39.181 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.457033882000001, 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.182 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.183 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:39.184 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.185 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.186 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:39.187 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.454652284000002, 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.188 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.189 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:39.190 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.191 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.192 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.451549447000001, 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.194 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.195 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:39.196 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.197 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.198 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.199 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 19.445697001999999, 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:39.200 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.201 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.202 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:39.203 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:39.204 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.205 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:39.206 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:39.206 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:39.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:39.208 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:39.212+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:39.309 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:39.308+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7638 4.2e 4:77161dc0:::10000001539.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.351558+0000", 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.010428285000000001, 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010459259, 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351558+0000", 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351558+0000", 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351559+0000", 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.212e-06 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351564+0000", 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9130000000000002e-06 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351577+0000", 2024-09-17T01:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3057999999999999e-05 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351585+0000", 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9519999999999994e-06 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351681+0000", 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6457000000000002e-05 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351824+0000", 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014282800000000001 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.351934+0000", 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109845 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.353152+0000", 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001218034 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7641 4.6 4:614930c9:::1000000153c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.352764+0000", 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0092220240000000005, 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093178219999999999, 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352764+0000", 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352764+0000", 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352765+0000", 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6899999999999996e-07 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352769+0000", 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9709999999999998e-06 2024-09-17T01:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352781+0000", 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2130000000000001e-05 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352789+0000", 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.622e-06 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.352867+0000", 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8239999999999996e-05 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.353026+0000", 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015943199999999999 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.353156+0000", 2024-09-17T01:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013003900000000001 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.355781+0000", 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026246669999999998 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7650 4.3b 4:dc5054fd:::10000001545.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.356035+0000", 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0059514360000000001, 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061052889999999999, 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356035+0000", 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356035+0000", 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356035+0000", 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8599999999999996e-07 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356041+0000", 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9710000000000001e-06 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356054+0000", 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3005e-05 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356062+0000", 2024-09-17T01:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8210000000000002e-06 2024-09-17T01:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356112+0000", 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9678000000000001e-05 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356254+0000", 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014197400000000001 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356402+0000", 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014855200000000001 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.358586+0000", 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002183071 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7652 4.33 4:ce67d6ca:::10000001547.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.356079+0000", 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.005907018, 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061196660000000002, 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356079+0000", 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356079+0000", 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356079+0000", 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3799999999999997e-07 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356082+0000", 2024-09-17T01:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7269999999999999e-06 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356091+0000", 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4330000000000004e-06 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356096+0000", 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7030000000000003e-06 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356159+0000", 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3136e-05 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356400+0000", 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240981 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356605+0000", 2024-09-17T01:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020505100000000001 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359213+0000", 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026072970000000002 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7657 4.15 4:aa03a6de:::1000000154c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.356131+0000", 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0058552539999999998, 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061231159999999996, 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356131+0000", 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356131+0000", 2024-09-17T01:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356131+0000", 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3600000000000004e-07 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356133+0000", 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1160000000000002e-06 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356140+0000", 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9979999999999997e-06 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356146+0000", 2024-09-17T01:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.339e-06 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356242+0000", 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6162999999999994e-05 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356500+0000", 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025806400000000001 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.356693+0000", 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019346599999999999 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359224+0000", 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002530844 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7664 4.28 4:148c0987:::1000000158e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.357826+0000", 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0041604169999999996, 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044840840000000002, 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357826+0000", 2024-09-17T01:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357826+0000", 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357826+0000", 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1200000000000003e-07 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357830+0000", 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4929999999999998e-06 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357839+0000", 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8269999999999993e-06 2024-09-17T01:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357846+0000", 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7410000000000003e-06 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.357911+0000", 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4403e-05 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.358034+0000", 2024-09-17T01:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012328600000000001 2024-09-17T01:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.358136+0000", 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101795 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359352+0000", 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012158430000000001 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7668 4.9 4:91594555:::10000001592.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.359354+0000", 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002631708, 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030434759999999998, 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359354+0000", 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359354+0000", 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359356+0000", 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5659999999999999e-06 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359363+0000", 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1060000000000002e-06 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359379+0000", 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6354e-05 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359391+0000", 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1688000000000001e-05 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359449+0000", 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8038999999999998e-05 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359569+0000", 2024-09-17T01:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011952500000000001 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.359663+0000", 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4944000000000004e-05 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.360647+0000", 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098319199999999992 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7679 4.2a 4:547cac7e:::1000000159d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.362060+0000", 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9999256, 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039742999999999999, 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362060+0000", 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362060+0000", 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362061+0000", 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1299999999999999e-07 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362065+0000", 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7469999999999999e-06 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362076+0000", 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1147e-05 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362082+0000", 2024-09-17T01:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5820000000000001e-06 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362144+0000", 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1977999999999995e-05 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362316+0000", 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017227 2024-09-17T01:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:7680 4.33 4:cfda65ba:::1000000159e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:39.362096+0000", 2024-09-17T01:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9998899, 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040946500000000002, 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362096+0000", 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362096+0000", 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362097+0000", 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8099999999999998e-07 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362098+0000", 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8649999999999999e-06 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362104+0000", 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7169999999999996e-06 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362107+0000", 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.208e-06 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362159+0000", 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1298999999999998e-05 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362320+0000", 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016116700000000001 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:39.362464+0000", 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144241 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 9 2024-09-17T01:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:39.425 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:39.425 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:39.425+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:39.437 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:56:39.525 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:39.525+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:39.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:39.584 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:39.584 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:39.584 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:39.584 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:39.584 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:39.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:39.626 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:39.628+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:39.727 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:39.728+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:39.733 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:39.733 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:39.753 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:39.754 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:39.754 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:39.757 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:39.757 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:39.763 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:39.763 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:39.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:39.828 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:39.829+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:39.909 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:39.910 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:39.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:39.929 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:39.929+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.030 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:40.033+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.040 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:40.041 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:40.055 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:40.131 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:40.133+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.181 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:40.182 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:40.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:40.242 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:40.245+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.334 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:40.333+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.336 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:40.336 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:40.355 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:40.431 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:56:40.444 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:40.445+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.534 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:40.536+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:40.569 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:40.569 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:40.584 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:40.674 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:40.677+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:40.737 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:40.736+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:40.747 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:40.748 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:40.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:40.838 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:40.840+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:40.895 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:40.895 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:40.910 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:40.953 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:40.956+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:41.039 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:41.040+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:41.084 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:41.084 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:41.099 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:41.140 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:41.141+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:41.240 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:41.241+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:41.269 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:41.269 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:41.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:41.342 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:41.345+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:41.424 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-09-17T01:56:41.424 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-17T01:56:41.424 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-17T01:56:41.425 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:56:41.425 INFO:teuthology.orchestra.console.smithi154:Power on 2024-09-17T01:56:41.425 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-17T01:56:41.443 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:41.444+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:41.449 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2024-09-17T01:56:41.452 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:41.452 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:41.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:41.544 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:41.544+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:41.645 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:41.649+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:41.647 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:41.647 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:41.663 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:41.750 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:41.753+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:41.758 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:41.830 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:41.830 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:41.844 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:41.847 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:41.848+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:41.895 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:41.895 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:41.916 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:41.916 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:41.916 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:41.919 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:41.919 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:41.949 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:41.948+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:41.975 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:41.975 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:41.976 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:41.976 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:41.989 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:42.077 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:42.080+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:42.150 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:42.153+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:42.158 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:42.158 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:42.158 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:42.158 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:42.158 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:42.172 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:42.257 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:42.260+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.784721131000001, 2024-09-17T01:56:42.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:42.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.344 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:42.345 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.779919454000002, 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:42.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.351 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.352 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.776846956, 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.353 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:42.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.774910801000001, 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.359 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.361 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.361 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:42.361 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.361 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.361 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.361 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.364 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.365 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:42.366 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.367 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.772929095999999, 2024-09-17T01:56:42.368 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.369 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:42.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.371 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.372 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:42.372 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:42.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.372 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.372 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.373 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.374 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:42.375 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.769675542999998, 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.377 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:42.378 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.379 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:42.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.381 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.382 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.759231024999998, 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:42.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.384 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.385 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:42.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:42.387 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.388 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.750062244999999, 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.389 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.390 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:42.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.392 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.393 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:42.394 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.746032887999998, 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.395 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.397 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.398 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:42.400 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.739707330999998, 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.401 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.402 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:42.403 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.404 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:42.405 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.406 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:42.407 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.736516686000002, 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.408 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:42.409 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:42.411 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.412 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.413 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.735361035, 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.414 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.415 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:42.416 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.417 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:42.418 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.419 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.733287696000001, 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.420 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.421 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:42.422 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.423 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:42.424 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.425 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.726186867999999, 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.427 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.428 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:42.429 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.430 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:42.431 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.432 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.720937878000001, 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.433 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.434 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.435 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:42.436 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.437 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.438 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.719743851, 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.439 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.440 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.441 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:42.442 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.443 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.444 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.713139418000001, 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:42.445 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.446 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:42.447 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.448 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:42.449 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.450 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.451 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.710757820000001, 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.452 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.453 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:42.455 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.456 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:42.457 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.707654983000001, 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.458 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.459 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:42.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:42.461 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.462 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.463 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 22.701802537999999, 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:42.464 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.465 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:42.467 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:42.468 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:42.469 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:42.470 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:42.471 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:56:42.472 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:42.473+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:42.473 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:42.573 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:42.573+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:42.647 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:42.647 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:42.647 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:42.647 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:42.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:42.706 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:42.709+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:42.775 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:42.776+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:42.823 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:42.823 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:42.823 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:42.823 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:42.823 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:42.838 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:42.882 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:42.885+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:42.963 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:42.963 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:42.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:42.963 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:42.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.591222018000003, 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.964 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:42.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:42.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.970 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.393225937, 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:42.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:42.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:42.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:42.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:42.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.392342683999999, 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:42.978 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:42.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:42.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:42.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:42.984 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.390343165000001, 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:42.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:42.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:42.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.389286455000001, 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:42.990 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:42.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.386208122999999, 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:42.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:42.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.384302605999999, 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:43.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:43.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.382068909000001, 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.008 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:43.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.013 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.381132773000001, 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.014 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:43.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.359180275, 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:43.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:43.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:43.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.356134267000002, 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.026 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:43.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.031 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.350941859999999, 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:43.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:43.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.037 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.345582316000002, 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.038 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:43.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:43.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.341109741, 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:43.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.329597532000001, 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:43.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:43.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.055 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.321646342000001, 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:43.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.317327891000001, 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.062 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:43.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:43.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:43.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.312587645000001, 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.068 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:43.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.310105957000001, 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:43.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:43.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.309110734000001, 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:43.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:43.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:43.085 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:43.087 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:43.089+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:43.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:43.188 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:43.189+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:43.222 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:43.222 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:43.223 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:43.223 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:43.238 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:43.289 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:43.288+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:43.365 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:43.365 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:43.365 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:43.365 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:43.365 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:43.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:43.390 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:43.393+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:56:43.490 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:43.492+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:43.567 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.015193254, 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.568 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:43.569 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.570 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:43.571 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.572 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.573 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.574 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.575 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.575 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.575 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.575 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.575 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:43.576 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.010391577, 2024-09-17T01:56:43.576 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:43.576 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.576 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.576 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.576 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.577 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.579 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.580 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.580 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:43.580 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:43.580 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.580 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.580 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.581 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:43.581 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:43.581 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.581 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.581 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.581 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:43.582 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:43.582 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.582 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.582 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.582 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:43.582 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.583 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.584 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:43.585 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.588 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.007319078999998, 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.589 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.590 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:43.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.592 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:43.593 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:43.594 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.005382923999999, 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.595 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.596 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:43.597 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.598 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.599 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.600 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.601 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.003401219000001, 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.602 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.603 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:43.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.605 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.607 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.608 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 24.000147666, 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.609 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.610 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.611 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:43.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.613 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.614 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.989703148, 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.615 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.616 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.617 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:43.618 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.619 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.620 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.621 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.980534368000001, 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:43.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.623 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:43.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.625 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.626 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.627 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.976505011, 2024-09-17T01:56:43.628 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:43.629 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.630 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.631 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:43.632 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.633 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:43.634 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.970179454, 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.635 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.636 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:43.637 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:43.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.637 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.637 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:43.638 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:43.638 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.638 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.638 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:43.639 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:43.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.639 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.639 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:43.640 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:43.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.640 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.640 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.642 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.643 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:43.643 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:43.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.643 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.644 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.645 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.646 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:43.646 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.966988809, 2024-09-17T01:56:43.646 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:43.646 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.646 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:43.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:43.650 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.651 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.653 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.965833157999999, 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.654 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:43.655 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:43.656 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.657 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.658 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.659 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.660 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.963759819, 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.661 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.662 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.663 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:43.664 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.665 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.666 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.667 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.956658991000001, 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.668 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:43.669 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.670 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:43.671 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.672 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:43.673 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.674 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.951410000999999, 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.675 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.676 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:43.677 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.678 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.679 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.680 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:43.681 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.682 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.950215973999999, 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.683 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.684 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.685 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.686 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:43.687 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.688 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.943611540999999, 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.689 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.690 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.691 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.692 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:43.693 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:43.694 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.695 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:43.696 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.941229943, 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.697 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:43.698 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:43.699 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.700 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.701 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:43.702 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.938127106, 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:43.703 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:43.704 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.705 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.706 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.707 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:43.708 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 23.932274661000001, 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:43.709 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.710 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.711 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.712 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:43.713 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:43.714 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.715 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.716 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:43.716 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:43.716 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:43.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:43.718 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:43.716+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:43.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2024-09-17T01:56:43.818 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:43.821+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:43.849 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:43.850 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:43.850 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:43.850 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:43.864 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:43.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:43.950 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:43.953+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:44.020 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:44.020+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:44.026 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:44.026 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:44.026 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:44.026 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:44.026 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:44.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:44.074 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:44.095 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:44.096 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:44.096 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:44.099 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:44.100 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:44.126 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:44.129+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:44.199 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:44.200 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:44.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:44.254 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:44.257+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:44.323 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:44.324+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:44.356 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:44.356 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:44.376 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:44.466 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:44.468+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:44.525 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:44.529+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:44.560 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:44.561 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:44.576 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:44.626 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:44.629+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:44.727 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:44.729+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:44.745 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:44.745 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:44.759 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:44.828 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:44.828+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:44.890 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:44.890 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:44.903 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:44.950 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:44.953+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:45.023 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:45.030 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:45.032+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:45.037 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:45.130 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:45.133+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:45.204 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:45.218 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:45.262 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:45.264+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:45.333 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:45.333+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:45.356 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:45.356 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:45.378 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:45.434 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:45.433+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:45.450 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-17T01:56:45.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:56:45.534 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:45.536+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:45.561 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-09-17T01:56:45.561 INFO:teuthology.orchestra.console.smithi154:Power on completed 2024-09-17T01:56:45.565 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:45.565 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:45.580 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:45.635 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:45.637+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:45.662 DEBUG:teuthology.orchestra.console.smithi154:Waiting for login prompt 2024-09-17T01:56:45.662 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi154 2024-09-17T01:56:45.737 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:45.737+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:45.748 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:45.748 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:45.763 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:45.838 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:45.840+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:45.895 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:45.895 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:45.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:45.958 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:45.961+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:46.027 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:46.027 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:46.040 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.040+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.041 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:46.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:46.141 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.144+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.204 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:46.204 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:46.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:46.236 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:46.236 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:46.257 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:46.257 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:46.257 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:46.261 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:46.261 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:46.265 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.268+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.343 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.344+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.352 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:46.352 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:46.352 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.352 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:16876 3.1 3:86ee9bce:::500.00000001:head [write 1191194~68074 in=68074b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-17T01:56:46.352 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:46.354443+0000", 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0020971369999999998, 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0021429539999999999, 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "started", 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354443+0000", 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.353 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354443+0000", 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354444+0000", 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.677e-06 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354585+0000", 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014045099999999999 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.354 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354726+0000", 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014083499999999999 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.355 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354741+0000", 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4939e-05 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354866+0000", 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000125652 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.355092+0000", 2024-09-17T01:56:46.356 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00022543899999999999 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(mds.0.3:16877 3.1 3.73d97761 (undecoded) ondisk+read+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-17T01:56:46.357 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:46.354781+0000", 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.001758438, 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001906593, 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "queued for pg", 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354781+0000", 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.358 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354781+0000", 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354783+0000", 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0839999999999999e-06 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354790+0000", 2024-09-17T01:56:46.359 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.409e-06 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354805+0000", 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5216e-05 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:46.354819+0000", 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4095e-05 2024-09-17T01:56:46.360 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.361 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.361 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.361 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.361 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-09-17T01:56:46.361 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 2 2024-09-17T01:56:46.361 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:46.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:46.457 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.460+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.462 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:56:46.545 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:46.545+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:46.563 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:46.563 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:46.563 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:46.563 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:46.563 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:46.578 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:46.647 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:46.649+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:46.748 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.748+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:46.756 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.202074218, 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.757 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.758 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.759 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.760 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.761 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.762 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.197272541, 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.763 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:46.764 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:46.765 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.766 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.767 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.768 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.194200042999999, 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.769 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.770 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.771 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:46.772 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.773 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.774 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.192263887999999, 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:46.775 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.776 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.777 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.778 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.779 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:46.780 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:46.781 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.190282183000001, 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:46.782 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.783 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:46.784 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.785 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:46.786 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:46.787 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.18702863, 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.788 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.789 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:46.790 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.791 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.792 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:46.793 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.176584112, 2024-09-17T01:56:46.794 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.795 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:46.796 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.797 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.798 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.799 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.800 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.167415332000001, 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.801 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:46.802 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.803 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.804 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:46.805 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.806 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.163385975000001, 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.807 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.808 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.809 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.810 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.811 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:46.812 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.157060418, 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:46.813 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.814 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:46.815 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.816 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.817 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.818 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.153869773, 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.819 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.820 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:46.821 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.822 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.823 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.824 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.825 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.152714121999999, 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.826 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.827 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:46.828 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:46.829 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.830 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.150640783, 2024-09-17T01:56:46.831 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:46.832 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:46.833 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.834 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.835 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:46.836 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.837 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.143539955000001, 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.838 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.839 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:46.840 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.842 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.843 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.138290964999999, 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.844 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:46.845 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.846 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.847 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:46.848 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.849 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.137096937999999, 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.850 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.851 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:46.852 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.853 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:46.854 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.855 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.130492504999999, 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.856 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.857 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:46.858 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.859 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:46.860 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.861 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.862 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.128110907, 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.863 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:46.864 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.865 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.866 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:46.867 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.868 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.12500807, 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:46.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.870 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.871 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.872 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.873 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:46.874 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 27.119155625000001, 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:46.875 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:46.876 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.877 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:46.878 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.879 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:46.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:46.881 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:46.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:46.883 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:46.884+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:46.984 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:46.985+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:46.998 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T01:56:46.998 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T01:56:47.017 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:47.017 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:47.017 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:47.018 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:47.032 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:47.118 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:47.121+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:47.186 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:47.189+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:47.193 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:47.193 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:47.193 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:47.193 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:47.193 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:47.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:47.287 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:47.288+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:47.302 DEBUG:teuthology.parallel:result is None 2024-09-17T01:56:47.303 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:56:47.317 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:56:47.317 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T01:56:47.327 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T01:56:47.327 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:56:47.327 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:56:47.366 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:56:47.367 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:56:47.380 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:47.380 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.007482146999997, 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:47.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:47.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:47.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:47.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:47.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.809486066000002, 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:47.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:47.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:47.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.808602813, 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.398 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:47.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:47.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.406 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.806603293999999, 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:47.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.805546583999998, 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.414 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:47.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:47.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:47.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:47.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.802468252000001, 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.421 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:47.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:47.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:47.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.428 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.800562735, 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:47.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.798329037999999, 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:47.436 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:47.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:47.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:47.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:47.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.797392901999999, 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:47.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:47.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:47.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.450 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.775440404000001, 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.451 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:47.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:47.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.772394395999999, 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.458 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:47.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:47.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.767201989, 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.466 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:47.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:47.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.761842444999999, 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:47.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:47.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.479 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.757369870000002, 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:47.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.745857660999999, 2024-09-17T01:56:47.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:47.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.495 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.737906470999999, 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:47.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:47.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:47.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.733588019999999, 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:47.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:47.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:47.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.728847773999998, 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.508 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:47.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.514 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.726366085999999, 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:47.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:47.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.725370862999998, 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:47.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:47.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:47.527 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:47.527 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:47.528 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:47.529+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:47.529 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:47.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:56:47.629 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:47.633+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:47.650 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:47.650 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:47.650 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:47.650 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:47.664 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:47.730 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:47.732+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:47.781 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:47.781 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:47.782 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:47.782 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:47.782 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:47.796 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:47.831 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:47.833+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:47.892 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T01:56:47.910 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T01:56:47.910 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:56:47.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:56:47.932 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:47.932+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.411419629000001, 2024-09-17T01:56:47.965 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.966 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:47.967 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.968 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.969 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:47.970 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.971 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.406617952000001, 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.972 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:47.973 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:47.974 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:47.975 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:47.976 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:47.977 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.403545454, 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:47.978 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:47.979 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.980 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.981 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:47.982 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.401609299, 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:47.983 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.984 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.985 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:47.986 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:47.987 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:47.988 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:47.989 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.399627593999998, 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:47.990 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:47.991 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.992 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.993 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:47.994 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:47.995 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.396374041000001, 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:47.996 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.997 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.998 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:47.999 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.000 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.001 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.002 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.385929523000001, 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.003 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.004 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:48.005 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.006 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:48.007 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:48.008 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.376760742999998, 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.009 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.010 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.011 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.014 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.015 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.372731386000002, 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.016 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:48.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.018 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:48.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.021 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.366405829000001, 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:48.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:48.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:48.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:48.027 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.363215184000001, 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.028 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:48.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.362059533, 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.034 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:48.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:48.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.040 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.359986194000001, 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:48.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:48.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.352885365999999, 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:48.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:48.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.052 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.347636376000001, 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:48.053 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:48.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:48.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.346442349, 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:48.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:48.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:48.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:48.066 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.339837916, 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:48.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:48.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.337456318000001, 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.073 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:48.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:48.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.079 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.334353481000001, 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.080 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 28.328501035999999, 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.086 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:48.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:48.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:48.091 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:48.093 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:48.094 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:48.093+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:48.194 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:48.197+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:48.241 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:48.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:48.263 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T01:56:48.281 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2024-09-17T01:56:48.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:56:48.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T01:56:48.330 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:48.333+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:48.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:56:48.350 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[23719]: fuse finished with error 0 and tester_r 0 2024-09-17T01:56:48.396 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:48.396+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:48.416 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:48.416 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:48.416 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:48.417 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:48.417 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:48.436 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:48.461 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:48.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T01:56:48.486 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:48.486 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:48.486 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:48.491 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:48.492 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:48.498 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:48.496+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:48.598 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:48.601+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:48.627 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:48.627 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:48.641 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:48.699 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:48.700+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:48.760 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:48.760 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:48.774 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:48.800 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:48.801+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:48.901 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:48.905+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:48.942 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:48.942 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:48.956 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:49.002 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:49.005+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:49.080 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:49.080 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:49.094 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:49.138 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:49.141+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:49.204 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:49.205+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:49.225 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:49.226 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:49.239 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:49.326 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:49.329+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:49.405 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:49.406 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:49.406 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:49.408+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:49.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:49.474 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-17T01:56:49.506 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:49.508+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:49.586 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:49.586 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:49.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:49.607 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:49.609+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:49.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2024-09-17T01:56:49.708 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:49.708+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:49.732 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:49.732 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:49.746 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:49.838 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:49.840+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:49.909 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:49.909 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:49.911 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:49.913+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:49.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:50.012 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:50.012+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:50.091 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:50.091 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:50.105 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:50.154 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:50.157+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:50.214 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:50.217+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:50.238 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:50.238 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:50.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:50.315 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:50.316+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:50.416 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:50.416 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:50.416 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:50.420+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:50.430 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:50.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T01:56:50.517 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:50.517+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:50.548 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:50.548 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:50.562 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:50.618 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:50.620+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:50.650 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:50.650 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:50.671 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:50.671 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:50.671 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:50.675 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:50.675 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:50.695 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:50.696 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:50.696 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:50.696 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:50.710 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:50.754 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:50.756+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:50.819 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:50.821+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:50.880 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:50.880 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:50.880 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:50.880 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:50.880 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:50.894 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:50.938 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:50.940+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:51.017 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:51.017 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:51.017 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.463884491999998, 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.018 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.019 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.020 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.021 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.022 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:51.023 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.024 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.459082814999999, 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.025 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.026 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:51.027 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.028 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:51.029 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.030 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.456010317, 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.031 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.032 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.033 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.034 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.035 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:51.036 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.037 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.454074162000001, 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.038 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:51.039 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:51.040 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.041 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:51.042 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.043 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.044 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.452092456999999, 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.045 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:51.046 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:51.047 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.048 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.049 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:51.050 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.448838903999999, 2024-09-17T01:56:51.051 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:51.052 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.052 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.052 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.052 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.052 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.052 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.053 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.054 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.055 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:51.056 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.057 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:51.058 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.438394385999999, 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.059 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.060 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.061 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.062 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.063 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.064 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:51.065 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.429225605999999, 2024-09-17T01:56:51.066 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.067 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.068 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.069 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.070 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:51.071 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.425196248999999, 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.073 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:51.075 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:51.076 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.077 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.078 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.079 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.418870691999999, 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.080 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.081 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.082 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:51.083 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.084 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.084 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:51.084 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:51.084 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.084 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:51.085 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.086 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.415680046999999, 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:51.087 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.088 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.089 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:51.090 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.091 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:51.092 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.093 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.414524396000001, 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.094 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.095 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:51.096 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.098 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.098 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.098 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:51.098 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:51.098 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.099 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.099 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:51.099 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:51.099 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.099 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.100 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:51.100 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:51.100 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.100 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.100 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.101 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:51.101 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:51.101 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.101 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.101 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:51.102 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:51.102 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.102 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.102 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.102 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:51.103 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:51.103 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.103 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.103 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.103 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:51.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:51.104 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.104 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.104 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.104 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:51.104 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.105 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.412451056999998, 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:51.106 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.107 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:51.108 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.109 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.110 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.111 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.405350229, 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.112 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.113 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:51.114 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:51.115 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.116 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.117 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.118 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.400101239000001, 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.119 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.120 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.121 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.122 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:51.123 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.124 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.125 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.398907212000001, 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.126 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:51.127 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.128 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:51.129 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.130 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.131 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.392302779000001, 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.132 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.133 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.133 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:51.133 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.133 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.133 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.133 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:51.134 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.135 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:51.136 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:51.136 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.136 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.136 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.136 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.137 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:51.138 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:51.139 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.389921180999998, 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.140 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.141 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:51.142 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:51.144 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.145 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.386818344000002, 2024-09-17T01:56:51.146 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.147 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:51.148 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.149 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.150 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:51.151 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 31.380965899, 2024-09-17T01:56:51.152 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:51.153 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.154 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.155 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:51.155 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:51.155 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:51.155 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.155 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:51.156 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.157 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.158 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:51.159 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:51.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.160 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.160 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:51.160 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:51.160 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:51.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:51.162 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:51.160+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:51.263 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:51.264+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:51.295 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:51.295 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:51.295 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:51.295 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:51.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:51.363 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:51.364+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:51.425 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:51.426 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:51.426 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:51.426 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:51.426 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:51.439 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:51.486 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:51.489+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:51.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T01:56:51.566 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:51.569+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.193787592, 2024-09-17T01:56:51.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:51.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:51.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.995791511, 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:51.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:51.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.585 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.994908257999999, 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.586 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:51.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:51.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:51.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:51.594 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.992908739000001, 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:51.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:51.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.991852029, 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.602 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.603 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:51.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:51.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:51.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:51.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.988773696999999, 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:51.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:51.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.986868179999998, 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:51.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:51.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:51.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:51.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:51.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:51.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.630 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.984634483000001, 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.631 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:51.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.983698347000001, 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:51.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.643 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.961745849, 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:51.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:51.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.958699841000001, 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:51.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:51.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:51.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.953507433999999, 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.658 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:51.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:51.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:51.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.948147890000001, 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:51.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:51.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.943675315, 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:51.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:51.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:51.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:51.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.932163106000001, 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.680 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:51.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:51.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:51.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.686 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.924211916000001, 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:51.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:51.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:51.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:51.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:51.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:51.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:51.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:51.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:51.695 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.919893465000001, 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.696 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:51.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:51.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:51.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:51.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:51.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:51.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:51.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:51.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:51.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.704 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.704 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.704 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:51.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.915153219, 2024-09-17T01:56:51.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:51.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:51.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:51.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:51.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.912671531000001, 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:51.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:51.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:51.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.911676308000001, 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:51.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:51.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:51.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:51.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:51.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:51.731 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:51.733 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:51.733+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:51.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:51.833 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:51.835+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:51.868 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:51.868 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:51.868 INFO:teuthology.orchestra.run.smithi096.stdout: "num_ops": 0 2024-09-17T01:56:51.868 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:51.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:51.934 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:51.937+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:52.035 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:52.035+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:52.050 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [], 2024-09-17T01:56:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: "complaint_time": 30, 2024-09-17T01:56:52.050 INFO:teuthology.orchestra.run.smithi096.stdout: "num_blocked_ops": 0 2024-09-17T01:56:52.050 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:52.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:52.136 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:52.137+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 20, 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 600, 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9523 4.20 4:05c0c200:::10000002bbb.00000000:head [write 0~5931] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:52.228 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.674244264999999, 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.84048860299999995, 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9523 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554006+0000", 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554008+0000", 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9230000000000001e-06 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554032+0000", 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3808999999999999e-05 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554064+0000", 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2218999999999998e-05 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554084+0000", 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0000000000000002e-05 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.231 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554243+0000", 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015902599999999999 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.554261+0000", 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8023e-05 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388037+0000", 2024-09-17T01:56:52.232 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.83377617500000001 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.388157+0000", 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119657 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394357+0000", 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0062002079999999996 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.233 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394409+0000", 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.2268000000000002e-05 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394495+0000", 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.5295000000000002e-05 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9527 4.2c 4:364785df:::10000002bbf.00000000:head [write 0~23537] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.234 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.669442588000003, 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.82604345700000004, 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9527 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.235 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558808+0000", 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558810+0000", 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.17e-06 2024-09-17T01:56:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558874+0000", 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4208999999999995e-05 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558907+0000", 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2495e-05 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.237 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.558926+0000", 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8913e-05 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559069+0000", 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014335300000000001 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.559083+0000", 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4260000000000001e-05 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.238 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374336+0000", 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81525230500000001 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374592+0000", 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00025674999999999998 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384639+0000", 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.010046337000000001 2024-09-17T01:56:52.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384722+0000", 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.3032000000000001e-05 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384851+0000", 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012963300000000001 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9529 4.3c 4:3e4bb9fa:::10000002bc2.00000000:head [write 0~7578] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.666370090000001, 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81723927200000002, 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9529 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.241 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561880+0000", 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561883+0000", 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5629999999999999e-06 2024-09-17T01:56:52.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561911+0000", 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.7783000000000001e-05 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561947+0000", 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6312000000000001e-05 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.561969+0000", 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1725999999999998e-05 2024-09-17T01:56:52.243 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562130+0000", 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000161779 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.562148+0000", 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7407000000000001e-05 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.244 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346255+0000", 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78410719399999995 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.346581+0000", 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032595600000000002 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378988+0000", 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.032406481000000001 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.245 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379042+0000", 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4030999999999998e-05 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379120+0000", 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.8040000000000005e-05 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.246 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9530 4.a 4:528ffd61:::10000002bc4.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.664433934999998, 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.812524354, 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9530 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.247 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563816+0000", 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563819+0000", 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:52.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563833+0000", 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3902e-05 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563860+0000", 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6999999999999999e-05 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563877+0000", 2024-09-17T01:56:52.249 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7122e-05 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.563994+0000", 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117698 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.564010+0000", 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5248999999999999e-05 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.250 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357951+0000", 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79394167199999999 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.358084+0000", 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013282499999999999 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376191+0000", 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.018106438999999998 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.251 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376256+0000", 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.5246999999999994e-05 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376341+0000", 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.4975999999999994e-05 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9532 4.2c 4:36782ade:::10000002bc6.00000000:head [write 0~4307] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.252 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.66245223, 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81928878400000005, 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9532 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:52.253 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565798+0000", 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565800+0000", 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1500000000000002e-06 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.254 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565823+0000", 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3054999999999999e-05 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565857+0000", 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.4075999999999997e-05 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.565882+0000", 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4110000000000001e-05 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.255 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566030+0000", 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014888299999999999 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.566045+0000", 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4413000000000001e-05 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378025+0000", 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.81197978999999998 2024-09-17T01:56:52.256 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378221+0000", 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00019595600000000001 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384867+0000", 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0066462880000000002 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.257 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384947+0000", 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0519999999999995e-05 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385087+0000", 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000139543 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9534 4.b 4:d06fdc19:::10000002bc9.00000000:head [write 0~7157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:52.258 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.659198676999999, 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.80063651499999999, 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9534 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:52.259 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569052+0000", 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569054+0000", 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2299999999999998e-06 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.260 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569090+0000", 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6028999999999997e-05 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569119+0000", 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9206000000000001e-05 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569136+0000", 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6765999999999998e-05 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.261 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569229+0000", 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.2927e-05 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.569242+0000", 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.3334e-05 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361362+0000", 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.792119825 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.262 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361516+0000", 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000154349 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369471+0000", 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079545299999999996 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369588+0000", 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011683 2024-09-17T01:56:52.263 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.369688+0000", 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010048900000000001 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9542 4.35 4:acaa7c0b:::10000002bd3.00000000:head [write 0~951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.648754158999999, 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77841253099999996, 2024-09-17T01:56:52.264 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9542 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579496+0000", 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579498+0000", 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5430000000000001e-06 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579507+0000", 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8100000000000004e-06 2024-09-17T01:56:52.266 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579530+0000", 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3359000000000001e-05 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579549+0000", 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8836999999999999e-05 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579675+0000", 2024-09-17T01:56:52.267 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012664299999999999 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.579690+0000", 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4153e-05 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.340930+0000", 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76124070499999996 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.341256+0000", 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00032571199999999997 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357745+0000", 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.016489191 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357810+0000", 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4513999999999999e-05 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357909+0000", 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9063999999999999e-05 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9549 4.16 4:6bf46135:::10000002bdc.00000000:head [write 0~6410] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.639585379000003, 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79119980700000003, 2024-09-17T01:56:52.270 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9549 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588665+0000", 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588667+0000", 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.784e-06 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588706+0000", 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.9521999999999999e-05 2024-09-17T01:56:52.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588735+0000", 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9011999999999999e-05 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588753+0000", 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7640000000000001e-05 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.273 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588867+0000", 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000113541 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.588881+0000", 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4272e-05 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357452+0000", 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76857092599999999 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.274 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.357573+0000", 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012166499999999999 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378744+0000", 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.02117109 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378946+0000", 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00020132900000000001 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379865+0000", 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00091902599999999998 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9553 4.1a 4:58010989:::10000002be0.00000000:head [write 0~6426] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.635556022000003, 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78590066999999997, 2024-09-17T01:56:52.276 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9553 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592694+0000", 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592696+0000", 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0930000000000001e-06 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592726+0000", 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9427000000000001e-05 2024-09-17T01:56:52.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592750+0000", 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3779000000000001e-05 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592771+0000", 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1486000000000001e-05 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.279 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592908+0000", 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000137033 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.592928+0000", 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9746999999999999e-05 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.370624+0000", 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77769575199999996 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.280 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371167+0000", 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00054374499999999999 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378441+0000", 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0072731769999999996 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378514+0000", 2024-09-17T01:56:52.281 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.3454000000000005e-05 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.378595+0000", 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0976999999999994e-05 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9558 4.2c 4:37e0e143:::10000002be6.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.629230464999999, 2024-09-17T01:56:52.282 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78629410899999996, 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9558 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:52.283 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599020+0000", 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599023+0000", 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.976e-06 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.284 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599036+0000", 2024-09-17T01:56:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.329e-05 2024-09-17T01:56:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599070+0000", 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.3531999999999997e-05 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599091+0000", 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1444e-05 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599305+0000", 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00021357400000000001 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.599341+0000", 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.6349e-05 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379200+0000", 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77985869500000005 2024-09-17T01:56:52.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379448+0000", 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00024858299999999997 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385099+0000", 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0056506689999999997 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.288 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385179+0000", 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9560000000000004e-05 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385314+0000", 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000135437 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9560 4.39 4:9f1bed9b:::10000002be9.00000000:head [write 0~8344] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.289 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.626039820000003, 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.795390822, 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9560 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.290 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602211+0000", 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602212+0000", 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.606e-06 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.291 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602242+0000", 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.9805999999999999e-05 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602259+0000", 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6835999999999999e-05 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602269+0000", 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9229999999999997e-06 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602370+0000", 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010156499999999999 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.602385+0000", 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4226000000000001e-05 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.293 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394623+0000", 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.79223800700000002 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.394755+0000", 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013271800000000001 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397438+0000", 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0026828730000000001 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.294 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397501+0000", 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.3025000000000001e-05 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.397601+0000", 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000100237 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9561 4.3c 4:3db71306:::10000002bea.00000000:head [write 0~8451] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:52.295 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.624884168999998, 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77592286200000005, 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9561 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.296 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603366+0000", 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603369+0000", 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3460000000000001e-06 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.297 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603395+0000", 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6516000000000002e-05 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603427+0000", 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1940000000000003e-05 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603443+0000", 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6402e-05 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.298 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603596+0000", 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00015296999999999999 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.603622+0000", 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.5709999999999999e-05 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347411+0000", 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74378846399999998 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.347577+0000", 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016619200000000001 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379127+0000", 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.031550658000000002 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379194+0000", 2024-09-17T01:56:52.300 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.6839000000000002e-05 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.379289+0000", 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.4825000000000001e-05 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9562 4.2c 4:36116276:::10000002bec.00000000:head [write 0~4393] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.622810829999999, 2024-09-17T01:56:52.301 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.78004273400000002, 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9562 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605440+0000", 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605442+0000", 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.3999999999999999e-06 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605462+0000", 2024-09-17T01:56:52.303 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0199000000000001e-05 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605494+0000", 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2036000000000003e-05 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605512+0000", 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7646e-05 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605635+0000", 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000123297 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.605654+0000", 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8839999999999999e-05 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381130+0000", 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.77547604199999998 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.305 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.381253+0000", 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012299899999999999 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385327+0000", 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0040734689999999997 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385406+0000", 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.9457999999999997e-05 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.385482+0000", 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 7.6347999999999995e-05 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9568 4.a 4:5230c8b9:::10000002bf3.00000000:head [write 0~4983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.615710002, 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76394734200000003, 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.307 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9568 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.308 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612540+0000", 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612543+0000", 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612561+0000", 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8581999999999999e-05 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612597+0000", 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.5456000000000001e-05 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612614+0000", 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7546000000000001e-05 2024-09-17T01:56:52.310 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612733+0000", 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011913699999999999 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.612751+0000", 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7312999999999998e-05 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.360019+0000", 2024-09-17T01:56:52.311 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74726794200000002 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.361312+0000", 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.001293059 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376352+0000", 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015039986999999999 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.312 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376407+0000", 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.5449999999999999e-05 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.376488+0000", 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.0703000000000003e-05 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9572 4.c 4:33ba71d7:::10000002bf8.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:52.313 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.610461012000002, 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.765781041, 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9572 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.314 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617789+0000", 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617792+0000", 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1660000000000001e-06 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.315 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617803+0000", 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.1353e-05 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617835+0000", 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2435999999999999e-05 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617854+0000", 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8595999999999999e-05 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.617994+0000", 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00013979699999999999 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618020+0000", 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.6009000000000001e-05 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368049+0000", 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75002955400000004 2024-09-17T01:56:52.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368197+0000", 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014789800000000001 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383323+0000", 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015125628 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383423+0000", 2024-09-17T01:56:52.318 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.9913000000000004e-05 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383570+0000", 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014769100000000001 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9573 4.c 4:308acd06:::10000002bf9.00000000:head [write 0~6955] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.609266984999998, 2024-09-17T01:56:52.319 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76491209299999996, 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9573 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618983+0000", 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.618986+0000", 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1229999999999998e-06 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619008+0000", 2024-09-17T01:56:52.321 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2461999999999999e-05 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619040+0000", 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2339999999999999e-05 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619055+0000", 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4355999999999999e-05 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.322 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619174+0000", 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000119144 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.619194+0000", 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.0353e-05 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368740+0000", 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.749545868 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.323 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.368865+0000", 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00012463700000000001 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383618+0000", 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.014753459999999999 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383735+0000", 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000117012 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383896+0000", 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000160338 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9577 4.29 4:96c3b5a3:::10000002bff.00000000:head [write 0~6807] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.602662551999998, 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76641918099999995, 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.325 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9577 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.326 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625588+0000", 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625590+0000", 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1670000000000002e-06 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625608+0000", 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8102999999999999e-05 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.327 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625650+0000", 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.2089000000000003e-05 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625675+0000", 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4983000000000001e-05 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625802+0000", 2024-09-17T01:56:52.328 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.000126477 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.625849+0000", 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 4.7122e-05 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383864+0000", 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75801563100000002 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.383974+0000", 2024-09-17T01:56:52.329 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010952500000000001 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391905+0000", 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0079312719999999996 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.391938+0000", 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.2502000000000002e-05 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.330 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392007+0000", 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.9309999999999999e-05 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9579 4.b 4:d3212d96:::10000002c01.00000000:head [write 0~7513] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.600280953999999, 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.74365801799999998, 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.331 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9579 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.332 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627969+0000", 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627972+0000", 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.1469999999999999e-06 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.627994+0000", 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.2473e-05 2024-09-17T01:56:52.333 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628026+0000", 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 3.1705999999999998e-05 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628040+0000", 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.4199000000000001e-05 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.334 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628181+0000", 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00014101700000000001 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.628209+0000", 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8119e-05 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.363830+0000", 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73562122699999999 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.335 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.364140+0000", 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00030950900000000002 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371472+0000", 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073318890000000003 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371536+0000", 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 6.4314999999999997e-05 2024-09-17T01:56:52.336 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.371627+0000", 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 9.1416999999999996e-05 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9582 4.29 4:95c6494c:::10000002c04.00000000:head [write 0~6361] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.597178116999999, 2024-09-17T01:56:52.337 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.76102357600000003, 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9582 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.338 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631072+0000", 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631074+0000", 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.827e-06 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631094+0000", 2024-09-17T01:56:52.339 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.9502000000000001e-05 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631111+0000", 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631126+0000", 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5291999999999999e-05 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.340 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631290+0000", 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00016448299999999999 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.631319+0000", 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8180000000000001e-05 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384562+0000", 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.753243624 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.341 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.384670+0000", 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00010791 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392012+0000", 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.0073422110000000004 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392041+0000", 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.8815000000000001e-05 2024-09-17T01:56:52.342 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.392096+0000", 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.4784999999999998e-05 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "description": "osd_op(client.4468.0:9586 4.0 4:037fc5cc:::10000002c09.00000000:head [write 0~3412] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "initiated_at": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 32.591325671999996, 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.75337878899999999, 2024-09-17T01:56:52.343 INFO:teuthology.orchestra.run.smithi096.stdout: "continuous": false, 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "type_data": { 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "client_info": { 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "client": "client.4468", 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 9586 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "events": [ 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "initiated", 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.344 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "header_read", 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636925+0000", 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "throttled", 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636927+0000", 2024-09-17T01:56:52.345 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.8199999999999999e-06 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "all_read", 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636939+0000", 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.2839e-05 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "dispatched", 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636964+0000", 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 2.4873999999999999e-05 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.346 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.636980+0000", 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.5985e-05 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637157+0000", 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00017699999999999999 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:19.637174+0000", 2024-09-17T01:56:52.347 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 1.7169000000000001e-05 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "reached_pg", 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374286+0000", 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.73711165000000001 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "started", 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.374403+0000", 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.00011739399999999999 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.348 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "op_commit", 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390163+0000", 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 0.015759364000000001 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "commit_sent", 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390215+0000", 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 5.1981999999999998e-05 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "event": "done", 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "time": "2024-09-17T01:56:20.390304+0000", 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: "duration": 8.8712e-05 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.349 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.350 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.350 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-17T01:56:52.350 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-09-17T01:56:52.350 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-17T01:56:52.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:52.352 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:52.351+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:52.452 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:52.453+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:52.483 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:52.483 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:52.483 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T01:56:52.484 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-17T01:56:52.499 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:52.557 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:52.555+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:52.654 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:52.655+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T01:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T01:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T01:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:52.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:52.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T01:56:52.755 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:52.757+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:4473 4.2d 4:b6788029:::1000000151e.00000000:head [write 0~890] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:52.797 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.423038515999998, 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89867404500000003, 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4473 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373798+0000", 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373799+0000", 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5900000000000005e-07 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373813+0000", 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3933e-05 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373826+0000", 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3304e-05 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373835+0000", 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-09-17T01:56:52.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373931+0000", 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6315000000000002e-05 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:10.373950+0000", 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8646000000000001e-05 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266693+0000", 2024-09-17T01:56:52.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.89274332899999997 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.266922+0000", 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022863000000000001 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.267157+0000", 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023553499999999999 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T01:56:52.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.271565+0000", 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044082920000000003 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272171+0000", 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060559999999999998 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272359+0000", 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188025 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:11.272472+0000", 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113038 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9537 4.1 4:81c0c845:::10000002bce.00000000:head [write 0~6637] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.225042434999999, 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81135622100000004, 2024-09-17T01:56:52.804 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9537 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571794+0000", 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571795+0000", 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5499999999999997e-07 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571803+0000", 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0560000000000005e-06 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571813+0000", 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8050000000000001e-06 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571818+0000", 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5770000000000001e-06 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571865+0000", 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6635000000000003e-05 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.571871+0000", 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3430000000000001e-06 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369848+0000", 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79797678299999997 2024-09-17T01:56:52.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370177+0000", 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032905899999999998 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382815+0000", 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012638099 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382940+0000", 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012475400000000001 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383150+0000", 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021025500000000001 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9538 4.2 4:4198fc3b:::10000002bcf.00000000:head [write 0~1036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.224159182000001, 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81486310200000001, 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9538 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572677+0000", 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572678+0000", 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3e-07 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572682+0000", 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9740000000000004e-06 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572691+0000", 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2159999999999995e-06 2024-09-17T01:56:52.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572696+0000", 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0660000000000003e-06 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572744+0000", 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7474e-05 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.572751+0000", 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1019999999999999e-06 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.376645+0000", 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80389401900000002 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.377221+0000", 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057621899999999999 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387310+0000", 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010089223 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387406+0000", 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5842999999999997e-05 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387541+0000", 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013423600000000001 2024-09-17T01:56:52.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9540 4.32 4:4e5ef6ba:::10000002bd1.00000000:head [write 0~9068] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.222159662999999, 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80688652299999997, 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9540 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574677+0000", 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574678+0000", 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-06 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574691+0000", 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3035e-05 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574701+0000", 2024-09-17T01:56:52.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7280000000000007e-06 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574707+0000", 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8390000000000003e-06 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574757+0000", 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.574764+0000", 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.255e-06 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345603+0000", 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77083885100000005 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.345999+0000", 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039676499999999999 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381234+0000", 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035234692999999997 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381371+0000", 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381563+0000", 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019279400000000001 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.822 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9541 4.34 4:2fd114f0:::10000002bd2.00000000:head [write 0~10436] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.221102952999999, 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80292449700000001, 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9541 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575734+0000", 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4199999999999995e-07 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575744+0000", 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9029999999999999e-06 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575752+0000", 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0539999999999995e-06 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575757+0000", 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5379999999999996e-06 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575817+0000", 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0195999999999998e-05 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.575826+0000", 2024-09-17T01:56:52.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0790000000000007e-06 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343467+0000", 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767640667 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.343728+0000", 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026160799999999998 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378291+0000", 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034562897000000002 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378408+0000", 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011629999999999999 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378658+0000", 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025061300000000001 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9543 4.1d 4:b8cfa12a:::10000002bd5.00000000:head [write 0~6114] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.218024620999998, 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81949322400000002, 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.829 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9543 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578812+0000", 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578813+0000", 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578821+0000", 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0760000000000003e-06 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578834+0000", 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2794e-05 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578840+0000", 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2169999999999999e-06 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578900+0000", 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0402000000000002e-05 2024-09-17T01:56:52.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.578910+0000", 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3039999999999994e-06 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390445+0000", 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.81153505100000001 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390655+0000", 2024-09-17T01:56:52.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210347 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398036+0000", 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073807569999999999 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398121+0000", 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4900000000000004e-05 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398305+0000", 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018438499999999999 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9545 4.24 4:26e2dfe5:::10000002bd7.00000000:head [write 0~4947] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.216119104000001, 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79834132999999996, 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.835 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9545 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580717+0000", 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580719+0000", 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1119999999999999e-06 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580729+0000", 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0835999999999999e-05 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580743+0000", 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3395e-05 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580750+0000", 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.542e-06 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580816+0000", 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5900000000000003e-05 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.580825+0000", 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8850000000000005e-06 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.346309+0000", 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76548348899999996 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.348054+0000", 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001745536 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378874+0000", 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030819684999999999 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378932+0000", 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8474999999999998e-05 2024-09-17T01:56:52.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.379059+0000", 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126475 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9546 4.25 4:a4b4494e:::10000002bd9.00000000:head [write 0~4122] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.213885406999999, 2024-09-17T01:56:52.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80120767900000001, 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9546 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582951+0000", 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582953+0000", 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1600000000000001e-06 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.582970+0000", 2024-09-17T01:56:52.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436999999999999e-05 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583000+0000", 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9907e-05 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583014+0000", 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4409999999999999e-05 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583081+0000", 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7268999999999996e-05 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583091+0000", 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2629999999999992e-06 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.362985+0000", 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77989421299999995 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363289+0000", 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030387600000000002 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.383932+0000", 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020643193000000001 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384025+0000", 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3213000000000004e-05 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384159+0000", 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133738 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.847 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9547 4.2a 4:542a53d1:::10000002bda.00000000:head [write 0~8113] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.212949270999999, 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.80712779199999996, 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9547 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583887+0000", 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583889+0000", 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-17T01:56:52.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583910+0000", 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1019999999999999e-05 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583940+0000", 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9658e-05 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.583955+0000", 2024-09-17T01:56:52.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4666e-05 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584010+0000", 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5671999999999998e-05 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.584016+0000", 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5690000000000004e-06 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386811+0000", 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.802795064 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387038+0000", 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000226942 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390837+0000", 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037988620000000001 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390890+0000", 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2942000000000002e-05 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391015+0000", 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012530700000000001 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9564 4.22 4:44b036bc:::10000002bef.00000000:head [write 0~6587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.190996773000002, 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78060542099999997, 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9564 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605840+0000", 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605842+0000", 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2239999999999998e-06 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605860+0000", 2024-09-17T01:56:52.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7813e-05 2024-09-17T01:56:52.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605890+0000", 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0017000000000001e-05 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605904+0000", 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4243999999999999e-05 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605989+0000", 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4469999999999996e-05 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.605998+0000", 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3430000000000002e-06 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359444+0000", 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75344577000000001 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.361843+0000", 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023997720000000001 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386226+0000", 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024382559000000002 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386335+0000", 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108983 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386445+0000", 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110226 2024-09-17T01:56:52.859 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9567 4.3d 4:be0e0b2f:::10000002bf2.00000000:head [write 0~7799] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.187950764999997, 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.79011772499999999, 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9567 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608886+0000", 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608887+0000", 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.477e-06 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608902+0000", 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608921+0000", 2024-09-17T01:56:52.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.608932+0000", 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1391e-05 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609005+0000", 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2469e-05 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.609014+0000", 2024-09-17T01:56:52.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0350000000000007e-06 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393011+0000", 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.78399743600000005 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393224+0000", 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213243 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398702+0000", 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054774960000000001 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.398797+0000", 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5563999999999995e-05 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399004+0000", 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000206188 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9571 4.32 4:4e56458f:::10000002bf7.00000000:head [write 0~3908] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.182758358000001, 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76784060700000001, 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.866 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9571 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614078+0000", 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614080+0000", 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.553e-06 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614092+0000", 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2694000000000001e-05 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614113+0000", 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0780000000000001e-05 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614125+0000", 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1250000000000001e-05 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614201+0000", 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6407000000000002e-05 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.614210+0000", 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9919999999999996e-06 2024-09-17T01:56:52.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349564+0000", 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73535455400000005 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.349930+0000", 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000365986 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381587+0000", 2024-09-17T01:56:52.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031656748999999998 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381715+0000", 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012803399999999999 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.381919+0000", 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020360800000000001 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9575 4.22 4:45633f74:::10000002bfc.00000000:head [write 0~6543] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.177398814, 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.767245332, 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9575 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.872 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619438+0000", 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619440+0000", 2024-09-17T01:56:52.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9570000000000001e-06 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619457+0000", 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946999999999999e-05 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619485+0000", 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8733000000000001e-05 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619504+0000", 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619591+0000", 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6817000000000006e-05 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.619600+0000", 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5219999999999996e-06 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363583+0000", 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74398304699999995 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.363892+0000", 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030903799999999998 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386454+0000", 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022561949000000001 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386578+0000", 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012409000000000001 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.386683+0000", 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104845 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9578 4.1d 4:b81a3ae5:::10000002c00.00000000:head [write 0~952] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.172926238999999, 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.77537758000000001, 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9578 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623910+0000", 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623913+0000", 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9670000000000001e-06 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623926+0000", 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2813000000000001e-05 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623959+0000", 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3219999999999997e-05 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.623976+0000", 2024-09-17T01:56:52.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.696e-05 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624058+0000", 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1237999999999997e-05 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.624066+0000", 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6500000000000002e-06 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391688+0000", 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76762206499999996 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.391946+0000", 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025734199999999998 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399028+0000", 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070827770000000002 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399118+0000", 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9786999999999999e-05 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399288+0000", 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016976099999999999 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9587 4.1d 4:b84a9322:::10000002c0a.00000000:head [write 0~7754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.883 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.161414030000003, 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76412885200000003, 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9587 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635423+0000", 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635425+0000", 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4569999999999999e-06 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635447+0000", 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.181e-05 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635472+0000", 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5556000000000001e-05 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635488+0000", 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5970000000000001e-05 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635565+0000", 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6527999999999996e-05 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.635574+0000", 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5990000000000008e-06 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393024+0000", 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75744911500000001 2024-09-17T01:56:52.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.393187+0000", 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016385400000000001 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399301+0000", 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061137750000000001 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399377+0000", 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6217999999999994e-05 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.399551+0000", 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017396999999999999 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9593 4.13 4:ca5dfb7d:::10000002c11.00000000:head [write 0~8925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:52.889 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.153462840000003, 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76196137600000002, 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9593 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:52.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643374+0000", 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643375+0000", 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0690000000000001e-06 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643387+0000", 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2251e-05 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643402+0000", 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4986e-05 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643411+0000", 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643523+0000", 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011205399999999999 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.643546+0000", 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2847e-05 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.359848+0000", 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.716302102 2024-09-17T01:56:52.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.360231+0000", 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038322200000000001 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405013+0000", 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.044782354000000003 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405145+0000", 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013151600000000001 2024-09-17T01:56:52.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.405335+0000", 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190304 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9596 4.25 4:a678029e:::10000002c15.00000000:head [write 0~6983] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.149144389, 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73671596900000003, 2024-09-17T01:56:52.895 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9596 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647692+0000", 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647693+0000", 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9100000000000002e-07 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647702+0000", 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2320000000000007e-06 2024-09-17T01:56:52.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647715+0000", 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3142999999999999e-05 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647723+0000", 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8890000000000002e-06 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647838+0000", 2024-09-17T01:56:52.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011428499999999999 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.647863+0000", 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5207000000000001e-05 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.369831+0000", 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.721968375 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.370211+0000", 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037955500000000001 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384172+0000", 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013960896 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384258+0000", 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6546999999999997e-05 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.384408+0000", 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149949 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9599 4.2a 4:5632a360:::10000002c19.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.144404143000003, 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.74436808799999998, 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.901 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9599 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652432+0000", 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652433+0000", 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652443+0000", 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1069999999999994e-06 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652456+0000", 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3383999999999999e-05 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652463+0000", 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4089999999999997e-06 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652506+0000", 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2731000000000001e-05 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.652512+0000", 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5559999999999998e-06 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.387949+0000", 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73543709999999995 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388117+0000", 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-17T01:56:52.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396565+0000", 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084484409999999992 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396665+0000", 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9504000000000001e-05 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.396801+0000", 2024-09-17T01:56:52.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013589099999999999 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9600 4.2 4:43c6fdd6:::10000002c1b.00000000:head [write 0~6105] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.141922455, 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73410517500000005, 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9600 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654914+0000", 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654916+0000", 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8640000000000001e-06 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654935+0000", 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8783e-05 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654958+0000", 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3493999999999999e-05 2024-09-17T01:56:52.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.654973+0000", 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.499e-05 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655023+0000", 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9892000000000003e-05 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655028+0000", 2024-09-17T01:56:52.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5549999999999996e-06 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378164+0000", 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72313676800000004 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.378380+0000", 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021526100000000001 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388773+0000", 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010393474999999999 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.388866+0000", 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2540000000000005e-05 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.389019+0000", 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015355300000000001 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.912 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4468.0:9601 4.d 4:b197b391:::10000002c1c.00000000:head [write 0~915] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.140927232000003, 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.73486579600000002, 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4468", 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/3923785698", 2024-09-17T01:56:52.913 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 9601 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655909+0000", 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655910+0000", 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0440000000000001e-06 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655916+0000", 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0070000000000003e-06 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655931+0000", 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4963000000000001e-05 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655942+0000", 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.076e-05 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655978+0000", 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6069000000000003e-05 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:19.655982+0000", 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.54e-06 2024-09-17T01:56:52.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382253+0000", 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.72627098300000004 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.382488+0000", 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000235763 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390428+0000", 2024-09-17T01:56:52.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079399789999999998 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390577+0000", 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014880699999999999 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T01:56:20.390775+0000", 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019788100000000001 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.918 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T01:56:52.919 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T01:56:52.919 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T01:56:52.920 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-17T01:56:52.920 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T01:56:52.921 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-17T01:56:52.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:52.922 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T01:56:52.922 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T01:56:52.922 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T01:56:52.922 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T01:56:52.923 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:52.919+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:53.021 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:53.021+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:53.052 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.052 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:53.122 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:53.123+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:53.183 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.183 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:53.223 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:53.225+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:53.324 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:53.325+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:53.362 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.362 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.377 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:53.426 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:53.429+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:53.510 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.510 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.525 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:53.526 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:53.527+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:53.627 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:53.627+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:53.684 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.684 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.698 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:53.728 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:53.727+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:53.820 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.821 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.829 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:53.829+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:53.834 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:53.929 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:53.933+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:53.964 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:53.964 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:53.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:54.030 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:54.031+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:54.095 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:54.095 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:54.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:54.132 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:54.133+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:54.234 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:54.235+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:54.274 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:54.275 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:54.288 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:54.335 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:54.335+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:54.420 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:54.421 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:54.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:54.436 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T01:56:54.437+0000 7fcaae4bc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22931) UID: 0 2024-09-17T01:56:54.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T01:56:54.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:56:54.452 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:56:54.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:56:54.468 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T01:56:54.515 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:56:54.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:56:54.516 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:56:54.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:56:54.537 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:54.539+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:54.550 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:54.551 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:54.564 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:54.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:56:54.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-17T01:56:54.638 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:54.639+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:54.680 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:54.680 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:54.694 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T01:56:54.739 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-17T01:56:54.739+0000 7f63400b3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22926) UID: 0 2024-09-17T01:56:54.791 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-17T01:56:54.801 INFO:tasks.thrashosds:joining thrashosds 2024-09-17T01:56:54.823 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:54.823 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:54.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T01:56:55.006 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:55.006 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:55.019 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T01:56:55.142 INFO:teuthology.orchestra.run.smithi096.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:55.143 INFO:teuthology.orchestra.run.smithi096.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:55.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T01:56:55.290 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:55.291 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:55.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T01:56:55.424 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:55.424 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:55.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~36s 2024-09-17T01:56:55.440 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T01:56:55.514 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:56:55.567 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T01:56:55.567 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T01:56:57.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T01:56:58.528 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-17T01:56:58.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T01:56:59.542 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-17T01:57:01.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-09-17T01:57:07.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-09-17T01:57:12.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-09-17T01:57:18.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-09-17T01:57:24.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-09-17T01:57:30.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-09-17T01:57:36.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-09-17T01:57:41.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-09-17T01:57:47.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-09-17T01:57:53.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-09-17T01:57:59.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2024-09-17T01:58:05.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-09-17T01:58:10.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-09-17T01:58:16.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-09-17T01:58:22.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-09-17T01:58:28.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~128s 2024-09-17T01:58:34.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2024-09-17T01:58:39.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-09-17T01:58:45.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2024-09-17T01:58:51.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2024-09-17T01:58:57.111 DEBUG:teuthology.orchestra.console.smithi154:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializiel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 77 61 GUID: 00000000 0000 0000 0000 0CC47AD91A54 DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.154 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:77:61)... Configuring (net0 0c:c4:7a:88:77:61).... Configuring (net0 0c:c4:7a:88:77:61)..... Configuring (net0 0c:c4:7a:88:77:61)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.757 MHz processor [ 0.000412] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000594] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001894] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008281] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008297] Using GB pages for direct mapping [ 0.008395] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008400] ACPI: Early table checksum verification disabled [ 0.008403] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008407] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008412] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008417] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008420] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008423] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008426] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008429] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008432] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008435] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008438] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008440] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008443] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008446] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008449] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008452] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008455] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008458] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008461] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008464] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008467] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008470] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008473] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008475] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008477] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008478] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008479] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008480] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008481] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008482] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008483] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008484] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008485] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008486] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008487] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008488] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008489] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008490] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008491] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008492] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008493] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008494] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008495] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008496] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008590] No NUMA configuration found [ 0.008592] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008601] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008936] Zone ranges: [ 0.008937] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008939] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008941] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008943] Device empty [ 0.008944] Movable zone start for each node [ 0.008946] Early memory node ranges [ 0.008947] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008949] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008950] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008954] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008959] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008994] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080629] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080744] ACPI: PM-Timer IO Port: 0x408 [ 0.080752] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080754] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080755] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080756] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080757] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080757] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080758] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080759] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080768] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080773] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080775] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080777] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080780] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080781] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080785] TSC deadline timer available [ 0.080787] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080797] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080799] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080800] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080801] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080802] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080803] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080804] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080805] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080806] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080807] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080808] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080809] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080811] Booting paravirtualized kernel on bare hardware [ 0.080813] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080820] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081033] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081064] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.081066] Policy zone: Normal [ 0.081067] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081126] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.083281] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084429] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084523] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171037] Memory: 32672656K/33438012K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765096K reserved, 0K cma-reserved) [ 0.171326] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171341] Kernel/User page tables isolation: enabled [ 0.171372] ftrace: allocating 50768 entries in 199 pages [ 0.191633] ftrace: allocated 199 pages with 5 groups [ 0.191760] rcu: Hierarchical RCU implementation. [ 0.191762] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191763] Rude variant of Tasks RCU enabled. [ 0.191764] Tracing variant of Tasks RCU enabled. [ 0.191764] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191766] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195215] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195414] random: crng init done [ 0.200279] Console: colour VGA+ 80x25 [ 0.211532] printk: console [tty0] enabled [ 1.198534] printk: console [ttyS1] enabled [ 1.202792] ACPI: Core revision 20210730 [ 1.206954] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.216183] APIC: Switch to symmetric I/O mode setup [ 1.221221] DMAR: Host address width 46 [ 1.225130] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.231629] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.239721] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.246058] DMAR: ATSR flags: 0x0 [ 1.249440] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.255775] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.262198] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.268620] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.274088] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.274089] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.289276] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.294650] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.300944] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.324189] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32726b93550, max_idle_ns: 440795300787 ns [ 1.334795] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.51 BogoMIPS (lpj=13999028) [ 1.338810] CPU0: Thermal monitoring enabled (TM1) [ 1.342846] process: using mwait in idle threads [ 1.346794] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.350792] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.354794] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.358793] Spectre V2 : Mitigation: Retpolines [ 1.362792] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.366792] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.370792] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.374793] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.378792] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.382793] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.386795] MDS: Mitigation: Clear CPU buffers [ 1.390792] TAA: Mitigation: Clear CPU buffers [ 1.394792] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.398797] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.402792] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.406792] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.410793] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.414792] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.436858] Freeing SMP alternatives memory: 44K [ 1.438793] pid_max: default: 32768 minimum: 301 [ 1.442813] LSM: Security Framework initializing [ 1.446800] landlock: Up and running. [ 1.450525] Yama: becoming mindful. [ 1.450809] AppArmor: AppArmor initialized [ 1.454853] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.458832] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.463151] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.466798] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.470902] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.474793] ... version: 3 [ 1.478792] ... bit width: 48 [ 1.482792] ... generic registers: 4 [ 1.486792] ... value mask: 0000ffffffffffff [ 1.490792] ... max period: 00007fffffffffff [ 1.494792] ... fixed-purpose events: 3 [ 1.498792] ... event mask: 000000070000000f [ 1.502853] signal: max sigframe size: 1776 [ 1.506807] rcu: Hierarchical SRCU implementation. [ 1.511515] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.514857] smp: Bringing up secondary CPUs ... [ 1.518874] x86: Booting SMP configuration: [ 1.522795] .... node #0, CPUs: #1 #2 #3 #4 [ 1.530964] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.538793] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.542792] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.546892] #5 #6 #7 [ 1.547439] smp: Brought up 1 node, 8 CPUs [ 1.554795] smpboot: Max logical packages: 1 [ 1.558793] smpboot: Total of 8 processors activated (55996.11 BogoMIPS) [ 1.567127] devtmpfs: initialized [ 1.570205] x86/mm: Memory block size: 128MB [ 1.572382] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.574868] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.578803] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.582839] pinctrl core: initialized pinctrl subsystem [ 1.586883] PM: RTC time: 01:58:23, date: 2024-09-17 [ 1.590898] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.595125] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.599091] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.603125] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.606802] audit: initializing netlink subsys (disabled) [ 1.610812] audit: type=2000 audit(1726538302.352:1): state=initialized audit_enabled=0 res=1 [ 1.610907] thermal_sys: Registered thermal governor 'fair_share' [ 1.614794] thermal_sys: Registered thermal governor 'bang_bang' [ 1.618793] thermal_sys: Registered thermal governor 'step_wise' [ 1.622792] thermal_sys: Registered thermal governor 'user_space' [ 1.626792] thermal_sys: Registered thermal governor 'power_allocator' [ 1.630798] EISA bus registered [ 1.638000] cpuidle: using governor ladder [ 1.638795] cpuidle: using governor menu [ 1.642808] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.646793] ACPI: bus type PCI registered [ 1.650794] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.654848] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.658794] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.662807] PCI: Using configuration type 1 for base access [ 1.667814] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.670809] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.674793] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.678866] ACPI: Added _OSI(Module Device) [ 1.682794] ACPI: Added _OSI(Processor Device) [ 1.686800] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.690792] ACPI: Added _OSI(Processor Aggregator Device) [ 1.694793] ACPI: Added _OSI(Linux-Dell-Video) [ 1.698793] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.702793] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.752055] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.758274] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.762939] ACPI: Dynamic OEM Table Load: [ 1.792560] ACPI: Interpreter enabled [ 1.794804] ACPI: PM: (supports S0 S4 S5) [ 1.798793] ACPI: Using IOAPIC for interrupt routing [ 1.802814] HEST: Enabling Firmware First mode for corrected errors. [ 1.806870] HEST: Table parsing has been initialized. [ 1.810940] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.814795] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.818792] PCI: Using E820 reservations for host bridge windows [ 1.823475] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.858104] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.858796] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.864759] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.867816] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.870793] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.874824] PCI host bridge to bus 0000:ff [ 1.878794] pci_bus 0000:ff: root bus resource [bus ff] [ 1.882803] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.886859] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.890847] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.894847] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.898846] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.902844] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.906844] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.910845] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.914848] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.918844] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.922845] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.926844] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.930845] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.934845] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.938845] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.942846] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.946847] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.950845] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.954845] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.958818] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.962855] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.966895] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.970857] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.974857] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.978859] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.982857] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.986854] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.990848] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.994847] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.998858] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.002857] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.006856] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.010859] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.014846] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.018846] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.022846] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.026848] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.030857] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.034857] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.038858] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.042861] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.046850] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.050847] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.054846] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.058849] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.062847] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.066846] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.070850] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.074851] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.078845] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.082845] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.086845] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.090818] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.094847] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.098846] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.106830] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.110795] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.115115] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.119240] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.122793] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.127080] PCI host bridge to bus 0000:00 [ 2.130795] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.134793] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.138793] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.142792] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.146792] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.150792] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.154793] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.158898] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.163002] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.166858] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.170963] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.174858] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.178956] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.182857] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.186952] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.190812] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.194987] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.198811] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.202984] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.206811] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.210984] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.214811] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.218985] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.222811] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.226988] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.230811] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.234982] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.238811] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.242984] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.246811] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.250938] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.255011] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.258941] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.262962] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.266807] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.271032] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.275083] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.278814] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.282804] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.286804] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.290804] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.294804] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.298804] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.302833] pci 0000:00:11.4: PME# supported from D3hot [ 2.306945] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.310819] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.314869] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.318940] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.322818] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.326870] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.330937] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.334818] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.338870] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.342955] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.346815] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.350897] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.354947] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.358882] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.362954] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.366884] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.370953] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.374885] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.378962] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.382815] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.386898] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.390950] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.395065] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.398812] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.402803] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.406803] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.410803] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.414803] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.418803] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.422827] pci 0000:00:1f.2: PME# supported from D3hot [ 2.426933] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.430819] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.434824] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.439003] acpiphp: Slot [1] registered [ 2.442810] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.446967] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.450813] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.454834] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.458795] pci 0000:02:00.0: enabling Extended Tags [ 2.462897] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.466794] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.470969] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.474814] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.478801] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.482815] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.486801] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.490834] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.494813] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.498792] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.502805] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.506792] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.510955] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.514814] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.518801] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.522815] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.526801] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.530833] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.534809] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.538792] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.542805] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.546792] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.550926] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.554793] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.558793] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.562794] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.566824] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.570858] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.574881] pci 0000:05:00.0: enabling Extended Tags [ 2.578870] pci 0000:05:00.0: supports D1 D2 [ 2.582793] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.586897] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.590794] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.594794] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.598840] pci_bus 0000:06: extended config space not accessible [ 2.602821] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.606825] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.610810] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.614809] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.618878] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.622834] pci 0000:06:00.0: supports D1 D2 [ 2.626792] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.630901] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.634799] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.638795] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.642891] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.646819] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.650820] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.654806] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.658927] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.662831] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.666792] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.670819] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.674792] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.678967] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.682820] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.686820] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.690806] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.694923] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.698830] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.702792] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.706818] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.710792] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.714947] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.718794] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.722794] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.726796] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.731680] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.734841] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.738838] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.742839] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.746838] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.750793] ACPI: PCI: Interrupt link LNKE disabled [ 2.754840] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.758792] ACPI: PCI: Interrupt link LNKF disabled [ 2.762838] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.766792] ACPI: PCI: Interrupt link LNKG disabled [ 2.770838] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.774792] ACPI: PCI: Interrupt link LNKH disabled [ 2.778978] iommu: Default domain type: Translated [ 2.782793] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.786917] SCSI subsystem initialized [ 2.790805] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.794792] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.794793] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.798793] vgaarb: loaded [ 2.801572] ACPI: bus type USB registered [ 2.802802] usbcore: registered new interface driver usbfs [ 2.806797] usbcore: registered new interface driver hub [ 2.810797] usbcore: registered new device driver usb [ 2.814810] pps_core: LinuxPPS API ver. 1 registered [ 2.818792] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.822795] PTP clock support registered [ 2.826807] EDAC MC: Ver: 3.0.0 [ 2.830103] NetLabel: Initializing [ 2.830793] NetLabel: domain hash size = 128 [ 2.834792] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.838803] NetLabel: unlabeled traffic allowed by default [ 2.842802] PCI: Using ACPI for IRQ routing [ 2.852033] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.854794] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.860833] clocksource: Switched to clocksource tsc-early [ 2.873006] VFS: Disk quotas dquot_6.6.0 [ 2.877005] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.884049] AppArmor: AppArmor Filesystem Enabled [ 2.888847] pnp: PnP ACPI init [ 2.892413] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.898398] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.904386] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.910377] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.916364] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.922343] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.928324] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.935000] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.941683] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.948365] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.955049] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.961730] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.968413] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.975300] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.981285] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.987272] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.993252] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.999235] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.006145] pnp: PnP ACPI: found 5 devices [ 3.015695] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.024695] NET: Registered PF_INET protocol family [ 3.029808] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.039100] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.047921] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.055917] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.064324] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.071856] TCP: Hash tables configured (established 262144 bind 65536) [ 3.078655] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.086449] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.093467] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.100922] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.106656] NET: Registered PF_XDP protocol family [ 3.111534] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.123105] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.131020] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.136064] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.141100] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.147966] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.155618] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.163617] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.171356] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.179446] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.187096] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.195098] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.202838] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.210926] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.218577] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.226578] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.234318] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.242407] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.250057] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.258059] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.265798] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.273887] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.278916] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.285076] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.291932] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.299767] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.304815] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.309841] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.316006] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.322881] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.328174] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.334334] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.341201] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.349028] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.356940] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.364769] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.372682] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.377709] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.383870] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.390725] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.406317] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.412561] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.418802] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.425738] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.432680] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.439624] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.446566] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.452900] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.458542] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.464871] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.472181] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.477817] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.484146] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.489778] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.496109] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.501749] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.508078] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.515598] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.547462] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 23996 usecs [ 3.579465] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23934 usecs [ 3.586958] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.593512] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.593518] Trying to unpack rootfs image as initramfs... [ 3.600016] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.613974] Initialise system trusted keyrings [ 3.618496] Key type blacklist registered [ 3.622613] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.630077] zbud: loaded [ 3.632881] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.638931] fuse: init (API version 7.34) [ 3.643166] integrity: Platform Keyring initialized [ 3.655710] Key type asymmetric registered [ 3.659885] Asymmetric key parser 'x509' registered [ 3.664853] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.672382] io scheduler mq-deadline registered [ 3.677550] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.683591] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.689609] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.695577] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.701555] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.707527] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.713487] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.720398] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.726200] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.734669] ACPI: button: Power Button [PWRB] [ 3.739126] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.746641] ACPI: button: Power Button [PWRF] [ 3.752411] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.759983] pstore: Registered erst as persistent store backend [ 3.766103] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.793036] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.821944] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.831523] Linux agpgart interface v0.103 [ 3.837262] loop: module loaded [ 3.840696] tun: Universal TUN/TAP device driver, 1.6 [ 3.845842] PPP generic driver version 2.4.2 [ 3.850227] VFIO - User Level meta-driver version: 0.3 [ 3.855519] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.862119] ehci-pci: EHCI PCI platform driver [ 3.866788] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.872087] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.879582] ehci-pci 0000:00:1a.0: debug port 2 [ 3.888118] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.907420] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.913278] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.921634] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.928947] usb usb1: Product: EHCI Host Controller [ 3.933897] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 3.940414] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.940979] Freeing initrd memory: 65112K [ 3.945231] hub 1-0:1.0: USB hub found [ 3.952999] hub 1-0:1.0: 2 ports detected [ 3.957319] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.962616] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.970105] ehci-pci 0000:00:1d.0: debug port 2 [ 3.978596] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.999494] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.005339] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.013686] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.020991] usb usb2: Product: EHCI Host Controller [ 4.025934] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.032438] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.037218] hub 2-0:1.0: USB hub found [ 4.041036] hub 2-0:1.0: 2 ports detected [ 4.045223] ehci-platform: EHCI generic platform driver [ 4.050533] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.056778] ohci-pci: OHCI PCI platform driver [ 4.061309] ohci-platform: OHCI generic platform driver [ 4.066601] uhci_hcd: USB Universal Host Controller Interface driver [ 4.073069] i8042: PNP: No PS/2 controller found. [ 4.077901] mousedev: PS/2 mouse device common for all mice [ 4.083612] rtc_cmos 00:00: RTC can wake from S4 [ 4.088520] rtc_cmos 00:00: registered as rtc0 [ 4.093062] rtc_cmos 00:00: setting system clock to 2024-09-17T01:58:27 UTC (1726538307) [ 4.101256] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.108030] i2c_dev: i2c /dev entries driver [ 4.112536] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.124817] device-mapper: uevent: version 1.0.3 [ 4.129566] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.138110] platform eisa.0: Probing EISA bus 0 [ 4.142704] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.149557] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.156062] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.162564] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.169074] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.175584] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.182093] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.188602] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.195112] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.201619] platform eisa.0: EISA: Detected 0 cards [ 4.206563] intel_pstate: Intel P-state driver initializing [ 4.213262] ledtrig-cpu: registered to indicate activity on CPUs [ 4.219487] drop_monitor: Initializing network drop monitor service [ 4.225929] NET: Registered PF_INET6 protocol family [ 4.238574] Segment Routing with IPv6 [ 4.242325] In-situ OAM (IOAM) with IPv6 [ 4.246344] NET: Registered PF_PACKET protocol family [ 4.251515] Key type dns_resolver registered [ 4.256330] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.262327] microcode: Microcode Update Driver: v2.2. [ 4.262405] resctrl: L3 allocation detected [ 4.271780] resctrl: L3 monitoring detected [ 4.276029] IPI shorthand broadcast: enabled [ 4.280373] sched_clock: Marking stable (3216975260, 1063383756)->(5272049975, -991690959) [ 4.288946] registered taskstats version 1 [ 4.291421] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.299858] Loading compiled-in X.509 certificates [ 4.305316] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.315779] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.326011] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.336097] blacklist: Loading compiled-in revocation X.509 certificates [ 4.342877] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.352799] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.363330] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.374210] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.379444] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.384754] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.402154] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.412945] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.423747] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.435563] zswap: loaded using pool lzo/zbud [ 4.440341] Key type .fscrypt registered [ 4.444335] Key type fscrypt-provisioning registered [ 4.449421] pstore: Using crash dump compression: deflate [ 4.455806] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.457936] Key type encrypted registered [ 4.464103] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.476055] AppArmor: AppArmor sha1 policy hashing enabled [ 4.488835] ima: No TPM chip found, activating TPM-bypass! [ 4.488930] hub 1-1:1.0: USB hub found [ 4.494393] Loading compiled-in module X.509 certificates [ 4.494860] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.513730] ima: Allocated hash algorithm: sha1 [ 4.518335] ima: No architecture policies found [ 4.522943] evm: Initialising EVM extended attributes: [ 4.522971] hub 1-1:1.0: 6 ports detected [ 4.528149] evm: security.selinux [ 4.528150] evm: security.SMACK64 [ 4.528150] evm: security.SMACK64EXEC [ 4.528151] evm: security.SMACK64TRANSMUTE [ 4.528151] evm: security.SMACK64MMAP [ 4.528151] evm: security.apparmor [ 4.528152] evm: security.ima [ 4.528152] evm: security.capability [ 4.528153] evm: HMAC attrs: 0x1 [ 4.528417] PM: Magic number: 8:840:963 [ 4.568202] pci 0000:00:04.7: hash matches [ 4.572503] memory memory14: hash matches [ 4.576771] RAS: Correctable Errors collector initialized. [ 4.582337] clk: Disabling unused clocks [ 4.586441] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.594732] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.602233] hub 2-1:1.0: USB hub found [ 4.602298] Freeing unused decrypted memory: 2036K [ 4.610998] hub 2-1:1.0: 8 ports detected [ 4.615420] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.615471] Freeing unused kernel image (initmem) memory: 3368K [ 4.621668] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.637760] clocksource: Switched to clocksource tsc [ 4.642792] Write protecting the kernel read-only data: 30720k [ 4.649102] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.656019] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 4.701248] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.707754] x86/mm: Checking user space page tables [ 4.749890] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.756396] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.899374] dca service started, version 1.12.1 [ 4.907083] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.912496] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.921097] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.930977] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.937167] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.943359] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.948657] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.951444] nvme nvme0: pci function 0000:02:00.0 [ 4.952529] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.952530] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.956140] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.956193] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.961163] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.961516] nvme nvme0: 8/0/0 default/read/poll queues [ 4.966387] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.966389] usb usb3: Product: xHCI Host Controller [ 4.966391] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 4.966392] usb usb3: SerialNumber: 0000:00:14.0 [ 4.967714] hub 3-0:1.0: USB hub found [ 4.972072] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.972268] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.978465] hub 3-0:1.0: 15 ports detected [ 4.987737] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.996773] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.000156] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.004575] igb 0000:07:00.0: added PHC on eth0 [ 5.007475] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.007477] usb usb4: Product: xHCI Host Controller [ 5.007478] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.007479] usb usb4: SerialNumber: 0000:00:14.0 [ 5.007573] hub 4-0:1.0: USB hub found [ 5.012456] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.018978] hub 4-0:1.0: 6 ports detected [ 5.019793] scsi host0: ahci [ 5.019910] scsi host1: ahci [ 5.019988] scsi host2: ahci [ 5.020067] scsi host3: ahci [ 5.020107] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 44 [ 5.020110] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 44 [ 5.020112] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 44 [ 5.020115] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 44 [ 5.020363] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.020367] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.023634] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:54 [ 5.088035] scsi host4: ahci [ 5.091967] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.096735] scsi host5: ahci [ 5.100386] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.154692] igb 0000:07:00.1: added PHC on eth1 [ 5.161624] scsi host6: ahci [ 5.169115] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.176421] scsi host7: ahci 5.179234] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:55 [ 5.184568] scsi host8: ahci [ 5.187451] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.195176] scsi host9: ahci [ 5.199624] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.202598] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.245870] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.253350] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.260846] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.268375] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.275874] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.334025] ata3: SATA link down (SStatus 0 SControl 300) [ 5.339514] ata4: SATA link down (SStatus 0 SControl 300) [ 5.343401] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.390921] ata2: SATA link down (SStatus 0 SControl 300) [ 5.396424] ata1: SATA link down (SStatus 0 SControl 300) [ 5.499690] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.508061] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.515759] hub 3-12:1.0: USB hub found [ 5.519760] hub 3-12:1.0: 4 ports detected [ 5.598378] ata8: SATA link down (SStatus 0 SControl 300) [ 5.603886] ata10: SATA link down (SStatus 0 SControl 300) [ 5.609480] ata9: SATA link down (SStatus 0 SControl 300) [ 5.614979] ata6: SATA link down (SStatus 0 SControl 300) [ 5.620487] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.626767] ata7: SATA link down (SStatus 0 SControl 300) [ 5.694204] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.701125] ata5.00: NCQ Send/Recv Log not supported [ 5.706182] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.714785] ata5.00: NCQ Send/Recv Log not supported [ 5.719847] ata5.00: configured for UDMA/133 [ 5.724421] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ Attached scsi gesd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.746080] sd 4:0:0:0: [sda] Write Protect is off [ 5.750955] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.771823] sda: sda1 [ 5.774395] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.780700] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.808337] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.839462] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.971895] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.980449] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.998972] hid: raw HID events driver (C) Jiri Kosina [ 6.007445] usbcore: registered new interface driver usbhid [ 6.013093] usbhid: USB HID core driver [ 6.019140] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.087551] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.099581] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.111517] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.135918] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.146300] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.154909] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.161158] ixgbe 0000:03:00.0: 0c:c4:7a:88:77:60 [ 6.169303] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.340169] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.350565] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.359189] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.366318] ixgbe 0000:03:00.1: 0c:c4:7a:88:77:61 [ 6.374607] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.383038] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.432701] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 199169/61054976 files, 6548080/244190336 blocks done. [ 13.947222] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.776439] systemd[1]: Inserted module 'autofs4' [ 14.869412] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.919546] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.966336] systemd[1]: Hostname set to . [ 16.374068] systemd[1]: Queued start job for default target Graphical Interface. [ 16.384163] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.408311] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.432195] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.455608] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.475653] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.499877] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.527582] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.555548] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.583540] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.611530] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.639563] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.667532] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.695640] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.719563] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.739565] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.763662] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.787787] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.814207] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.839789] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.859757] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.883656] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.907972] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.927758] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.947806] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.967905] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.991852] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 17.011734] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 17.033169] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 17.053119] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 17.076956] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 17.101171] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 17.121303] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 17.139747] RPC: Registered named UNIX socket transport module. [ 17.145745] RPC: Registered udp transport module. [ 17.150522] RPC: Registered tcp transport module. [ 17.155293] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 17.163082] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.187565] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.199084] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.225389] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.248534] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.276414] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.300486] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.320587] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.340499] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.368936] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.388616] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.412420] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.436707] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.459463] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.469289] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.488031] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.508506] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.525941] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.536411] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.557616] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.603727] lp: driver loaded but no devices found [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted [0;[ 17.626144] Loading iSCSI transport class v2.0-870. 1;39mKernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE [ 17.897842] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.977372] systemd-journald[369]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. Starting Raise network interfaces... [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started RPC Remote Quota Server. [ OK ] Finished GRUB failed boot detection. [ OK ] Started System Logging Service. [ OK ] Started User Login Management. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. Starting containerd container runtime... Starting Network Time Service... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started Network Time Service. [ OK ] Started (i)SCSI target daemon. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Reached target Network is Online. Starting NFS Mount Daemon... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... Starting NFS status monitor for NFSv2/3 locking.... Starting Ubuntu FAN network setup... [ OK ] Started NFS Mount Daemon. + '[' '!' -f /.cephlab_net_configured ']' [ OK ] Started containerd container runtime. + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. Starting Docker Application Container Engine... + myips=172.21.15.154 + attempts=1 + sleep 1 [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started The Apache HTTP Server. + '[' 172.21.15.154 '!=' '' ']' + set -e + '[' -n 172.21.15.154 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.154 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.154 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi154.front.sepia.ceph.com + '[' -n smithi154.front.sepia.ceph.com ']' + hostname smithi154.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi154 + echo smithi154 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.154 smithi154.front.sepia.ceph.com smithi154/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi154.front.sepia.ceph.com ttyS1 2024-09-17T01:58:57.112 DEBUG:teuthology.orchestra.console.smithi154:expect after: smithi154 login: 2024-09-17T01:58:57.166 DEBUG:teuthology.orchestra.console.smithi154:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializiel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 77 61 GUID: 00000000 0000 0000 0000 0CC47AD91A54 DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.154 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:77:61)... Configuring (net0 0c:c4:7a:88:77:61).... Configuring (net0 0c:c4:7a:88:77:61)..... Configuring (net0 0c:c4:7a:88:77:61)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-122-generic ... Loading initial ramdisk ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-122-generic (buildd@lcy02-amd64-034) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 (Ubuntu 5.15.0-122.132-generic 5.15.163) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.757 MHz processor [ 0.000412] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000594] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001894] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.008281] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.008297] Using GB pages for direct mapping [ 0.008395] RAMDISK: [mem 0x300c3000-0x34058fff] [ 0.008400] ACPI: Early table checksum verification disabled [ 0.008403] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.008407] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.008412] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008417] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008420] ACPI: FACS 0x0000000079D43F80 000040 [ 0.008423] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008426] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008429] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008432] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008435] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008438] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008440] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008443] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008446] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008449] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008452] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008455] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008458] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008461] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008464] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008467] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008470] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008473] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008475] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.008477] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.008478] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.008479] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.008480] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.008481] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.008482] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.008483] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.008484] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.008485] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.008486] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.008487] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.008488] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.008489] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.008490] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.008491] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.008492] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.008493] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.008494] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.008495] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.008496] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.008590] No NUMA configuration found [ 0.008592] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008601] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008936] Zone ranges: [ 0.008937] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008939] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008941] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008943] Device empty [ 0.008944] Movable zone start for each node [ 0.008946] Early memory node ranges [ 0.008947] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008949] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008950] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008954] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008959] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.008994] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.080629] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.080744] ACPI: PM-Timer IO Port: 0x408 [ 0.080752] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.080754] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.080755] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.080756] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.080757] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.080757] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.080758] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.080759] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.080768] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.080773] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.080775] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.080777] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.080780] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.080781] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.080785] TSC deadline timer available [ 0.080787] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.080797] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.080799] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.080800] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.080801] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.080802] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.080803] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.080804] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.080805] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.080806] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.080807] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.080808] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.080809] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.080811] Booting paravirtualized kernel on bare hardware [ 0.080813] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.080820] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.081033] percpu: Embedded 62 pages/cpu s217088 r8192 d28672 u262144 [ 0.081064] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.081066] Policy zone: Normal [ 0.081067] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.081126] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-122-generic", will be passed to user space. [ 0.083281] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.084429] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.084523] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.171037] Memory: 32672656K/33438012K available (16392K kernel code, 4397K rwdata, 10964K rodata, 3368K init, 18700K bss, 765096K reserved, 0K cma-reserved) [ 0.171326] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.171341] Kernel/User page tables isolation: enabled [ 0.171372] ftrace: allocating 50768 entries in 199 pages [ 0.191633] ftrace: allocated 199 pages with 5 groups [ 0.191760] rcu: Hierarchical RCU implementation. [ 0.191762] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.191763] Rude variant of Tasks RCU enabled. [ 0.191764] Tracing variant of Tasks RCU enabled. [ 0.191764] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.191766] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.195215] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.195414] random: crng init done [ 0.200279] Console: colour VGA+ 80x25 [ 0.211532] printk: console [tty0] enabled [ 1.198534] printk: console [ttyS1] enabled [ 1.202792] ACPI: Core revision 20210730 [ 1.206954] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.216183] APIC: Switch to symmetric I/O mode setup [ 1.221221] DMAR: Host address width 46 [ 1.225130] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.231629] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.239721] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.246058] DMAR: ATSR flags: 0x0 [ 1.249440] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.255775] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.262198] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.268620] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.274088] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.274089] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.289276] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.294650] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.300944] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.324189] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32726b93550, max_idle_ns: 440795300787 ns [ 1.334795] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.51 BogoMIPS (lpj=13999028) [ 1.338810] CPU0: Thermal monitoring enabled (TM1) [ 1.342846] process: using mwait in idle threads [ 1.346794] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.350792] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.354794] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.358793] Spectre V2 : Mitigation: Retpolines [ 1.362792] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.366792] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.370792] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.374793] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.378792] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.382793] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.386795] MDS: Mitigation: Clear CPU buffers [ 1.390792] TAA: Mitigation: Clear CPU buffers [ 1.394792] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.398797] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.402792] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.406792] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.410793] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.414792] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.436858] Freeing SMP alternatives memory: 44K [ 1.438793] pid_max: default: 32768 minimum: 301 [ 1.442813] LSM: Security Framework initializing [ 1.446800] landlock: Up and running. [ 1.450525] Yama: becoming mindful. [ 1.450809] AppArmor: AppArmor initialized [ 1.454853] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.458832] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.463151] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.466798] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.470902] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.474793] ... version: 3 [ 1.478792] ... bit width: 48 [ 1.482792] ... generic registers: 4 [ 1.486792] ... value mask: 0000ffffffffffff [ 1.490792] ... max period: 00007fffffffffff [ 1.494792] ... fixed-purpose events: 3 [ 1.498792] ... event mask: 000000070000000f [ 1.502853] signal: max sigframe size: 1776 [ 1.506807] rcu: Hierarchical SRCU implementation. [ 1.511515] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.514857] smp: Bringing up secondary CPUs ... [ 1.518874] x86: Booting SMP configuration: [ 1.522795] .... node #0, CPUs: #1 #2 #3 #4 [ 1.530964] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.538793] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.542792] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.546892] #5 #6 #7 [ 1.547439] smp: Brought up 1 node, 8 CPUs [ 1.554795] smpboot: Max logical packages: 1 [ 1.558793] smpboot: Total of 8 processors activated (55996.11 BogoMIPS) [ 1.567127] devtmpfs: initialized [ 1.570205] x86/mm: Memory block size: 128MB [ 1.572382] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.574868] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.578803] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.582839] pinctrl core: initialized pinctrl subsystem [ 1.586883] PM: RTC time: 01:58:23, date: 2024-09-17 [ 1.590898] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.595125] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.599091] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.603125] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.606802] audit: initializing netlink subsys (disabled) [ 1.610812] audit: type=2000 audit(1726538302.352:1): state=initialized audit_enabled=0 res=1 [ 1.610907] thermal_sys: Registered thermal governor 'fair_share' [ 1.614794] thermal_sys: Registered thermal governor 'bang_bang' [ 1.618793] thermal_sys: Registered thermal governor 'step_wise' [ 1.622792] thermal_sys: Registered thermal governor 'user_space' [ 1.626792] thermal_sys: Registered thermal governor 'power_allocator' [ 1.630798] EISA bus registered [ 1.638000] cpuidle: using governor ladder [ 1.638795] cpuidle: using governor menu [ 1.642808] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.646793] ACPI: bus type PCI registered [ 1.650794] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.654848] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.658794] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.662807] PCI: Using configuration type 1 for base access [ 1.667814] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.670809] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.674793] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.678866] ACPI: Added _OSI(Module Device) [ 1.682794] ACPI: Added _OSI(Processor Device) [ 1.686800] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.690792] ACPI: Added _OSI(Processor Aggregator Device) [ 1.694793] ACPI: Added _OSI(Linux-Dell-Video) [ 1.698793] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.702793] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.752055] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.758274] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.762939] ACPI: Dynamic OEM Table Load: [ 1.792560] ACPI: Interpreter enabled [ 1.794804] ACPI: PM: (supports S0 S4 S5) [ 1.798793] ACPI: Using IOAPIC for interrupt routing [ 1.802814] HEST: Enabling Firmware First mode for corrected errors. [ 1.806870] HEST: Table parsing has been initialized. [ 1.810940] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.814795] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.818792] PCI: Using E820 reservations for host bridge windows [ 1.823475] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.858104] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.858796] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.864759] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.867816] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.870793] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.874824] PCI host bridge to bus 0000:ff [ 1.878794] pci_bus 0000:ff: root bus resource [bus ff] [ 1.882803] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.886859] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.890847] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.894847] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.898846] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.902844] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.906844] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.910845] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.914848] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.918844] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.922845] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.926844] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.930845] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.934845] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.938845] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.942846] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.946847] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.950845] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.954845] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.958818] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.962855] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.966895] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.970857] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.974857] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.978859] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.982857] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.986854] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.990848] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.994847] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.998858] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 2.002857] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 2.006856] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.010859] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.014846] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.018846] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.022846] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.026848] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.030857] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.034857] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.038858] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.042861] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.046850] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.050847] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.054846] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.058849] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.062847] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.066846] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.070850] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.074851] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.078845] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.082845] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.086845] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.090818] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.094847] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.098846] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.106830] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.110795] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.115115] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.119240] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.122793] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.127080] PCI host bridge to bus 0000:00 [ 2.130795] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.134793] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.138793] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.142792] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.146792] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.150792] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.154793] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.158898] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.163002] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.166858] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.170963] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.174858] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.178956] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.182857] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.186952] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.190812] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.194987] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.198811] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.202984] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.206811] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.210984] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.214811] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.218985] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.222811] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.226988] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.230811] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.234982] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.238811] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.242984] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.246811] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.250938] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.255011] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.258941] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.262962] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.266807] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.271032] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.275083] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.278814] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.282804] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.286804] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.290804] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.294804] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.298804] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.302833] pci 0000:00:11.4: PME# supported from D3hot [ 2.306945] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.310819] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.314869] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.318940] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.322818] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.326870] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.330937] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.334818] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.338870] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.342955] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.346815] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.350897] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.354947] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.358882] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.362954] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.366884] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.370953] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.374885] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.378962] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.382815] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.386898] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.390950] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.395065] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.398812] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.402803] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.406803] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.410803] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.414803] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.418803] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.422827] pci 0000:00:1f.2: PME# supported from D3hot [ 2.426933] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.430819] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.434824] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.439003] acpiphp: Slot [1] registered [ 2.442810] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.446967] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.450813] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.454834] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.458795] pci 0000:02:00.0: enabling Extended Tags [ 2.462897] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.466794] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.470969] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.474814] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.478801] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.482815] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.486801] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.490834] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.494813] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.498792] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.502805] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.506792] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.510955] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.514814] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.518801] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.522815] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.526801] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.530833] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.534809] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.538792] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.542805] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.546792] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.550926] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.554793] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.558793] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.562794] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.566824] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.570858] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.574881] pci 0000:05:00.0: enabling Extended Tags [ 2.578870] pci 0000:05:00.0: supports D1 D2 [ 2.582793] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.586897] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.590794] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.594794] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.598840] pci_bus 0000:06: extended config space not accessible [ 2.602821] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.606825] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.610810] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.614809] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.618878] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.622834] pci 0000:06:00.0: supports D1 D2 [ 2.626792] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.630901] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.634799] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.638795] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.642891] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.646819] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.650820] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.654806] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.658927] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.662831] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.666792] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.670819] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.674792] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.678967] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.682820] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.686820] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.690806] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.694923] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.698830] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.702792] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.706818] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.710792] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.714947] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.718794] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.722794] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.726796] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.731680] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.734841] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.738838] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.742839] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.746838] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.750793] ACPI: PCI: Interrupt link LNKE disabled [ 2.754840] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.758792] ACPI: PCI: Interrupt link LNKF disabled [ 2.762838] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.766792] ACPI: PCI: Interrupt link LNKG disabled [ 2.770838] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.774792] ACPI: PCI: Interrupt link LNKH disabled [ 2.778978] iommu: Default domain type: Translated [ 2.782793] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.786917] SCSI subsystem initialized [ 2.790805] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.794792] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.794793] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.798793] vgaarb: loaded [ 2.801572] ACPI: bus type USB registered [ 2.802802] usbcore: registered new interface driver usbfs [ 2.806797] usbcore: registered new interface driver hub [ 2.810797] usbcore: registered new device driver usb [ 2.814810] pps_core: LinuxPPS API ver. 1 registered [ 2.818792] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.822795] PTP clock support registered [ 2.826807] EDAC MC: Ver: 3.0.0 [ 2.830103] NetLabel: Initializing [ 2.830793] NetLabel: domain hash size = 128 [ 2.834792] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.838803] NetLabel: unlabeled traffic allowed by default [ 2.842802] PCI: Using ACPI for IRQ routing [ 2.852033] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.854794] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.860833] clocksource: Switched to clocksource tsc-early [ 2.873006] VFS: Disk quotas dquot_6.6.0 [ 2.877005] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.884049] AppArmor: AppArmor Filesystem Enabled [ 2.888847] pnp: PnP ACPI init [ 2.892413] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.898398] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.904386] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.910377] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.916364] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.922343] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.928324] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.935000] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.941683] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.948365] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.955049] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.961730] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.968413] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.975300] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.981285] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.987272] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.993252] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.999235] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.006145] pnp: PnP ACPI: found 5 devices [ 3.015695] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.024695] NET: Registered PF_INET protocol family [ 3.029808] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.039100] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.047921] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.055917] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.064324] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.071856] TCP: Hash tables configured (established 262144 bind 65536) [ 3.078655] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.086449] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.093467] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.100922] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.106656] NET: Registered PF_XDP protocol family [ 3.111534] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.123105] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.131020] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.136064] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.141100] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.147966] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.155618] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.163617] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.171356] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.179446] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.187096] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.195098] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.202838] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.210926] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.218577] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.226578] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.234318] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.242407] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.250057] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.258059] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.265798] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.273887] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.278916] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.285076] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.291932] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.299767] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.304815] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.309841] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.316006] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.322881] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.328174] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.334334] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.341201] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.349028] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.356940] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.364769] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.372682] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.377709] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.383870] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.390725] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.406317] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.412561] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.418802] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.425738] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.432680] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.439624] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.446566] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.452900] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.458542] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.464871] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.472181] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.477817] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.484146] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.489778] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.496109] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.501749] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.508078] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.515598] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.547462] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 23996 usecs [ 3.579465] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23934 usecs [ 3.586958] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.593512] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.593518] Trying to unpack rootfs image as initramfs... [ 3.600016] software IO TLB: mapped [mem 0x0000000074ec6000-0x0000000078ec6000] (64MB) [ 3.613974] Initialise system trusted keyrings [ 3.618496] Key type blacklist registered [ 3.622613] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.630077] zbud: loaded [ 3.632881] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.638931] fuse: init (API version 7.34) [ 3.643166] integrity: Platform Keyring initialized [ 3.655710] Key type asymmetric registered [ 3.659885] Asymmetric key parser 'x509' registered [ 3.664853] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.672382] io scheduler mq-deadline registered [ 3.677550] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.683591] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.689609] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.695577] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.701555] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.707527] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.713487] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.720398] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.726200] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.734669] ACPI: button: Power Button [PWRB] [ 3.739126] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.746641] ACPI: button: Power Button [PWRF] [ 3.752411] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.759983] pstore: Registered erst as persistent store backend [ 3.766103] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.793036] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.821944] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.831523] Linux agpgart interface v0.103 [ 3.837262] loop: module loaded [ 3.840696] tun: Universal TUN/TAP device driver, 1.6 [ 3.845842] PPP generic driver version 2.4.2 [ 3.850227] VFIO - User Level meta-driver version: 0.3 [ 3.855519] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.862119] ehci-pci: EHCI PCI platform driver [ 3.866788] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.872087] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.879582] ehci-pci 0000:00:1a.0: debug port 2 [ 3.888118] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.907420] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.913278] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.921634] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.928947] usb usb1: Product: EHCI Host Controller [ 3.933897] usb usb1: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 3.940414] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.940979] Freeing initrd memory: 65112K [ 3.945231] hub 1-0:1.0: USB hub found [ 3.952999] hub 1-0:1.0: 2 ports detected [ 3.957319] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.962616] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.970105] ehci-pci 0000:00:1d.0: debug port 2 [ 3.978596] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.999494] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.005339] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.013686] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.020991] usb usb2: Product: EHCI Host Controller [ 4.025934] usb usb2: Manufacturer: Linux 5.15.0-122-generic ehci_hcd [ 4.032438] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.037218] hub 2-0:1.0: USB hub found [ 4.041036] hub 2-0:1.0: 2 ports detected [ 4.045223] ehci-platform: EHCI generic platform driver [ 4.050533] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.056778] ohci-pci: OHCI PCI platform driver [ 4.061309] ohci-platform: OHCI generic platform driver [ 4.066601] uhci_hcd: USB Universal Host Controller Interface driver [ 4.073069] i8042: PNP: No PS/2 controller found. [ 4.077901] mousedev: PS/2 mouse device common for all mice [ 4.083612] rtc_cmos 00:00: RTC can wake from S4 [ 4.088520] rtc_cmos 00:00: registered as rtc0 [ 4.093062] rtc_cmos 00:00: setting system clock to 2024-09-17T01:58:27 UTC (1726538307) [ 4.101256] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.108030] i2c_dev: i2c /dev entries driver [ 4.112536] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.124817] device-mapper: uevent: version 1.0.3 [ 4.129566] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.138110] platform eisa.0: Probing EISA bus 0 [ 4.142704] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.149557] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.156062] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.162564] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.169074] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.175584] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.182093] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.188602] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.195112] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.201619] platform eisa.0: EISA: Detected 0 cards [ 4.206563] intel_pstate: Intel P-state driver initializing [ 4.213262] ledtrig-cpu: registered to indicate activity on CPUs [ 4.219487] drop_monitor: Initializing network drop monitor service [ 4.225929] NET: Registered PF_INET6 protocol family [ 4.238574] Segment Routing with IPv6 [ 4.242325] In-situ OAM (IOAM) with IPv6 [ 4.246344] NET: Registered PF_PACKET protocol family [ 4.251515] Key type dns_resolver registered [ 4.256330] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.262327] microcode: Microcode Update Driver: v2.2. [ 4.262405] resctrl: L3 allocation detected [ 4.271780] resctrl: L3 monitoring detected [ 4.276029] IPI shorthand broadcast: enabled [ 4.280373] sched_clock: Marking stable (3216975260, 1063383756)->(5272049975, -991690959) [ 4.288946] registered taskstats version 1 [ 4.291421] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.299858] Loading compiled-in X.509 certificates [ 4.305316] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.315779] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.326011] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.336097] blacklist: Loading compiled-in revocation X.509 certificates [ 4.342877] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.352799] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.363330] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.374210] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.379444] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.384754] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.402154] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.412945] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.423747] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.435563] zswap: loaded using pool lzo/zbud [ 4.440341] Key type .fscrypt registered [ 4.444335] Key type fscrypt-provisioning registered [ 4.449421] pstore: Using crash dump compression: deflate [ 4.455806] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.457936] Key type encrypted registered [ 4.464103] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.476055] AppArmor: AppArmor sha1 policy hashing enabled [ 4.488835] ima: No TPM chip found, activating TPM-bypass! [ 4.488930] hub 1-1:1.0: USB hub found [ 4.494393] Loading compiled-in module X.509 certificates [ 4.494860] Loaded X.509 cert 'Build time autogenerated kernel key: cf341c0246f305ce65bb84b8240a4185ace92bf9' [ 4.513730] ima: Allocated hash algorithm: sha1 [ 4.518335] ima: No architecture policies found [ 4.522943] evm: Initialising EVM extended attributes: [ 4.522971] hub 1-1:1.0: 6 ports detected [ 4.528149] evm: security.selinux [ 4.528150] evm: security.SMACK64 [ 4.528150] evm: security.SMACK64EXEC [ 4.528151] evm: security.SMACK64TRANSMUTE [ 4.528151] evm: security.SMACK64MMAP [ 4.528151] evm: security.apparmor [ 4.528152] evm: security.ima [ 4.528152] evm: security.capability [ 4.528153] evm: HMAC attrs: 0x1 [ 4.528417] PM: Magic number: 8:840:963 [ 4.568202] pci 0000:00:04.7: hash matches [ 4.572503] memory memory14: hash matches [ 4.576771] RAS: Correctable Errors collector initialized. [ 4.582337] clk: Disabling unused clocks [ 4.586441] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.594732] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.602233] hub 2-1:1.0: USB hub found [ 4.602298] Freeing unused decrypted memory: 2036K [ 4.610998] hub 2-1:1.0: 8 ports detected [ 4.615420] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.615471] Freeing unused kernel image (initmem) memory: 3368K [ 4.621668] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.637760] clocksource: Switched to clocksource tsc [ 4.642792] Write protecting the kernel read-only data: 30720k [ 4.649102] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.656019] Freeing unused kernel image (rodata/data gap) memory: 1324K [ 4.701248] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.707754] x86/mm: Checking user space page tables [ 4.749890] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.756396] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.899374] dca service started, version 1.12.1 [ 4.907083] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.912496] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.921097] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.930977] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.937167] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.943359] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.948657] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.951444] nvme nvme0: pci function 0000:02:00.0 [ 4.952529] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.952530] igb: Copyright (c) 2007-2014 Intel Corporation. [ 4.956140] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.956193] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.961163] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.961516] nvme nvme0: 8/0/0 default/read/poll queues [ 4.966387] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.966389] usb usb3: Product: xHCI Host Controller [ 4.966391] usb usb3: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 4.966392] usb usb3: SerialNumber: 0000:00:14.0 [ 4.967714] hub 3-0:1.0: USB hub found [ 4.972072] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.972268] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 4.978465] hub 3-0:1.0: 15 ports detected [ 4.987737] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 4.996773] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.000156] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.004575] igb 0000:07:00.0: added PHC on eth0 [ 5.007475] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.007477] usb usb4: Product: xHCI Host Controller [ 5.007478] usb usb4: Manufacturer: Linux 5.15.0-122-generic xhci-hcd [ 5.007479] usb usb4: SerialNumber: 0000:00:14.0 [ 5.007573] hub 4-0:1.0: USB hub found [ 5.012456] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.018978] hub 4-0:1.0: 6 ports detected [ 5.019793] scsi host0: ahci [ 5.019910] scsi host1: ahci [ 5.019988] scsi host2: ahci [ 5.020067] scsi host3: ahci [ 5.020107] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 44 [ 5.020110] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 44 [ 5.020112] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 44 [ 5.020115] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 44 [ 5.020363] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.020367] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.023634] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:54 [ 5.088035] scsi host4: ahci [ 5.091967] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.096735] scsi host5: ahci [ 5.100386] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.154692] igb 0000:07:00.1: added PHC on eth1 [ 5.161624] scsi host6: ahci [ 5.169115] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.176421] scsi host7: ahci 5.179234] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:1a:55 [ 5.184568] scsi host8: ahci [ 5.187451] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.195176] scsi host9: ahci [ 5.199624] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.202598] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 5.245870] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 5.253350] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 5.260846] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 5.268375] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 5.275874] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 5.334025] ata3: SATA link down (SStatus 0 SControl 300) [ 5.339514] ata4: SATA link down (SStatus 0 SControl 300) [ 5.343401] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.390921] ata2: SATA link down (SStatus 0 SControl 300) [ 5.396424] ata1: SATA link down (SStatus 0 SControl 300) [ 5.499690] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.508061] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.515759] hub 3-12:1.0: USB hub found [ 5.519760] hub 3-12:1.0: 4 ports detected [ 5.598378] ata8: SATA link down (SStatus 0 SControl 300) [ 5.603886] ata10: SATA link down (SStatus 0 SControl 300) [ 5.609480] ata9: SATA link down (SStatus 0 SControl 300) [ 5.614979] ata6: SATA link down (SStatus 0 SControl 300) [ 5.620487] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.626767] ata7: SATA link down (SStatus 0 SControl 300) [ 5.694204] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.701125] ata5.00: NCQ Send/Recv Log not supported [ 5.706182] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.714785] ata5.00: NCQ Send/Recv Log not supported [ 5.719847] ata5.00: configured for UDMA/133 [ 5.724421] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ Attached scsi gesd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.746080] sd 4:0:0:0: [sda] Write Protect is off [ 5.750955] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.771823] sda: sda1 [ 5.774395] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.780700] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.808337] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.839462] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.971895] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.980449] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.998972] hid: raw HID events driver (C) Jiri Kosina [ 6.007445] usbcore: registered new interface driver usbhid [ 6.013093] usbhid: USB HID core driver [ 6.019140] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.087551] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.099581] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.111517] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.135918] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.146300] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.154909] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.161158] ixgbe 0000:03:00.0: 0c:c4:7a:88:77:60 [ 6.169303] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.340169] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.350565] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.359189] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.366318] ixgbe 0000:03:00.1: 0c:c4:7a:88:77:61 [ 6.374607] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.383038] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.432701] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 199169/61054976 files, 6548080/244190336 blocks done. [ 13.947222] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.776439] systemd[1]: Inserted module 'autofs4' [ 14.869412] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.919546] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.966336] systemd[1]: Hostname set to . [ 16.374068] systemd[1]: Queued start job for default target Graphical Interface. [ 16.384163] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.408311] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.432195] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.455608] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.475653] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.499877] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.527582] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.555548] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.583540] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.611530] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.639563] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.667532] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.695640] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.719563] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.739565] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.763662] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.787787] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.814207] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.839789] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.859757] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.883656] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.907972] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.927758] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.947806] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.967905] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.991852] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 17.011734] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 17.033169] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 17.053119] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 17.076956] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 17.101171] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 17.121303] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 17.139747] RPC: Registered named UNIX socket transport module. [ 17.145745] RPC: Registered udp transport module. [ 17.150522] RPC: Registered tcp transport module. [ 17.155293] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 17.163082] systemd[1]: Starting Journal Service... Starting Journal Service... [ 17.187565] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 17.199084] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.225389] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.248534] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.276414] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.300486] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.320587] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.340499] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.368936] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.388616] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.412420] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.436707] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.459463] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.469289] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.488031] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.508506] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.525941] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. [ 17.536411] systemd[1]: Starting Coldplug All udev Devices... Starting Coldplug All udev Devices... [ 17.557616] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ 17.603727] lp: driver loaded but no devices found [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted [0;[ 17.626144] Loading iSCSI transport class v2.0-870. 1;39mKernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE [ 17.897842] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Control File System... Mounting Kernel Configuration File System... Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.977372] systemd-journald[369]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Configuration. [ OK ] Started RPC bind portmap service. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. Starting Raise network interfaces... [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Started RPC Remote Quota Server. [ OK ] Finished GRUB failed boot detection. [ OK ] Started System Logging Service. [ OK ] Started User Login Management. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. Starting containerd container runtime... Starting Network Time Service... Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started Network Time Service. [ OK ] Started (i)SCSI target daemon. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. [ OK ] Reached target Network is Online. Starting NFS Mount Daemon... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... Starting NFS status monitor for NFSv2/3 locking.... Starting Ubuntu FAN network setup... [ OK ] Started NFS Mount Daemon. + '[' '!' -f /.cephlab_net_configured ']' [ OK ] Started containerd container runtime. + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. Starting Docker Application Container Engine... + myips=172.21.15.154 + attempts=1 + sleep 1 [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started The Apache HTTP Server. + '[' 172.21.15.154 '!=' '' ']' + set -e + '[' -n 172.21.15.154 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.154 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.154 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi154.front.sepia.ceph.com + '[' -n smithi154.front.sepia.ceph.com ']' + hostname smithi154.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi154 + echo smithi154 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.154 smithi154.front.sepia.ceph.com smithi154/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi154.front.sepia.ceph.com ttyS1 smithi154 login: [disconnect] 2024-09-17T01:58:57.268 INFO:teuthology.misc:Re-opening connections... 2024-09-17T01:58:57.268 INFO:teuthology.misc:trying to connect to ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:58:57.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:58:57.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:58:57.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~157s 2024-09-17T01:58:57.458 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-17T01:58:57.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-17T01:58:57.938 DEBUG:teuthology.misc:waited 0.669426679611206 2024-09-17T01:58:58.939 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T01:58:58.939 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi154.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-09-17T01:58:58.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-17T01:58:59.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:58:59.054 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T01:58:59.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T01:58:59.099 INFO:tasks.ceph.osd.2:Started 2024-09-17T01:58:59.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:58:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-17T01:58:59.233 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:58:59.233 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T01:59:00.872 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:59:01.396+0000 7f34dcdf67c0 -1 Falling back to public interface 2024-09-17T01:59:03.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-17T01:59:04.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:59:04.357 INFO:teuthology.orchestra.run.smithi154.stderr:no valid command found; 10 closest matches: 2024-09-17T01:59:04.357 INFO:teuthology.orchestra.run.smithi154.stderr:0 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:1 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:2 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:abort 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:assert 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:bluefs debug_inject_read_zeros 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:bluefs files list 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:bluefs stats 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:bluestore allocator dump block 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:bluestore allocator fragmentation block 2024-09-17T01:59:04.358 INFO:teuthology.orchestra.run.smithi154.stderr:admin_socket: invalid command 2024-09-17T01:59:04.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:59:04.361 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T01:59:05.664 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:59:06.188+0000 7f34dcdf67c0 -1 osd.2 51 log_to_monitors true 2024-09-17T01:59:06.280 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-09-17T01:59:06.804+0000 7f34d0bd4640 -1 osd.2 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:59:09.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T01:59:09.492 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-17T01:59:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-17T01:59:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-17T01:59:09.493 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-17T01:59:14.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-17T01:59:14.660 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a: {} 2024-09-17T01:59:14.660 INFO:teuthology.orchestra.run.smithi063.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T01:59:14.669 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b: {} 2024-09-17T01:59:14.669 INFO:teuthology.orchestra.run.smithi063.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T01:59:14.679 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c: {} 2024-09-17T01:59:14.679 INFO:teuthology.orchestra.run.smithi063.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T01:59:14.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T01:59:15.827 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T01:59:15.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T01:59:16.800 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T01:59:16.829 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T01:59:17.810 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T01:59:17.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-17T01:59:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-17T01:59:18.837 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T01:59:19.816 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T01:59:19.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T01:59:20.811 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T01:59:20.835 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-17T01:59:20.836 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-17T01:59:20.836 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-17T01:59:20.836 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-17T01:59:20.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T01:59:20.836 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:59:21.136 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:21.136 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":85,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:59:20.813441+0000","last_up_change":"2024-09-17T01:59:07.188980+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":51,"up_from":71,"up_thru":84,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6801","nonce":3415443736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6803","nonce":3415443736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6807","nonce":3415443736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6805","nonce":3415443736}]},"public_addr":"172.21.15.154:6801/3415443736","cluster_addr":"172.21.15.154:6803/3415443736","heartbeat_back_addr":"172.21.15.154:6807/3415443736","heartbeat_front_addr":"172.21.15.154:6805/3415443736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":51}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[0]},{"pgid":"4.2","osds":[1]},{"pgid":"4.5","osds":[1]},{"pgid":"4.8","osds":[1]},{"pgid":"4.a","osds":[0]},{"pgid":"4.c","osds":[0]},{"pgid":"4.d","osds":[1]},{"pgid":"4.11","osds":[0]},{"pgid":"4.16","osds":[0]},{"pgid":"4.17","osds":[0]},{"pgid":"4.18","osds":[0]},{"pgid":"4.1a","osds":[0]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.20","osds":[0]},{"pgid":"4.22","osds":[1]},{"pgid":"4.24","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.2b","osds":[0]},{"pgid":"4.30","osds":[0]},{"pgid":"4.32","osds":[1]},{"pgid":"4.38","osds":[0]},{"pgid":"4.3a","osds":[0]},{"pgid":"4.3c","osds":[0]},{"pgid":"4.3d","osds":[1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:59:21.156 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T01:59:21.156 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:59:21.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:21.447 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":85,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:59:20.813441+0000","last_up_change":"2024-09-17T01:59:07.188980+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":51,"up_from":71,"up_thru":84,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6801","nonce":3415443736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6803","nonce":3415443736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6807","nonce":3415443736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6805","nonce":3415443736}]},"public_addr":"172.21.15.154:6801/3415443736","cluster_addr":"172.21.15.154:6803/3415443736","heartbeat_back_addr":"172.21.15.154:6807/3415443736","heartbeat_front_addr":"172.21.15.154:6805/3415443736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":51}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[0]},{"pgid":"4.2","osds":[1]},{"pgid":"4.5","osds":[1]},{"pgid":"4.8","osds":[1]},{"pgid":"4.a","osds":[0]},{"pgid":"4.c","osds":[0]},{"pgid":"4.d","osds":[1]},{"pgid":"4.11","osds":[0]},{"pgid":"4.16","osds":[0]},{"pgid":"4.17","osds":[0]},{"pgid":"4.18","osds":[0]},{"pgid":"4.1a","osds":[0]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.20","osds":[0]},{"pgid":"4.22","osds":[1]},{"pgid":"4.24","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.2b","osds":[0]},{"pgid":"4.30","osds":[0]},{"pgid":"4.32","osds":[1]},{"pgid":"4.38","osds":[0]},{"pgid":"4.3a","osds":[0]},{"pgid":"4.3c","osds":[0]},{"pgid":"4.3d","osds":[1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:59:21.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T01:59:21.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T01:59:21.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T01:59:21.634 INFO:teuthology.orchestra.run.smithi063.stdout:34359738428 2024-09-17T01:59:21.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T01:59:21.636 INFO:teuthology.orchestra.run.smithi063.stdout:304942678021 2024-09-17T01:59:21.636 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T01:59:21.637 INFO:teuthology.orchestra.run.smithi063.stdout:34359738429 2024-09-17T01:59:21.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T01:59:21.922 INFO:teuthology.orchestra.run.smithi063.stdout:34359738427 2024-09-17T01:59:21.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738428 got 34359738427 for osd.0 2024-09-17T01:59:21.974 INFO:teuthology.orchestra.run.smithi063.stdout:34359738428 2024-09-17T01:59:21.977 INFO:teuthology.orchestra.run.smithi063.stdout:304942678019 2024-09-17T01:59:21.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.1 2024-09-17T01:59:21.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678021 got 304942678019 for osd.2 2024-09-17T01:59:22.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T01:59:22.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T01:59:22.996 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T01:59:23.296 INFO:teuthology.orchestra.run.smithi063.stdout:304942678021 2024-09-17T01:59:23.301 INFO:teuthology.orchestra.run.smithi063.stdout:34359738428 2024-09-17T01:59:23.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678021 got 304942678021 for osd.2 2024-09-17T01:59:23.317 DEBUG:teuthology.parallel:result is None 2024-09-17T01:59:23.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738428 got 34359738428 for osd.0 2024-09-17T01:59:23.321 DEBUG:teuthology.parallel:result is None 2024-09-17T01:59:23.324 INFO:teuthology.orchestra.run.smithi063.stdout:34359738429 2024-09-17T01:59:23.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.1 2024-09-17T01:59:23.341 DEBUG:teuthology.parallel:result is None 2024-09-17T01:59:23.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T01:59:23.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:23.692 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:23.695 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:23.710 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-17T01:59:22.830911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2999,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":259552,"kb_used_data":79516,"kb_used_omap":177,"kb_used_meta":179790,"kb_avail":282855968,"statfs":{"total":289910292480,"available":289644511232,"internally_reserved":0,"allocated":81424384,"data_stored":279941248,"data_compressed":21759347,"data_compressed_allocated":34959360,"data_compressed_original":243089408,"omap_allocated":182244,"internal_metadata":184104988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1233,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1499,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018298"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":639,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826848+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:21.826848+0000","last_peered":"2024-09-17T01:59:21.826848+0000","last_clean":"2024-09-17T01:59:21.826848+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:21.826848+0000","last_undegraded":"2024-09-17T01:59:21.826848+0000","last_fullsized":"2024-09-17T01:59:21.826848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":632,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826012+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:21.826012+0000","last_peered":"2024-09-17T01:59:21.826012+0000","last_clean":"2024-09-17T01:59:21.826012+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:21.826012+0000","last_undegraded":"2024-09-17T01:59:21.826012+0000","last_fullsized":"2024-09-17T01:59:21.826012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":519,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826430+0000","last_change":"2024-09-17T01:59:09.353894+0000","last_active":"2024-09-17T01:59:21.826430+0000","last_peered":"2024-09-17T01:59:21.826430+0000","last_clean":"2024-09-17T01:56:19.055461+0000","last_became_active":"2024-09-17T01:59:09.346926+0000","last_became_peered":"2024-09-17T01:59:09.346926+0000","last_unstale":"2024-09-17T01:59:21.826430+0000","last_undegraded":"2024-09-17T01:59:09.247998+0000","last_fullsized":"2024-09-17T01:59:09.238269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":565,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824731+0000","last_change":"2024-09-17T01:59:09.355212+0000","last_active":"2024-09-17T01:59:21.824731+0000","last_peered":"2024-09-17T01:59:21.824731+0000","last_clean":"2024-09-17T01:56:18.963805+0000","last_became_active":"2024-09-17T01:59:09.348164+0000","last_became_peered":"2024-09-17T01:59:09.348164+0000","last_unstale":"2024-09-17T01:59:21.824731+0000","last_undegraded":"2024-09-17T01:59:09.246790+0000","last_fullsized":"2024-09-17T01:59:09.237643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":636,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827351+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:21.827351+0000","last_peered":"2024-09-17T01:59:21.827351+0000","last_clean":"2024-09-17T01:59:21.827351+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:21.827351+0000","last_undegraded":"2024-09-17T01:59:21.827351+0000","last_fullsized":"2024-09-17T01:59:21.827351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":582,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822638+0000","last_change":"2024-09-17T01:59:09.360065+0000","last_active":"2024-09-17T01:59:21.822638+0000","last_peered":"2024-09-17T01:59:21.822638+0000","last_clean":"2024-09-17T01:56:19.050631+0000","last_became_active":"2024-09-17T01:59:09.350052+0000","last_became_peered":"2024-09-17T01:59:09.350052+0000","last_unstale":"2024-09-17T01:59:21.822638+0000","last_undegraded":"2024-09-17T01:59:09.234190+0000","last_fullsized":"2024-09-17T01:59:09.216778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346638+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:21.346638+0000","last_peered":"2024-09-17T01:59:21.346638+0000","last_clean":"2024-09-17T01:59:21.346638+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:21.346638+0000","last_undegraded":"2024-09-17T01:59:21.346638+0000","last_fullsized":"2024-09-17T01:59:21.346638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":547,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822887+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:21.822887+0000","last_peered":"2024-09-17T01:59:21.822887+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:21.822887+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":596,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824770+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:21.824770+0000","last_peered":"2024-09-17T01:59:21.824770+0000","last_clean":"2024-09-17T01:59:21.824770+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:21.824770+0000","last_undegraded":"2024-09-17T01:59:21.824770+0000","last_fullsized":"2024-09-17T01:59:21.824770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":562,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826295+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:21.826295+0000","last_peered":"2024-09-17T01:59:21.826295+0000","last_clean":"2024-09-17T01:59:21.826295+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:21.826295+0000","last_undegraded":"2024-09-17T01:59:21.826295+0000","last_fullsized":"2024-09-17T01:59:21.826295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.358668+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:21.358668+0000","last_peered":"2024-09-17T01:59:21.358668+0000","last_clean":"2024-09-17T01:59:21.358668+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:21.358668+0000","last_undegraded":"2024-09-17T01:59:21.358668+0000","last_fullsized":"2024-09-17T01:59:21.358668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":845,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827814+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:21.827814+0000","last_peered":"2024-09-17T01:59:21.827814+0000","last_clean":"2024-09-17T01:59:21.827814+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:21.827814+0000","last_undegraded":"2024-09-17T01:59:21.827814+0000","last_fullsized":"2024-09-17T01:59:21.827814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":538,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826042+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:21.826042+0000","last_peered":"2024-09-17T01:59:21.826042+0000","last_clean":"2024-09-17T01:59:21.826042+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:21.826042+0000","last_undegraded":"2024-09-17T01:59:21.826042+0000","last_fullsized":"2024-09-17T01:59:21.826042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":651,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824995+0000","last_change":"2024-09-17T01:59:09.356914+0000","last_active":"2024-09-17T01:59:21.824995+0000","last_peered":"2024-09-17T01:59:21.824995+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:59:09.352444+0000","last_became_peered":"2024-09-17T01:59:09.352444+0000","last_unstale":"2024-09-17T01:59:21.824995+0000","last_undegraded":"2024-09-17T01:59:09.251613+0000","last_fullsized":"2024-09-17T01:59:09.242492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346626+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:21.346626+0000","last_peered":"2024-09-17T01:59:21.346626+0000","last_clean":"2024-09-17T01:59:21.346626+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:21.346626+0000","last_undegraded":"2024-09-17T01:59:21.346626+0000","last_fullsized":"2024-09-17T01:59:21.346626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":660,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822797+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:21.822797+0000","last_peered":"2024-09-17T01:59:21.822797+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:21.822797+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":559,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827069+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:21.827069+0000","last_peered":"2024-09-17T01:59:21.827069+0000","last_clean":"2024-09-17T01:59:21.827069+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:21.827069+0000","last_undegraded":"2024-09-17T01:59:21.827069+0000","last_fullsized":"2024-09-17T01:59:21.827069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":588,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826814+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:21.826814+0000","last_peered":"2024-09-17T01:59:21.826814+0000","last_clean":"2024-09-17T01:59:21.826814+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:21.826814+0000","last_undegraded":"2024-09-17T01:59:21.826814+0000","last_fullsized":"2024-09-17T01:59:21.826814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":644,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824559+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:21.824559+0000","last_peered":"2024-09-17T01:59:21.824559+0000","last_clean":"2024-09-17T01:59:21.824559+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:21.824559+0000","last_undegraded":"2024-09-17T01:59:21.824559+0000","last_fullsized":"2024-09-17T01:59:21.824559+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":651,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-17T01:59:21.348754+0000","last_change":"2024-09-17T01:59:21.348754+0000","last_active":"2024-09-17T01:59:08.220906+0000","last_peered":"2024-09-17T01:59:06.601049+0000","last_clean":"2024-09-17T01:56:18.977276+0000","last_became_active":"2024-09-17T01:56:20.332766+0000","last_became_peered":"2024-09-17T01:56:20.332766+0000","last_unstale":"2024-09-17T01:59:21.348754+0000","last_undegraded":"2024-09-17T01:59:21.348754+0000","last_fullsized":"2024-09-17T01:59:21.348754+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":566,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825283+0000","last_change":"2024-09-17T01:59:09.360583+0000","last_active":"2024-09-17T01:59:21.825283+0000","last_peered":"2024-09-17T01:59:21.825283+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:59:09.352921+0000","last_became_peered":"2024-09-17T01:59:09.352921+0000","last_unstale":"2024-09-17T01:59:21.825283+0000","last_undegraded":"2024-09-17T01:59:09.257578+0000","last_fullsized":"2024-09-17T01:59:09.251871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":746,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825491+0000","last_change":"2024-09-17T01:59:09.353921+0000","last_active":"2024-09-17T01:59:21.825491+0000","last_peered":"2024-09-17T01:59:21.825491+0000","last_clean":"2024-09-17T01:56:19.175808+0000","last_became_active":"2024-09-17T01:59:09.347955+0000","last_became_peered":"2024-09-17T01:59:09.347955+0000","last_unstale":"2024-09-17T01:59:21.825491+0000","last_undegraded":"2024-09-17T01:59:09.242382+0000","last_fullsized":"2024-09-17T01:59:09.221213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1043,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.822382+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:21.822382+0000","last_peered":"2024-09-17T01:59:21.822382+0000","last_clean":"2024-09-17T01:59:21.822382+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:21.822382+0000","last_undegraded":"2024-09-17T01:59:21.822382+0000","last_fullsized":"2024-09-17T01:59:21.822382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":636,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824775+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:21.824775+0000","last_peered":"2024-09-17T01:59:21.824775+0000","last_clean":"2024-09-17T01:59:21.824775+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:21.824775+0000","last_undegraded":"2024-09-17T01:59:21.824775+0000","last_fullsized":"2024-09-17T01:59:21.824775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":986,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826849+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:21.826849+0000","last_peered":"2024-09-17T01:59:21.826849+0000","last_clean":"2024-09-17T01:59:21.826849+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:21.826849+0000","last_undegraded":"2024-09-17T01:59:21.826849+0000","last_fullsized":"2024-09-17T01:59:21.826849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1066,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825097+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:21.825097+0000","last_peered":"2024-09-17T01:59:21.825097+0000","last_clean":"2024-09-17T01:59:21.825097+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:21.825097+0000","last_undegraded":"2024-09-17T01:59:21.825097+0000","last_fullsized":"2024-09-17T01:59:21.825097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":580,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.828640+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:21.828640+0000","last_peered":"2024-09-17T01:59:21.828640+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:21.828640+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":929,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-17T01:59:21.336435+0000","last_change":"2024-09-17T01:59:21.827888+0000","last_active":"2024-09-17T01:59:21.827888+0000","last_peered":"2024-09-17T01:59:21.336435+0000","last_clean":"2024-09-17T01:56:19.097605+0000","last_became_active":"2024-09-17T01:59:09.342592+0000","last_became_peered":"2024-09-17T01:59:09.342592+0000","last_unstale":"2024-09-17T01:59:21.336435+0000","last_undegraded":"2024-09-17T01:59:21.336435+0000","last_fullsized":"2024-09-17T01:59:09.222164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":584,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824888+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:21.824888+0000","last_peered":"2024-09-17T01:59:21.824888+0000","last_clean":"2024-09-17T01:59:21.824888+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:21.824888+0000","last_undegraded":"2024-09-17T01:59:21.824888+0000","last_fullsized":"2024-09-17T01:59:21.824888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":624,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826255+0000","last_change":"2024-09-17T01:59:09.353611+0000","last_active":"2024-09-17T01:59:21.826255+0000","last_peered":"2024-09-17T01:59:21.826255+0000","last_clean":"2024-09-17T01:56:19.085369+0000","last_became_active":"2024-09-17T01:59:09.348190+0000","last_became_peered":"2024-09-17T01:59:09.348190+0000","last_unstale":"2024-09-17T01:59:21.826255+0000","last_undegraded":"2024-09-17T01:59:09.241825+0000","last_fullsized":"2024-09-17T01:59:09.221247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":645,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.822595+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:21.822595+0000","last_peered":"2024-09-17T01:59:21.822595+0000","last_clean":"2024-09-17T01:59:21.822595+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:21.822595+0000","last_undegraded":"2024-09-17T01:59:21.822595+0000","last_fullsized":"2024-09-17T01:59:21.822595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":1063,"reported_epoch":86,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:22.130263+0000","last_change":"2024-09-17T01:59:21.341088+0000","last_active":"2024-09-17T01:59:22.130263+0000","last_peered":"2024-09-17T01:59:22.130263+0000","last_clean":"2024-09-17T01:56:18.958056+0000","last_became_active":"2024-09-17T01:59:09.344792+0000","last_became_peered":"2024-09-17T01:59:09.344792+0000","last_unstale":"2024-09-17T01:59:22.130263+0000","last_undegraded":"2024-09-17T01:59:22.130263+0000","last_fullsized":"2024-09-17T01:59:09.216214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":611,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828170+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:21.828170+0000","last_peered":"2024-09-17T01:59:21.828170+0000","last_clean":"2024-09-17T01:59:21.828170+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:21.828170+0000","last_undegraded":"2024-09-17T01:59:21.828170+0000","last_fullsized":"2024-09-17T01:59:21.828170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":546,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346289+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:21.346289+0000","last_peered":"2024-09-17T01:59:21.346289+0000","last_clean":"2024-09-17T01:59:21.346289+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:21.346289+0000","last_undegraded":"2024-09-17T01:59:21.346289+0000","last_fullsized":"2024-09-17T01:59:21.346289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":633,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827769+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:21.827769+0000","last_peered":"2024-09-17T01:59:21.827769+0000","last_clean":"2024-09-17T01:59:21.827769+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:21.827769+0000","last_undegraded":"2024-09-17T01:59:21.827769+0000","last_fullsized":"2024-09-17T01:59:21.827769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":208,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823588+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:21.823588+0000","last_peered":"2024-09-17T01:59:21.823588+0000","last_clean":"2024-09-17T01:59:21.823588+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:21.823588+0000","last_undegraded":"2024-09-17T01:59:21.823588+0000","last_fullsized":"2024-09-17T01:59:21.823588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":670,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825523+0000","last_change":"2024-09-17T01:59:09.359886+0000","last_active":"2024-09-17T01:59:21.825523+0000","last_peered":"2024-09-17T01:59:21.825523+0000","last_clean":"2024-09-17T01:56:19.307562+0000","last_became_active":"2024-09-17T01:59:09.346790+0000","last_became_peered":"2024-09-17T01:59:09.346790+0000","last_unstale":"2024-09-17T01:59:21.825523+0000","last_undegraded":"2024-09-17T01:59:09.259034+0000","last_fullsized":"2024-09-17T01:59:09.253040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":233,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825464+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:21.825464+0000","last_peered":"2024-09-17T01:59:21.825464+0000","last_clean":"2024-09-17T01:59:21.825464+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:21.825464+0000","last_undegraded":"2024-09-17T01:59:21.825464+0000","last_fullsized":"2024-09-17T01:59:21.825464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":617,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826125+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:21.826125+0000","last_peered":"2024-09-17T01:59:21.826125+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:21.826125+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345416+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:21.345416+0000","last_peered":"2024-09-17T01:59:21.345416+0000","last_clean":"2024-09-17T01:59:21.345416+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:21.345416+0000","last_undegraded":"2024-09-17T01:59:21.345416+0000","last_fullsized":"2024-09-17T01:59:21.345416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348504+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:21.348504+0000","last_peered":"2024-09-17T01:59:21.348504+0000","last_clean":"2024-09-17T01:59:21.348504+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:21.348504+0000","last_undegraded":"2024-09-17T01:59:21.348504+0000","last_fullsized":"2024-09-17T01:59:21.348504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":586,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824852+0000","last_change":"2024-09-17T01:59:09.350752+0000","last_active":"2024-09-17T01:59:21.824852+0000","last_peered":"2024-09-17T01:59:21.824852+0000","last_clean":"2024-09-17T01:56:19.149880+0000","last_became_active":"2024-09-17T01:59:09.345019+0000","last_became_peered":"2024-09-17T01:59:09.345019+0000","last_unstale":"2024-09-17T01:59:21.824852+0000","last_undegraded":"2024-09-17T01:59:09.238653+0000","last_fullsized":"2024-09-17T01:59:09.221148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":426,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827130+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:21.827130+0000","last_peered":"2024-09-17T01:59:21.827130+0000","last_clean":"2024-09-17T01:59:21.827130+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:21.827130+0000","last_undegraded":"2024-09-17T01:59:21.827130+0000","last_fullsized":"2024-09-17T01:59:21.827130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":619,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825080+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:21.825080+0000","last_peered":"2024-09-17T01:59:21.825080+0000","last_clean":"2024-09-17T01:59:21.825080+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:21.825080+0000","last_undegraded":"2024-09-17T01:59:21.825080+0000","last_fullsized":"2024-09-17T01:59:21.825080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347987+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:21.347987+0000","last_peered":"2024-09-17T01:59:21.347987+0000","last_clean":"2024-09-17T01:59:21.347987+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:21.347987+0000","last_undegraded":"2024-09-17T01:59:21.347987+0000","last_fullsized":"2024-09-17T01:59:21.347987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":664,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823894+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:21.823894+0000","last_peered":"2024-09-17T01:59:21.823894+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:21.823894+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347498+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:21.347498+0000","last_peered":"2024-09-17T01:59:21.347498+0000","last_clean":"2024-09-17T01:59:21.347498+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:21.347498+0000","last_undegraded":"2024-09-17T01:59:21.347498+0000","last_fullsized":"2024-09-17T01:59:21.347498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":975,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824252+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:21.824252+0000","last_peered":"2024-09-17T01:59:21.824252+0000","last_clean":"2024-09-17T01:59:21.824252+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:21.824252+0000","last_undegraded":"2024-09-17T01:59:21.824252+0000","last_fullsized":"2024-09-17T01:59:21.824252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":318,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825397+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:21.825397+0000","last_peered":"2024-09-17T01:59:21.825397+0000","last_clean":"2024-09-17T01:59:21.825397+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:21.825397+0000","last_undegraded":"2024-09-17T01:59:21.825397+0000","last_fullsized":"2024-09-17T01:59:21.825397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":636,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824001+0000","last_change":"2024-09-17T01:59:09.354142+0000","last_active":"2024-09-17T01:59:21.824001+0000","last_peered":"2024-09-17T01:59:21.824001+0000","last_clean":"2024-09-17T01:56:19.230450+0000","last_became_active":"2024-09-17T01:59:09.346035+0000","last_became_peered":"2024-09-17T01:59:09.346035+0000","last_unstale":"2024-09-17T01:59:21.824001+0000","last_undegraded":"2024-09-17T01:59:09.240022+0000","last_fullsized":"2024-09-17T01:59:09.217749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":203,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346023+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:21.346023+0000","last_peered":"2024-09-17T01:59:21.346023+0000","last_clean":"2024-09-17T01:59:21.346023+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:21.346023+0000","last_undegraded":"2024-09-17T01:59:21.346023+0000","last_fullsized":"2024-09-17T01:59:21.346023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":687,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.828077+0000","last_change":"2024-09-17T01:59:09.358162+0000","last_active":"2024-09-17T01:59:21.828077+0000","last_peered":"2024-09-17T01:59:21.828077+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:21.828077+0000","last_undegraded":"2024-09-17T01:59:09.257380+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":207,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825548+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:21.825548+0000","last_peered":"2024-09-17T01:59:21.825548+0000","last_clean":"2024-09-17T01:59:21.825548+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:21.825548+0000","last_undegraded":"2024-09-17T01:59:21.825548+0000","last_fullsized":"2024-09-17T01:59:21.825548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":542,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348667+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:21.348667+0000","last_peered":"2024-09-17T01:59:21.348667+0000","last_clean":"2024-09-17T01:59:21.348667+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:21.348667+0000","last_undegraded":"2024-09-17T01:59:21.348667+0000","last_fullsized":"2024-09-17T01:59:21.348667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":602,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825081+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:21.825081+0000","last_peered":"2024-09-17T01:59:21.825081+0000","last_clean":"2024-09-17T01:59:21.825081+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:21.825081+0000","last_undegraded":"2024-09-17T01:59:21.825081+0000","last_fullsized":"2024-09-17T01:59:21.825081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":579,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826519+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:21.826519+0000","last_peered":"2024-09-17T01:59:21.826519+0000","last_clean":"2024-09-17T01:59:21.826519+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:21.826519+0000","last_undegraded":"2024-09-17T01:59:21.826519+0000","last_fullsized":"2024-09-17T01:59:21.826519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":245,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345206+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:21.345206+0000","last_peered":"2024-09-17T01:59:21.345206+0000","last_clean":"2024-09-17T01:59:21.345206+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:21.345206+0000","last_undegraded":"2024-09-17T01:59:21.345206+0000","last_fullsized":"2024-09-17T01:59:21.345206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346082+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:21.346082+0000","last_peered":"2024-09-17T01:59:21.346082+0000","last_clean":"2024-09-17T01:59:21.346082+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:21.346082+0000","last_undegraded":"2024-09-17T01:59:21.346082+0000","last_fullsized":"2024-09-17T01:59:21.346082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346542+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:21.346542+0000","last_peered":"2024-09-17T01:59:21.346542+0000","last_clean":"2024-09-17T01:59:21.346542+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:21.346542+0000","last_undegraded":"2024-09-17T01:59:21.346542+0000","last_fullsized":"2024-09-17T01:59:21.346542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":606,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.827503+0000","last_change":"2024-09-17T01:59:09.355911+0000","last_active":"2024-09-17T01:59:21.827503+0000","last_peered":"2024-09-17T01:59:21.827503+0000","last_clean":"2024-09-17T01:56:19.185411+0000","last_became_active":"2024-09-17T01:59:09.349985+0000","last_became_peered":"2024-09-17T01:59:09.349985+0000","last_unstale":"2024-09-17T01:59:21.827503+0000","last_undegraded":"2024-09-17T01:59:09.252095+0000","last_fullsized":"2024-09-17T01:59:09.248489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345878+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:21.345878+0000","last_peered":"2024-09-17T01:59:21.345878+0000","last_clean":"2024-09-17T01:59:21.345878+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:21.345878+0000","last_undegraded":"2024-09-17T01:59:21.345878+0000","last_fullsized":"2024-09-17T01:59:21.345878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823481+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:21.823481+0000","last_peered":"2024-09-17T01:59:21.823481+0000","last_clean":"2024-09-17T01:59:21.823481+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:21.823481+0000","last_undegraded":"2024-09-17T01:59:21.823481+0000","last_fullsized":"2024-09-17T01:59:21.823481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":680,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826913+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:21.826913+0000","last_peered":"2024-09-17T01:59:21.826913+0000","last_clean":"2024-09-17T01:59:21.826913+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:21.826913+0000","last_undegraded":"2024-09-17T01:59:21.826913+0000","last_fullsized":"2024-09-17T01:59:21.826913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823723+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:21.823723+0000","last_peered":"2024-09-17T01:59:21.823723+0000","last_clean":"2024-09-17T01:59:21.823723+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:21.823723+0000","last_undegraded":"2024-09-17T01:59:21.823723+0000","last_fullsized":"2024-09-17T01:59:21.823723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":582,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825403+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:21.825403+0000","last_peered":"2024-09-17T01:59:21.825403+0000","last_clean":"2024-09-17T01:59:21.825403+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:21.825403+0000","last_undegraded":"2024-09-17T01:59:21.825403+0000","last_fullsized":"2024-09-17T01:59:21.825403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":542,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826758+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:21.826758+0000","last_peered":"2024-09-17T01:59:21.826758+0000","last_clean":"2024-09-17T01:59:21.826758+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:21.826758+0000","last_undegraded":"2024-09-17T01:59:21.826758+0000","last_fullsized":"2024-09-17T01:59:21.826758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345548+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:21.345548+0000","last_peered":"2024-09-17T01:59:21.345548+0000","last_clean":"2024-09-17T01:59:21.345548+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:21.345548+0000","last_undegraded":"2024-09-17T01:59:21.345548+0000","last_fullsized":"2024-09-17T01:59:21.345548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345972+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:21.345972+0000","last_peered":"2024-09-17T01:59:21.345972+0000","last_clean":"2024-09-17T01:59:21.345972+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:21.345972+0000","last_undegraded":"2024-09-17T01:59:21.345972+0000","last_fullsized":"2024-09-17T01:59:21.345972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":587,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825563+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:21.825563+0000","last_peered":"2024-09-17T01:59:21.825563+0000","last_clean":"2024-09-17T01:59:21.825563+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:21.825563+0000","last_undegraded":"2024-09-17T01:59:21.825563+0000","last_fullsized":"2024-09-17T01:59:21.825563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":359,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347234+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:21.347234+0000","last_peered":"2024-09-17T01:59:21.347234+0000","last_clean":"2024-09-17T01:59:21.347234+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:21.347234+0000","last_undegraded":"2024-09-17T01:59:21.347234+0000","last_fullsized":"2024-09-17T01:59:21.347234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826221+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:21.826221+0000","last_peered":"2024-09-17T01:59:21.826221+0000","last_clean":"2024-09-17T01:59:21.826221+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:21.826221+0000","last_undegraded":"2024-09-17T01:59:21.826221+0000","last_fullsized":"2024-09-17T01:59:21.826221+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":557,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825655+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:21.825655+0000","last_peered":"2024-09-17T01:59:21.825655+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:21.825655+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":207,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826152+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:21.826152+0000","last_peered":"2024-09-17T01:59:21.826152+0000","last_clean":"2024-09-17T01:59:21.826152+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:21.826152+0000","last_undegraded":"2024-09-17T01:59:21.826152+0000","last_fullsized":"2024-09-17T01:59:21.826152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828700+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:21.828700+0000","last_peered":"2024-09-17T01:59:21.828700+0000","last_clean":"2024-09-17T01:59:21.828700+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:21.828700+0000","last_undegraded":"2024-09-17T01:59:21.828700+0000","last_fullsized":"2024-09-17T01:59:21.828700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":977,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.834309+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:21.834309+0000","last_peered":"2024-09-17T01:59:21.834309+0000","last_clean":"2024-09-17T01:59:21.834309+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:21.834309+0000","last_undegraded":"2024-09-17T01:59:21.834309+0000","last_fullsized":"2024-09-17T01:59:21.834309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827138+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:21.827138+0000","last_peered":"2024-09-17T01:59:21.827138+0000","last_clean":"2024-09-17T01:59:21.827138+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:21.827138+0000","last_undegraded":"2024-09-17T01:59:21.827138+0000","last_fullsized":"2024-09-17T01:59:21.827138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826202+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:21.826202+0000","last_peered":"2024-09-17T01:59:21.826202+0000","last_clean":"2024-09-17T01:59:21.826202+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:21.826202+0000","last_undegraded":"2024-09-17T01:59:21.826202+0000","last_fullsized":"2024-09-17T01:59:21.826202+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":584,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823818+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:21.823818+0000","last_peered":"2024-09-17T01:59:21.823818+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:21.823818+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":274,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825739+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:21.825739+0000","last_peered":"2024-09-17T01:59:21.825739+0000","last_clean":"2024-09-17T01:59:21.825739+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:21.825739+0000","last_undegraded":"2024-09-17T01:59:21.825739+0000","last_fullsized":"2024-09-17T01:59:21.825739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347662+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:21.347662+0000","last_peered":"2024-09-17T01:59:21.347662+0000","last_clean":"2024-09-17T01:59:21.347662+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:21.347662+0000","last_undegraded":"2024-09-17T01:59:21.347662+0000","last_fullsized":"2024-09-17T01:59:21.347662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1011,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825232+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:21.825232+0000","last_peered":"2024-09-17T01:59:21.825232+0000","last_clean":"2024-09-17T01:59:21.825232+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:21.825232+0000","last_undegraded":"2024-09-17T01:59:21.825232+0000","last_fullsized":"2024-09-17T01:59:21.825232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":578,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346595+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:21.346595+0000","last_peered":"2024-09-17T01:59:21.346595+0000","last_clean":"2024-09-17T01:59:21.346595+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:21.346595+0000","last_undegraded":"2024-09-17T01:59:21.346595+0000","last_fullsized":"2024-09-17T01:59:21.346595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":401,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347046+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:21.347046+0000","last_peered":"2024-09-17T01:59:21.347046+0000","last_clean":"2024-09-17T01:59:21.347046+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:21.347046+0000","last_undegraded":"2024-09-17T01:59:21.347046+0000","last_fullsized":"2024-09-17T01:59:21.347046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":635,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823265+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:21.823265+0000","last_peered":"2024-09-17T01:59:21.823265+0000","last_clean":"2024-09-17T01:59:21.823265+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:21.823265+0000","last_undegraded":"2024-09-17T01:59:21.823265+0000","last_fullsized":"2024-09-17T01:59:21.823265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":241,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828159+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:21.828159+0000","last_peered":"2024-09-17T01:59:21.828159+0000","last_clean":"2024-09-17T01:59:21.828159+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:21.828159+0000","last_undegraded":"2024-09-17T01:59:21.828159+0000","last_fullsized":"2024-09-17T01:59:21.828159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":295,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348200+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:21.348200+0000","last_peered":"2024-09-17T01:59:21.348200+0000","last_clean":"2024-09-17T01:59:21.348200+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:21.348200+0000","last_undegraded":"2024-09-17T01:59:21.348200+0000","last_fullsized":"2024-09-17T01:59:21.348200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":725,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822751+0000","last_change":"2024-09-17T01:59:09.361052+0000","last_active":"2024-09-17T01:59:21.822751+0000","last_peered":"2024-09-17T01:59:21.822751+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:21.822751+0000","last_undegraded":"2024-09-17T01:59:09.243588+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":206,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826995+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:21.826995+0000","last_peered":"2024-09-17T01:59:21.826995+0000","last_clean":"2024-09-17T01:59:21.826995+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:21.826995+0000","last_undegraded":"2024-09-17T01:59:21.826995+0000","last_fullsized":"2024-09-17T01:59:21.826995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":662,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823730+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:21.823730+0000","last_peered":"2024-09-17T01:59:21.823730+0000","last_clean":"2024-09-17T01:59:21.823730+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:21.823730+0000","last_undegraded":"2024-09-17T01:59:21.823730+0000","last_fullsized":"2024-09-17T01:59:21.823730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":849,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827209+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:21.827209+0000","last_peered":"2024-09-17T01:59:21.827209+0000","last_clean":"2024-09-17T01:59:21.827209+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:21.827209+0000","last_undegraded":"2024-09-17T01:59:21.827209+0000","last_fullsized":"2024-09-17T01:59:21.827209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":773,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824029+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:21.824029+0000","last_peered":"2024-09-17T01:59:21.824029+0000","last_clean":"2024-09-17T01:59:21.824029+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:21.824029+0000","last_undegraded":"2024-09-17T01:59:21.824029+0000","last_fullsized":"2024-09-17T01:59:21.824029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":932,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824824+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:21.824824+0000","last_peered":"2024-09-17T01:59:21.824824+0000","last_clean":"2024-09-17T01:59:21.824824+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:21.824824+0000","last_undegraded":"2024-09-17T01:59:21.824824+0000","last_fullsized":"2024-09-17T01:59:21.824824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":361,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823149+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:21.823149+0000","last_peered":"2024-09-17T01:59:21.823149+0000","last_clean":"2024-09-17T01:59:21.823149+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:21.823149+0000","last_undegraded":"2024-09-17T01:59:21.823149+0000","last_fullsized":"2024-09-17T01:59:21.823149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":583,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.827433+0000","last_change":"2024-09-17T01:59:09.355604+0000","last_active":"2024-09-17T01:59:21.827433+0000","last_peered":"2024-09-17T01:59:21.827433+0000","last_clean":"2024-09-17T01:56:19.136297+0000","last_became_active":"2024-09-17T01:59:09.347969+0000","last_became_peered":"2024-09-17T01:59:09.347969+0000","last_unstale":"2024-09-17T01:59:21.827433+0000","last_undegraded":"2024-09-17T01:59:09.248244+0000","last_fullsized":"2024-09-17T01:59:09.223371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":419,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826314+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:21.826314+0000","last_peered":"2024-09-17T01:59:21.826314+0000","last_clean":"2024-09-17T01:59:21.826314+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:21.826314+0000","last_undegraded":"2024-09-17T01:59:21.826314+0000","last_fullsized":"2024-09-17T01:59:21.826314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":559,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828020+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:21.828020+0000","last_peered":"2024-09-17T01:59:21.828020+0000","last_clean":"2024-09-17T01:59:21.828020+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:21.828020+0000","last_undegraded":"2024-09-17T01:59:21.828020+0000","last_fullsized":"2024-09-17T01:59:21.828020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":208,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827623+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:21.827623+0000","last_peered":"2024-09-17T01:59:21.827623+0000","last_clean":"2024-09-17T01:59:21.827623+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:21.827623+0000","last_undegraded":"2024-09-17T01:59:21.827623+0000","last_fullsized":"2024-09-17T01:59:21.827623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346589+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:21.346589+0000","last_peered":"2024-09-17T01:59:21.346589+0000","last_clean":"2024-09-17T01:59:21.346589+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:21.346589+0000","last_undegraded":"2024-09-17T01:59:21.346589+0000","last_fullsized":"2024-09-17T01:59:21.346589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347208+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:21.347208+0000","last_peered":"2024-09-17T01:59:21.347208+0000","last_clean":"2024-09-17T01:59:21.347208+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:21.347208+0000","last_undegraded":"2024-09-17T01:59:21.347208+0000","last_fullsized":"2024-09-17T01:59:21.347208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":554,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823578+0000","last_change":"2024-09-17T01:59:09.359162+0000","last_active":"2024-09-17T01:59:21.823578+0000","last_peered":"2024-09-17T01:59:21.823578+0000","last_clean":"2024-09-17T01:56:19.006818+0000","last_became_active":"2024-09-17T01:59:09.351483+0000","last_became_peered":"2024-09-17T01:59:09.351483+0000","last_unstale":"2024-09-17T01:59:21.823578+0000","last_undegraded":"2024-09-17T01:59:09.240046+0000","last_fullsized":"2024-09-17T01:59:09.225735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":433,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827918+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:21.827918+0000","last_peered":"2024-09-17T01:59:21.827918+0000","last_clean":"2024-09-17T01:59:21.827918+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:21.827918+0000","last_undegraded":"2024-09-17T01:59:21.827918+0000","last_fullsized":"2024-09-17T01:59:21.827918+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":654,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825920+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:21.825920+0000","last_peered":"2024-09-17T01:59:21.825920+0000","last_clean":"2024-09-17T01:59:21.825920+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:21.825920+0000","last_undegraded":"2024-09-17T01:59:21.825920+0000","last_fullsized":"2024-09-17T01:59:21.825920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":189,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825399+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:21.825399+0000","last_peered":"2024-09-17T01:59:21.825399+0000","last_clean":"2024-09-17T01:59:21.825399+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:21.825399+0000","last_undegraded":"2024-09-17T01:59:21.825399+0000","last_fullsized":"2024-09-17T01:59:21.825399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":694,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822141+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:21.822141+0000","last_peered":"2024-09-17T01:59:21.822141+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:21.822141+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826875+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:21.826875+0000","last_peered":"2024-09-17T01:59:21.826875+0000","last_clean":"2024-09-17T01:59:21.826875+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:21.826875+0000","last_undegraded":"2024-09-17T01:59:21.826875+0000","last_fullsized":"2024-09-17T01:59:21.826875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2977,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23330816,"data_stored":22647183,"data_compressed":2044511,"data_compressed_allocated":2809856,"data_compressed_original":10334208,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678021,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72696,"kb_used_data":35428,"kb_used_omap":174,"kb_used_meta":37073,"kb_avail":94299144,"statfs":{"total":96636764160,"available":96562323456,"internally_reserved":0,"allocated":36278272,"data_stored":121825650,"data_compressed":10099268,"data_compressed_allocated":14524416,"data_compressed_original":108826624,"omap_allocated":179054,"internal_metadata":37962898},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95116,"kb_used_data":23732,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276724,"statfs":{"total":96636764160,"available":96539365376,"internally_reserved":0,"allocated":24301568,"data_stored":84979137,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91740,"kb_used_data":20356,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94280100,"statfs":{"total":96636764160,"available":96542822400,"internally_reserved":0,"allocated":20844544,"data_stored":73136461,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23330816,"data_stored":22647183,"data_compressed":2044511,"data_compressed_allocated":2809856,"data_compressed_original":10334208,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:23.716 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:24.058 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:24.060 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:24.076 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-17T01:59:23.822504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2999,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":259552,"kb_used_data":79516,"kb_used_omap":177,"kb_used_meta":179790,"kb_avail":282855968,"statfs":{"total":289910292480,"available":289644511232,"internally_reserved":0,"allocated":81424384,"data_stored":279941248,"data_compressed":21759347,"data_compressed_allocated":34959360,"data_compressed_original":243089408,"omap_allocated":182244,"internal_metadata":184104988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1233,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1499,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.005198"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":639,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826848+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:21.826848+0000","last_peered":"2024-09-17T01:59:21.826848+0000","last_clean":"2024-09-17T01:59:21.826848+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:21.826848+0000","last_undegraded":"2024-09-17T01:59:21.826848+0000","last_fullsized":"2024-09-17T01:59:21.826848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":632,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826012+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:21.826012+0000","last_peered":"2024-09-17T01:59:21.826012+0000","last_clean":"2024-09-17T01:59:21.826012+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:21.826012+0000","last_undegraded":"2024-09-17T01:59:21.826012+0000","last_fullsized":"2024-09-17T01:59:21.826012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":519,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826430+0000","last_change":"2024-09-17T01:59:09.353894+0000","last_active":"2024-09-17T01:59:21.826430+0000","last_peered":"2024-09-17T01:59:21.826430+0000","last_clean":"2024-09-17T01:56:19.055461+0000","last_became_active":"2024-09-17T01:59:09.346926+0000","last_became_peered":"2024-09-17T01:59:09.346926+0000","last_unstale":"2024-09-17T01:59:21.826430+0000","last_undegraded":"2024-09-17T01:59:09.247998+0000","last_fullsized":"2024-09-17T01:59:09.238269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":565,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824731+0000","last_change":"2024-09-17T01:59:09.355212+0000","last_active":"2024-09-17T01:59:21.824731+0000","last_peered":"2024-09-17T01:59:21.824731+0000","last_clean":"2024-09-17T01:56:18.963805+0000","last_became_active":"2024-09-17T01:59:09.348164+0000","last_became_peered":"2024-09-17T01:59:09.348164+0000","last_unstale":"2024-09-17T01:59:21.824731+0000","last_undegraded":"2024-09-17T01:59:09.246790+0000","last_fullsized":"2024-09-17T01:59:09.237643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":636,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827351+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:21.827351+0000","last_peered":"2024-09-17T01:59:21.827351+0000","last_clean":"2024-09-17T01:59:21.827351+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:21.827351+0000","last_undegraded":"2024-09-17T01:59:21.827351+0000","last_fullsized":"2024-09-17T01:59:21.827351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":582,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822638+0000","last_change":"2024-09-17T01:59:09.360065+0000","last_active":"2024-09-17T01:59:21.822638+0000","last_peered":"2024-09-17T01:59:21.822638+0000","last_clean":"2024-09-17T01:56:19.050631+0000","last_became_active":"2024-09-17T01:59:09.350052+0000","last_became_peered":"2024-09-17T01:59:09.350052+0000","last_unstale":"2024-09-17T01:59:21.822638+0000","last_undegraded":"2024-09-17T01:59:09.234190+0000","last_fullsized":"2024-09-17T01:59:09.216778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346638+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:21.346638+0000","last_peered":"2024-09-17T01:59:21.346638+0000","last_clean":"2024-09-17T01:59:21.346638+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:21.346638+0000","last_undegraded":"2024-09-17T01:59:21.346638+0000","last_fullsized":"2024-09-17T01:59:21.346638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":547,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822887+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:21.822887+0000","last_peered":"2024-09-17T01:59:21.822887+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:21.822887+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":596,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824770+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:21.824770+0000","last_peered":"2024-09-17T01:59:21.824770+0000","last_clean":"2024-09-17T01:59:21.824770+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:21.824770+0000","last_undegraded":"2024-09-17T01:59:21.824770+0000","last_fullsized":"2024-09-17T01:59:21.824770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":562,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826295+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:21.826295+0000","last_peered":"2024-09-17T01:59:21.826295+0000","last_clean":"2024-09-17T01:59:21.826295+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:21.826295+0000","last_undegraded":"2024-09-17T01:59:21.826295+0000","last_fullsized":"2024-09-17T01:59:21.826295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.358668+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:21.358668+0000","last_peered":"2024-09-17T01:59:21.358668+0000","last_clean":"2024-09-17T01:59:21.358668+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:21.358668+0000","last_undegraded":"2024-09-17T01:59:21.358668+0000","last_fullsized":"2024-09-17T01:59:21.358668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":845,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827814+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:21.827814+0000","last_peered":"2024-09-17T01:59:21.827814+0000","last_clean":"2024-09-17T01:59:21.827814+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:21.827814+0000","last_undegraded":"2024-09-17T01:59:21.827814+0000","last_fullsized":"2024-09-17T01:59:21.827814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":538,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826042+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:21.826042+0000","last_peered":"2024-09-17T01:59:21.826042+0000","last_clean":"2024-09-17T01:59:21.826042+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:21.826042+0000","last_undegraded":"2024-09-17T01:59:21.826042+0000","last_fullsized":"2024-09-17T01:59:21.826042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":651,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824995+0000","last_change":"2024-09-17T01:59:09.356914+0000","last_active":"2024-09-17T01:59:21.824995+0000","last_peered":"2024-09-17T01:59:21.824995+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:59:09.352444+0000","last_became_peered":"2024-09-17T01:59:09.352444+0000","last_unstale":"2024-09-17T01:59:21.824995+0000","last_undegraded":"2024-09-17T01:59:09.251613+0000","last_fullsized":"2024-09-17T01:59:09.242492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346626+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:21.346626+0000","last_peered":"2024-09-17T01:59:21.346626+0000","last_clean":"2024-09-17T01:59:21.346626+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:21.346626+0000","last_undegraded":"2024-09-17T01:59:21.346626+0000","last_fullsized":"2024-09-17T01:59:21.346626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":660,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822797+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:21.822797+0000","last_peered":"2024-09-17T01:59:21.822797+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:21.822797+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":559,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827069+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:21.827069+0000","last_peered":"2024-09-17T01:59:21.827069+0000","last_clean":"2024-09-17T01:59:21.827069+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:21.827069+0000","last_undegraded":"2024-09-17T01:59:21.827069+0000","last_fullsized":"2024-09-17T01:59:21.827069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":588,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826814+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:21.826814+0000","last_peered":"2024-09-17T01:59:21.826814+0000","last_clean":"2024-09-17T01:59:21.826814+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:21.826814+0000","last_undegraded":"2024-09-17T01:59:21.826814+0000","last_fullsized":"2024-09-17T01:59:21.826814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":644,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824559+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:21.824559+0000","last_peered":"2024-09-17T01:59:21.824559+0000","last_clean":"2024-09-17T01:59:21.824559+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:21.824559+0000","last_undegraded":"2024-09-17T01:59:21.824559+0000","last_fullsized":"2024-09-17T01:59:21.824559+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":651,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-17T01:59:21.348754+0000","last_change":"2024-09-17T01:59:21.348754+0000","last_active":"2024-09-17T01:59:08.220906+0000","last_peered":"2024-09-17T01:59:06.601049+0000","last_clean":"2024-09-17T01:56:18.977276+0000","last_became_active":"2024-09-17T01:56:20.332766+0000","last_became_peered":"2024-09-17T01:56:20.332766+0000","last_unstale":"2024-09-17T01:59:21.348754+0000","last_undegraded":"2024-09-17T01:59:21.348754+0000","last_fullsized":"2024-09-17T01:59:21.348754+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":566,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825283+0000","last_change":"2024-09-17T01:59:09.360583+0000","last_active":"2024-09-17T01:59:21.825283+0000","last_peered":"2024-09-17T01:59:21.825283+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:59:09.352921+0000","last_became_peered":"2024-09-17T01:59:09.352921+0000","last_unstale":"2024-09-17T01:59:21.825283+0000","last_undegraded":"2024-09-17T01:59:09.257578+0000","last_fullsized":"2024-09-17T01:59:09.251871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":746,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825491+0000","last_change":"2024-09-17T01:59:09.353921+0000","last_active":"2024-09-17T01:59:21.825491+0000","last_peered":"2024-09-17T01:59:21.825491+0000","last_clean":"2024-09-17T01:56:19.175808+0000","last_became_active":"2024-09-17T01:59:09.347955+0000","last_became_peered":"2024-09-17T01:59:09.347955+0000","last_unstale":"2024-09-17T01:59:21.825491+0000","last_undegraded":"2024-09-17T01:59:09.242382+0000","last_fullsized":"2024-09-17T01:59:09.221213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1043,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.822382+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:21.822382+0000","last_peered":"2024-09-17T01:59:21.822382+0000","last_clean":"2024-09-17T01:59:21.822382+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:21.822382+0000","last_undegraded":"2024-09-17T01:59:21.822382+0000","last_fullsized":"2024-09-17T01:59:21.822382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":636,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824775+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:21.824775+0000","last_peered":"2024-09-17T01:59:21.824775+0000","last_clean":"2024-09-17T01:59:21.824775+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:21.824775+0000","last_undegraded":"2024-09-17T01:59:21.824775+0000","last_fullsized":"2024-09-17T01:59:21.824775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":986,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826849+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:21.826849+0000","last_peered":"2024-09-17T01:59:21.826849+0000","last_clean":"2024-09-17T01:59:21.826849+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:21.826849+0000","last_undegraded":"2024-09-17T01:59:21.826849+0000","last_fullsized":"2024-09-17T01:59:21.826849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1066,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825097+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:21.825097+0000","last_peered":"2024-09-17T01:59:21.825097+0000","last_clean":"2024-09-17T01:59:21.825097+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:21.825097+0000","last_undegraded":"2024-09-17T01:59:21.825097+0000","last_fullsized":"2024-09-17T01:59:21.825097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":580,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.828640+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:21.828640+0000","last_peered":"2024-09-17T01:59:21.828640+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:21.828640+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":929,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-17T01:59:21.336435+0000","last_change":"2024-09-17T01:59:21.827888+0000","last_active":"2024-09-17T01:59:21.827888+0000","last_peered":"2024-09-17T01:59:21.336435+0000","last_clean":"2024-09-17T01:56:19.097605+0000","last_became_active":"2024-09-17T01:59:09.342592+0000","last_became_peered":"2024-09-17T01:59:09.342592+0000","last_unstale":"2024-09-17T01:59:21.336435+0000","last_undegraded":"2024-09-17T01:59:21.336435+0000","last_fullsized":"2024-09-17T01:59:09.222164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":584,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824888+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:21.824888+0000","last_peered":"2024-09-17T01:59:21.824888+0000","last_clean":"2024-09-17T01:59:21.824888+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:21.824888+0000","last_undegraded":"2024-09-17T01:59:21.824888+0000","last_fullsized":"2024-09-17T01:59:21.824888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":624,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826255+0000","last_change":"2024-09-17T01:59:09.353611+0000","last_active":"2024-09-17T01:59:21.826255+0000","last_peered":"2024-09-17T01:59:21.826255+0000","last_clean":"2024-09-17T01:56:19.085369+0000","last_became_active":"2024-09-17T01:59:09.348190+0000","last_became_peered":"2024-09-17T01:59:09.348190+0000","last_unstale":"2024-09-17T01:59:21.826255+0000","last_undegraded":"2024-09-17T01:59:09.241825+0000","last_fullsized":"2024-09-17T01:59:09.221247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":645,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.822595+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:21.822595+0000","last_peered":"2024-09-17T01:59:21.822595+0000","last_clean":"2024-09-17T01:59:21.822595+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:21.822595+0000","last_undegraded":"2024-09-17T01:59:21.822595+0000","last_fullsized":"2024-09-17T01:59:21.822595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":1063,"reported_epoch":86,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:22.130263+0000","last_change":"2024-09-17T01:59:21.341088+0000","last_active":"2024-09-17T01:59:22.130263+0000","last_peered":"2024-09-17T01:59:22.130263+0000","last_clean":"2024-09-17T01:56:18.958056+0000","last_became_active":"2024-09-17T01:59:09.344792+0000","last_became_peered":"2024-09-17T01:59:09.344792+0000","last_unstale":"2024-09-17T01:59:22.130263+0000","last_undegraded":"2024-09-17T01:59:22.130263+0000","last_fullsized":"2024-09-17T01:59:09.216214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":611,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828170+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:21.828170+0000","last_peered":"2024-09-17T01:59:21.828170+0000","last_clean":"2024-09-17T01:59:21.828170+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:21.828170+0000","last_undegraded":"2024-09-17T01:59:21.828170+0000","last_fullsized":"2024-09-17T01:59:21.828170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":546,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346289+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:21.346289+0000","last_peered":"2024-09-17T01:59:21.346289+0000","last_clean":"2024-09-17T01:59:21.346289+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:21.346289+0000","last_undegraded":"2024-09-17T01:59:21.346289+0000","last_fullsized":"2024-09-17T01:59:21.346289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":633,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827769+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:21.827769+0000","last_peered":"2024-09-17T01:59:21.827769+0000","last_clean":"2024-09-17T01:59:21.827769+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:21.827769+0000","last_undegraded":"2024-09-17T01:59:21.827769+0000","last_fullsized":"2024-09-17T01:59:21.827769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":208,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823588+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:21.823588+0000","last_peered":"2024-09-17T01:59:21.823588+0000","last_clean":"2024-09-17T01:59:21.823588+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:21.823588+0000","last_undegraded":"2024-09-17T01:59:21.823588+0000","last_fullsized":"2024-09-17T01:59:21.823588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":670,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825523+0000","last_change":"2024-09-17T01:59:09.359886+0000","last_active":"2024-09-17T01:59:21.825523+0000","last_peered":"2024-09-17T01:59:21.825523+0000","last_clean":"2024-09-17T01:56:19.307562+0000","last_became_active":"2024-09-17T01:59:09.346790+0000","last_became_peered":"2024-09-17T01:59:09.346790+0000","last_unstale":"2024-09-17T01:59:21.825523+0000","last_undegraded":"2024-09-17T01:59:09.259034+0000","last_fullsized":"2024-09-17T01:59:09.253040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":233,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825464+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:21.825464+0000","last_peered":"2024-09-17T01:59:21.825464+0000","last_clean":"2024-09-17T01:59:21.825464+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:21.825464+0000","last_undegraded":"2024-09-17T01:59:21.825464+0000","last_fullsized":"2024-09-17T01:59:21.825464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":617,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826125+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:21.826125+0000","last_peered":"2024-09-17T01:59:21.826125+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:21.826125+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345416+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:21.345416+0000","last_peered":"2024-09-17T01:59:21.345416+0000","last_clean":"2024-09-17T01:59:21.345416+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:21.345416+0000","last_undegraded":"2024-09-17T01:59:21.345416+0000","last_fullsized":"2024-09-17T01:59:21.345416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348504+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:21.348504+0000","last_peered":"2024-09-17T01:59:21.348504+0000","last_clean":"2024-09-17T01:59:21.348504+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:21.348504+0000","last_undegraded":"2024-09-17T01:59:21.348504+0000","last_fullsized":"2024-09-17T01:59:21.348504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":586,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824852+0000","last_change":"2024-09-17T01:59:09.350752+0000","last_active":"2024-09-17T01:59:21.824852+0000","last_peered":"2024-09-17T01:59:21.824852+0000","last_clean":"2024-09-17T01:56:19.149880+0000","last_became_active":"2024-09-17T01:59:09.345019+0000","last_became_peered":"2024-09-17T01:59:09.345019+0000","last_unstale":"2024-09-17T01:59:21.824852+0000","last_undegraded":"2024-09-17T01:59:09.238653+0000","last_fullsized":"2024-09-17T01:59:09.221148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":426,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827130+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:21.827130+0000","last_peered":"2024-09-17T01:59:21.827130+0000","last_clean":"2024-09-17T01:59:21.827130+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:21.827130+0000","last_undegraded":"2024-09-17T01:59:21.827130+0000","last_fullsized":"2024-09-17T01:59:21.827130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":619,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825080+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:21.825080+0000","last_peered":"2024-09-17T01:59:21.825080+0000","last_clean":"2024-09-17T01:59:21.825080+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:21.825080+0000","last_undegraded":"2024-09-17T01:59:21.825080+0000","last_fullsized":"2024-09-17T01:59:21.825080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347987+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:21.347987+0000","last_peered":"2024-09-17T01:59:21.347987+0000","last_clean":"2024-09-17T01:59:21.347987+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:21.347987+0000","last_undegraded":"2024-09-17T01:59:21.347987+0000","last_fullsized":"2024-09-17T01:59:21.347987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":664,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823894+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:21.823894+0000","last_peered":"2024-09-17T01:59:21.823894+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:21.823894+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347498+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:21.347498+0000","last_peered":"2024-09-17T01:59:21.347498+0000","last_clean":"2024-09-17T01:59:21.347498+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:21.347498+0000","last_undegraded":"2024-09-17T01:59:21.347498+0000","last_fullsized":"2024-09-17T01:59:21.347498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":975,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824252+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:21.824252+0000","last_peered":"2024-09-17T01:59:21.824252+0000","last_clean":"2024-09-17T01:59:21.824252+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:21.824252+0000","last_undegraded":"2024-09-17T01:59:21.824252+0000","last_fullsized":"2024-09-17T01:59:21.824252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":318,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825397+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:21.825397+0000","last_peered":"2024-09-17T01:59:21.825397+0000","last_clean":"2024-09-17T01:59:21.825397+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:21.825397+0000","last_undegraded":"2024-09-17T01:59:21.825397+0000","last_fullsized":"2024-09-17T01:59:21.825397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":636,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824001+0000","last_change":"2024-09-17T01:59:09.354142+0000","last_active":"2024-09-17T01:59:21.824001+0000","last_peered":"2024-09-17T01:59:21.824001+0000","last_clean":"2024-09-17T01:56:19.230450+0000","last_became_active":"2024-09-17T01:59:09.346035+0000","last_became_peered":"2024-09-17T01:59:09.346035+0000","last_unstale":"2024-09-17T01:59:21.824001+0000","last_undegraded":"2024-09-17T01:59:09.240022+0000","last_fullsized":"2024-09-17T01:59:09.217749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":203,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346023+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:21.346023+0000","last_peered":"2024-09-17T01:59:21.346023+0000","last_clean":"2024-09-17T01:59:21.346023+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:21.346023+0000","last_undegraded":"2024-09-17T01:59:21.346023+0000","last_fullsized":"2024-09-17T01:59:21.346023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":687,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.828077+0000","last_change":"2024-09-17T01:59:09.358162+0000","last_active":"2024-09-17T01:59:21.828077+0000","last_peered":"2024-09-17T01:59:21.828077+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:21.828077+0000","last_undegraded":"2024-09-17T01:59:09.257380+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":207,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825548+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:21.825548+0000","last_peered":"2024-09-17T01:59:21.825548+0000","last_clean":"2024-09-17T01:59:21.825548+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:21.825548+0000","last_undegraded":"2024-09-17T01:59:21.825548+0000","last_fullsized":"2024-09-17T01:59:21.825548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":542,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348667+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:21.348667+0000","last_peered":"2024-09-17T01:59:21.348667+0000","last_clean":"2024-09-17T01:59:21.348667+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:21.348667+0000","last_undegraded":"2024-09-17T01:59:21.348667+0000","last_fullsized":"2024-09-17T01:59:21.348667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":602,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825081+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:21.825081+0000","last_peered":"2024-09-17T01:59:21.825081+0000","last_clean":"2024-09-17T01:59:21.825081+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:21.825081+0000","last_undegraded":"2024-09-17T01:59:21.825081+0000","last_fullsized":"2024-09-17T01:59:21.825081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":579,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826519+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:21.826519+0000","last_peered":"2024-09-17T01:59:21.826519+0000","last_clean":"2024-09-17T01:59:21.826519+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:21.826519+0000","last_undegraded":"2024-09-17T01:59:21.826519+0000","last_fullsized":"2024-09-17T01:59:21.826519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":245,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345206+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:21.345206+0000","last_peered":"2024-09-17T01:59:21.345206+0000","last_clean":"2024-09-17T01:59:21.345206+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:21.345206+0000","last_undegraded":"2024-09-17T01:59:21.345206+0000","last_fullsized":"2024-09-17T01:59:21.345206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346082+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:21.346082+0000","last_peered":"2024-09-17T01:59:21.346082+0000","last_clean":"2024-09-17T01:59:21.346082+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:21.346082+0000","last_undegraded":"2024-09-17T01:59:21.346082+0000","last_fullsized":"2024-09-17T01:59:21.346082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346542+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:21.346542+0000","last_peered":"2024-09-17T01:59:21.346542+0000","last_clean":"2024-09-17T01:59:21.346542+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:21.346542+0000","last_undegraded":"2024-09-17T01:59:21.346542+0000","last_fullsized":"2024-09-17T01:59:21.346542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":606,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.827503+0000","last_change":"2024-09-17T01:59:09.355911+0000","last_active":"2024-09-17T01:59:21.827503+0000","last_peered":"2024-09-17T01:59:21.827503+0000","last_clean":"2024-09-17T01:56:19.185411+0000","last_became_active":"2024-09-17T01:59:09.349985+0000","last_became_peered":"2024-09-17T01:59:09.349985+0000","last_unstale":"2024-09-17T01:59:21.827503+0000","last_undegraded":"2024-09-17T01:59:09.252095+0000","last_fullsized":"2024-09-17T01:59:09.248489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345878+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:21.345878+0000","last_peered":"2024-09-17T01:59:21.345878+0000","last_clean":"2024-09-17T01:59:21.345878+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:21.345878+0000","last_undegraded":"2024-09-17T01:59:21.345878+0000","last_fullsized":"2024-09-17T01:59:21.345878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823481+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:21.823481+0000","last_peered":"2024-09-17T01:59:21.823481+0000","last_clean":"2024-09-17T01:59:21.823481+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:21.823481+0000","last_undegraded":"2024-09-17T01:59:21.823481+0000","last_fullsized":"2024-09-17T01:59:21.823481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":680,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826913+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:21.826913+0000","last_peered":"2024-09-17T01:59:21.826913+0000","last_clean":"2024-09-17T01:59:21.826913+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:21.826913+0000","last_undegraded":"2024-09-17T01:59:21.826913+0000","last_fullsized":"2024-09-17T01:59:21.826913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823723+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:21.823723+0000","last_peered":"2024-09-17T01:59:21.823723+0000","last_clean":"2024-09-17T01:59:21.823723+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:21.823723+0000","last_undegraded":"2024-09-17T01:59:21.823723+0000","last_fullsized":"2024-09-17T01:59:21.823723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":582,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825403+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:21.825403+0000","last_peered":"2024-09-17T01:59:21.825403+0000","last_clean":"2024-09-17T01:59:21.825403+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:21.825403+0000","last_undegraded":"2024-09-17T01:59:21.825403+0000","last_fullsized":"2024-09-17T01:59:21.825403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":542,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826758+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:21.826758+0000","last_peered":"2024-09-17T01:59:21.826758+0000","last_clean":"2024-09-17T01:59:21.826758+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:21.826758+0000","last_undegraded":"2024-09-17T01:59:21.826758+0000","last_fullsized":"2024-09-17T01:59:21.826758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345548+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:21.345548+0000","last_peered":"2024-09-17T01:59:21.345548+0000","last_clean":"2024-09-17T01:59:21.345548+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:21.345548+0000","last_undegraded":"2024-09-17T01:59:21.345548+0000","last_fullsized":"2024-09-17T01:59:21.345548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345972+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:21.345972+0000","last_peered":"2024-09-17T01:59:21.345972+0000","last_clean":"2024-09-17T01:59:21.345972+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:21.345972+0000","last_undegraded":"2024-09-17T01:59:21.345972+0000","last_fullsized":"2024-09-17T01:59:21.345972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":587,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825563+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:21.825563+0000","last_peered":"2024-09-17T01:59:21.825563+0000","last_clean":"2024-09-17T01:59:21.825563+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:21.825563+0000","last_undegraded":"2024-09-17T01:59:21.825563+0000","last_fullsized":"2024-09-17T01:59:21.825563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":359,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347234+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:21.347234+0000","last_peered":"2024-09-17T01:59:21.347234+0000","last_clean":"2024-09-17T01:59:21.347234+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:21.347234+0000","last_undegraded":"2024-09-17T01:59:21.347234+0000","last_fullsized":"2024-09-17T01:59:21.347234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826221+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:21.826221+0000","last_peered":"2024-09-17T01:59:21.826221+0000","last_clean":"2024-09-17T01:59:21.826221+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:21.826221+0000","last_undegraded":"2024-09-17T01:59:21.826221+0000","last_fullsized":"2024-09-17T01:59:21.826221+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":557,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825655+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:21.825655+0000","last_peered":"2024-09-17T01:59:21.825655+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:21.825655+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":207,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826152+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:21.826152+0000","last_peered":"2024-09-17T01:59:21.826152+0000","last_clean":"2024-09-17T01:59:21.826152+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:21.826152+0000","last_undegraded":"2024-09-17T01:59:21.826152+0000","last_fullsized":"2024-09-17T01:59:21.826152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828700+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:21.828700+0000","last_peered":"2024-09-17T01:59:21.828700+0000","last_clean":"2024-09-17T01:59:21.828700+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:21.828700+0000","last_undegraded":"2024-09-17T01:59:21.828700+0000","last_fullsized":"2024-09-17T01:59:21.828700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":977,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.834309+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:21.834309+0000","last_peered":"2024-09-17T01:59:21.834309+0000","last_clean":"2024-09-17T01:59:21.834309+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:21.834309+0000","last_undegraded":"2024-09-17T01:59:21.834309+0000","last_fullsized":"2024-09-17T01:59:21.834309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827138+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:21.827138+0000","last_peered":"2024-09-17T01:59:21.827138+0000","last_clean":"2024-09-17T01:59:21.827138+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:21.827138+0000","last_undegraded":"2024-09-17T01:59:21.827138+0000","last_fullsized":"2024-09-17T01:59:21.827138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826202+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:21.826202+0000","last_peered":"2024-09-17T01:59:21.826202+0000","last_clean":"2024-09-17T01:59:21.826202+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:21.826202+0000","last_undegraded":"2024-09-17T01:59:21.826202+0000","last_fullsized":"2024-09-17T01:59:21.826202+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":584,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823818+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:21.823818+0000","last_peered":"2024-09-17T01:59:21.823818+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:21.823818+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":274,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825739+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:21.825739+0000","last_peered":"2024-09-17T01:59:21.825739+0000","last_clean":"2024-09-17T01:59:21.825739+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:21.825739+0000","last_undegraded":"2024-09-17T01:59:21.825739+0000","last_fullsized":"2024-09-17T01:59:21.825739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347662+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:21.347662+0000","last_peered":"2024-09-17T01:59:21.347662+0000","last_clean":"2024-09-17T01:59:21.347662+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:21.347662+0000","last_undegraded":"2024-09-17T01:59:21.347662+0000","last_fullsized":"2024-09-17T01:59:21.347662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1011,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825232+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:21.825232+0000","last_peered":"2024-09-17T01:59:21.825232+0000","last_clean":"2024-09-17T01:59:21.825232+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:21.825232+0000","last_undegraded":"2024-09-17T01:59:21.825232+0000","last_fullsized":"2024-09-17T01:59:21.825232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":578,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346595+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:21.346595+0000","last_peered":"2024-09-17T01:59:21.346595+0000","last_clean":"2024-09-17T01:59:21.346595+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:21.346595+0000","last_undegraded":"2024-09-17T01:59:21.346595+0000","last_fullsized":"2024-09-17T01:59:21.346595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":401,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347046+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:21.347046+0000","last_peered":"2024-09-17T01:59:21.347046+0000","last_clean":"2024-09-17T01:59:21.347046+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:21.347046+0000","last_undegraded":"2024-09-17T01:59:21.347046+0000","last_fullsized":"2024-09-17T01:59:21.347046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":635,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823265+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:21.823265+0000","last_peered":"2024-09-17T01:59:21.823265+0000","last_clean":"2024-09-17T01:59:21.823265+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:21.823265+0000","last_undegraded":"2024-09-17T01:59:21.823265+0000","last_fullsized":"2024-09-17T01:59:21.823265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":241,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828159+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:21.828159+0000","last_peered":"2024-09-17T01:59:21.828159+0000","last_clean":"2024-09-17T01:59:21.828159+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:21.828159+0000","last_undegraded":"2024-09-17T01:59:21.828159+0000","last_fullsized":"2024-09-17T01:59:21.828159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":295,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348200+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:21.348200+0000","last_peered":"2024-09-17T01:59:21.348200+0000","last_clean":"2024-09-17T01:59:21.348200+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:21.348200+0000","last_undegraded":"2024-09-17T01:59:21.348200+0000","last_fullsized":"2024-09-17T01:59:21.348200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":725,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822751+0000","last_change":"2024-09-17T01:59:09.361052+0000","last_active":"2024-09-17T01:59:21.822751+0000","last_peered":"2024-09-17T01:59:21.822751+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:21.822751+0000","last_undegraded":"2024-09-17T01:59:09.243588+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":206,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826995+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:21.826995+0000","last_peered":"2024-09-17T01:59:21.826995+0000","last_clean":"2024-09-17T01:59:21.826995+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:21.826995+0000","last_undegraded":"2024-09-17T01:59:21.826995+0000","last_fullsized":"2024-09-17T01:59:21.826995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":662,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823730+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:21.823730+0000","last_peered":"2024-09-17T01:59:21.823730+0000","last_clean":"2024-09-17T01:59:21.823730+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:21.823730+0000","last_undegraded":"2024-09-17T01:59:21.823730+0000","last_fullsized":"2024-09-17T01:59:21.823730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":849,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827209+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:21.827209+0000","last_peered":"2024-09-17T01:59:21.827209+0000","last_clean":"2024-09-17T01:59:21.827209+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:21.827209+0000","last_undegraded":"2024-09-17T01:59:21.827209+0000","last_fullsized":"2024-09-17T01:59:21.827209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":773,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824029+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:21.824029+0000","last_peered":"2024-09-17T01:59:21.824029+0000","last_clean":"2024-09-17T01:59:21.824029+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:21.824029+0000","last_undegraded":"2024-09-17T01:59:21.824029+0000","last_fullsized":"2024-09-17T01:59:21.824029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":932,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824824+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:21.824824+0000","last_peered":"2024-09-17T01:59:21.824824+0000","last_clean":"2024-09-17T01:59:21.824824+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:21.824824+0000","last_undegraded":"2024-09-17T01:59:21.824824+0000","last_fullsized":"2024-09-17T01:59:21.824824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":361,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823149+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:21.823149+0000","last_peered":"2024-09-17T01:59:21.823149+0000","last_clean":"2024-09-17T01:59:21.823149+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:21.823149+0000","last_undegraded":"2024-09-17T01:59:21.823149+0000","last_fullsized":"2024-09-17T01:59:21.823149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":583,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.827433+0000","last_change":"2024-09-17T01:59:09.355604+0000","last_active":"2024-09-17T01:59:21.827433+0000","last_peered":"2024-09-17T01:59:21.827433+0000","last_clean":"2024-09-17T01:56:19.136297+0000","last_became_active":"2024-09-17T01:59:09.347969+0000","last_became_peered":"2024-09-17T01:59:09.347969+0000","last_unstale":"2024-09-17T01:59:21.827433+0000","last_undegraded":"2024-09-17T01:59:09.248244+0000","last_fullsized":"2024-09-17T01:59:09.223371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":419,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826314+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:21.826314+0000","last_peered":"2024-09-17T01:59:21.826314+0000","last_clean":"2024-09-17T01:59:21.826314+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:21.826314+0000","last_undegraded":"2024-09-17T01:59:21.826314+0000","last_fullsized":"2024-09-17T01:59:21.826314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":559,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828020+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:21.828020+0000","last_peered":"2024-09-17T01:59:21.828020+0000","last_clean":"2024-09-17T01:59:21.828020+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:21.828020+0000","last_undegraded":"2024-09-17T01:59:21.828020+0000","last_fullsized":"2024-09-17T01:59:21.828020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":208,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827623+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:21.827623+0000","last_peered":"2024-09-17T01:59:21.827623+0000","last_clean":"2024-09-17T01:59:21.827623+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:21.827623+0000","last_undegraded":"2024-09-17T01:59:21.827623+0000","last_fullsized":"2024-09-17T01:59:21.827623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346589+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:21.346589+0000","last_peered":"2024-09-17T01:59:21.346589+0000","last_clean":"2024-09-17T01:59:21.346589+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:21.346589+0000","last_undegraded":"2024-09-17T01:59:21.346589+0000","last_fullsized":"2024-09-17T01:59:21.346589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347208+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:21.347208+0000","last_peered":"2024-09-17T01:59:21.347208+0000","last_clean":"2024-09-17T01:59:21.347208+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:21.347208+0000","last_undegraded":"2024-09-17T01:59:21.347208+0000","last_fullsized":"2024-09-17T01:59:21.347208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":554,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823578+0000","last_change":"2024-09-17T01:59:09.359162+0000","last_active":"2024-09-17T01:59:21.823578+0000","last_peered":"2024-09-17T01:59:21.823578+0000","last_clean":"2024-09-17T01:56:19.006818+0000","last_became_active":"2024-09-17T01:59:09.351483+0000","last_became_peered":"2024-09-17T01:59:09.351483+0000","last_unstale":"2024-09-17T01:59:21.823578+0000","last_undegraded":"2024-09-17T01:59:09.240046+0000","last_fullsized":"2024-09-17T01:59:09.225735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":433,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827918+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:21.827918+0000","last_peered":"2024-09-17T01:59:21.827918+0000","last_clean":"2024-09-17T01:59:21.827918+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:21.827918+0000","last_undegraded":"2024-09-17T01:59:21.827918+0000","last_fullsized":"2024-09-17T01:59:21.827918+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":654,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825920+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:21.825920+0000","last_peered":"2024-09-17T01:59:21.825920+0000","last_clean":"2024-09-17T01:59:21.825920+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:21.825920+0000","last_undegraded":"2024-09-17T01:59:21.825920+0000","last_fullsized":"2024-09-17T01:59:21.825920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":189,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825399+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:21.825399+0000","last_peered":"2024-09-17T01:59:21.825399+0000","last_clean":"2024-09-17T01:59:21.825399+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:21.825399+0000","last_undegraded":"2024-09-17T01:59:21.825399+0000","last_fullsized":"2024-09-17T01:59:21.825399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":694,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822141+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:21.822141+0000","last_peered":"2024-09-17T01:59:21.822141+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:21.822141+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826875+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:21.826875+0000","last_peered":"2024-09-17T01:59:21.826875+0000","last_clean":"2024-09-17T01:59:21.826875+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:21.826875+0000","last_undegraded":"2024-09-17T01:59:21.826875+0000","last_fullsized":"2024-09-17T01:59:21.826875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2977,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23330816,"data_stored":22647183,"data_compressed":2044511,"data_compressed_allocated":2809856,"data_compressed_original":10334208,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678021,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72696,"kb_used_data":35428,"kb_used_omap":174,"kb_used_meta":37073,"kb_avail":94299144,"statfs":{"total":96636764160,"available":96562323456,"internally_reserved":0,"allocated":36278272,"data_stored":121825650,"data_compressed":10099268,"data_compressed_allocated":14524416,"data_compressed_original":108826624,"omap_allocated":179054,"internal_metadata":37962898},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95116,"kb_used_data":23732,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276724,"statfs":{"total":96636764160,"available":96539365376,"internally_reserved":0,"allocated":24301568,"data_stored":84979137,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91740,"kb_used_data":20356,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94280100,"statfs":{"total":96636764160,"available":96542822400,"internally_reserved":0,"allocated":20844544,"data_stored":73136461,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23330816,"data_stored":22647183,"data_compressed":2044511,"data_compressed_allocated":2809856,"data_compressed_original":10334208,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:24.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:59:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:24.477 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 4122/114 objects degraded (3615.789%), 23 pgs degraded","count":23},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":302,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":88,"num_osds":3,"num_up_osds":3,"osd_up_since":1726538347,"num_in_osds":3,"osd_in_since":1726538063,"num_remapped_pgs":21},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":23},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128027436,"bytes_used":265748480,"bytes_avail":289644544000,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":4122,"degraded_total":114,"degraded_ratio":36.157894736842103,"recovering_objects_per_sec":343,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1375,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T01:55:53.990553+0000","services":{}},"progress_events":{}} 2024-09-17T01:59:24.496 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-17T01:59:24.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:24.792 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:24.807 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-17T01:59:24.093678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2999,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":259552,"kb_used_data":79516,"kb_used_omap":177,"kb_used_meta":179790,"kb_avail":282855968,"statfs":{"total":289910292480,"available":289644511232,"internally_reserved":0,"allocated":81424384,"data_stored":279941248,"data_compressed":21759347,"data_compressed_allocated":34959360,"data_compressed_original":243089408,"omap_allocated":182244,"internal_metadata":184104988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1233,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1499,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001271"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":639,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826848+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:21.826848+0000","last_peered":"2024-09-17T01:59:21.826848+0000","last_clean":"2024-09-17T01:59:21.826848+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:21.826848+0000","last_undegraded":"2024-09-17T01:59:21.826848+0000","last_fullsized":"2024-09-17T01:59:21.826848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":632,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826012+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:21.826012+0000","last_peered":"2024-09-17T01:59:21.826012+0000","last_clean":"2024-09-17T01:59:21.826012+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:21.826012+0000","last_undegraded":"2024-09-17T01:59:21.826012+0000","last_fullsized":"2024-09-17T01:59:21.826012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":519,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826430+0000","last_change":"2024-09-17T01:59:09.353894+0000","last_active":"2024-09-17T01:59:21.826430+0000","last_peered":"2024-09-17T01:59:21.826430+0000","last_clean":"2024-09-17T01:56:19.055461+0000","last_became_active":"2024-09-17T01:59:09.346926+0000","last_became_peered":"2024-09-17T01:59:09.346926+0000","last_unstale":"2024-09-17T01:59:21.826430+0000","last_undegraded":"2024-09-17T01:59:09.247998+0000","last_fullsized":"2024-09-17T01:59:09.238269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":159,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":565,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824731+0000","last_change":"2024-09-17T01:59:09.355212+0000","last_active":"2024-09-17T01:59:21.824731+0000","last_peered":"2024-09-17T01:59:21.824731+0000","last_clean":"2024-09-17T01:56:18.963805+0000","last_became_active":"2024-09-17T01:59:09.348164+0000","last_became_peered":"2024-09-17T01:59:09.348164+0000","last_unstale":"2024-09-17T01:59:21.824731+0000","last_undegraded":"2024-09-17T01:59:09.246790+0000","last_fullsized":"2024-09-17T01:59:09.237643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":636,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827351+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:21.827351+0000","last_peered":"2024-09-17T01:59:21.827351+0000","last_clean":"2024-09-17T01:59:21.827351+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:21.827351+0000","last_undegraded":"2024-09-17T01:59:21.827351+0000","last_fullsized":"2024-09-17T01:59:21.827351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":582,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822638+0000","last_change":"2024-09-17T01:59:09.360065+0000","last_active":"2024-09-17T01:59:21.822638+0000","last_peered":"2024-09-17T01:59:21.822638+0000","last_clean":"2024-09-17T01:56:19.050631+0000","last_became_active":"2024-09-17T01:59:09.350052+0000","last_became_peered":"2024-09-17T01:59:09.350052+0000","last_unstale":"2024-09-17T01:59:21.822638+0000","last_undegraded":"2024-09-17T01:59:09.234190+0000","last_fullsized":"2024-09-17T01:59:09.216778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346638+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:21.346638+0000","last_peered":"2024-09-17T01:59:21.346638+0000","last_clean":"2024-09-17T01:59:21.346638+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:21.346638+0000","last_undegraded":"2024-09-17T01:59:21.346638+0000","last_fullsized":"2024-09-17T01:59:21.346638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":547,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822887+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:21.822887+0000","last_peered":"2024-09-17T01:59:21.822887+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:21.822887+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":596,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824770+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:21.824770+0000","last_peered":"2024-09-17T01:59:21.824770+0000","last_clean":"2024-09-17T01:59:21.824770+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:21.824770+0000","last_undegraded":"2024-09-17T01:59:21.824770+0000","last_fullsized":"2024-09-17T01:59:21.824770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":562,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826295+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:21.826295+0000","last_peered":"2024-09-17T01:59:21.826295+0000","last_clean":"2024-09-17T01:59:21.826295+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:21.826295+0000","last_undegraded":"2024-09-17T01:59:21.826295+0000","last_fullsized":"2024-09-17T01:59:21.826295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.358668+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:21.358668+0000","last_peered":"2024-09-17T01:59:21.358668+0000","last_clean":"2024-09-17T01:59:21.358668+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:21.358668+0000","last_undegraded":"2024-09-17T01:59:21.358668+0000","last_fullsized":"2024-09-17T01:59:21.358668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":845,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827814+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:21.827814+0000","last_peered":"2024-09-17T01:59:21.827814+0000","last_clean":"2024-09-17T01:59:21.827814+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:21.827814+0000","last_undegraded":"2024-09-17T01:59:21.827814+0000","last_fullsized":"2024-09-17T01:59:21.827814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":538,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826042+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:21.826042+0000","last_peered":"2024-09-17T01:59:21.826042+0000","last_clean":"2024-09-17T01:59:21.826042+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:21.826042+0000","last_undegraded":"2024-09-17T01:59:21.826042+0000","last_fullsized":"2024-09-17T01:59:21.826042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":651,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824995+0000","last_change":"2024-09-17T01:59:09.356914+0000","last_active":"2024-09-17T01:59:21.824995+0000","last_peered":"2024-09-17T01:59:21.824995+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:59:09.352444+0000","last_became_peered":"2024-09-17T01:59:09.352444+0000","last_unstale":"2024-09-17T01:59:21.824995+0000","last_undegraded":"2024-09-17T01:59:09.251613+0000","last_fullsized":"2024-09-17T01:59:09.242492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346626+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:21.346626+0000","last_peered":"2024-09-17T01:59:21.346626+0000","last_clean":"2024-09-17T01:59:21.346626+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:21.346626+0000","last_undegraded":"2024-09-17T01:59:21.346626+0000","last_fullsized":"2024-09-17T01:59:21.346626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":660,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822797+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:21.822797+0000","last_peered":"2024-09-17T01:59:21.822797+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:21.822797+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":559,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827069+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:21.827069+0000","last_peered":"2024-09-17T01:59:21.827069+0000","last_clean":"2024-09-17T01:59:21.827069+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:21.827069+0000","last_undegraded":"2024-09-17T01:59:21.827069+0000","last_fullsized":"2024-09-17T01:59:21.827069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":588,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826814+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:21.826814+0000","last_peered":"2024-09-17T01:59:21.826814+0000","last_clean":"2024-09-17T01:59:21.826814+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:21.826814+0000","last_undegraded":"2024-09-17T01:59:21.826814+0000","last_fullsized":"2024-09-17T01:59:21.826814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":644,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824559+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:21.824559+0000","last_peered":"2024-09-17T01:59:21.824559+0000","last_clean":"2024-09-17T01:59:21.824559+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:21.824559+0000","last_undegraded":"2024-09-17T01:59:21.824559+0000","last_fullsized":"2024-09-17T01:59:21.824559+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":651,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-17T01:59:21.348754+0000","last_change":"2024-09-17T01:59:21.348754+0000","last_active":"2024-09-17T01:59:08.220906+0000","last_peered":"2024-09-17T01:59:06.601049+0000","last_clean":"2024-09-17T01:56:18.977276+0000","last_became_active":"2024-09-17T01:56:20.332766+0000","last_became_peered":"2024-09-17T01:56:20.332766+0000","last_unstale":"2024-09-17T01:59:21.348754+0000","last_undegraded":"2024-09-17T01:59:21.348754+0000","last_fullsized":"2024-09-17T01:59:21.348754+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":566,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825283+0000","last_change":"2024-09-17T01:59:09.360583+0000","last_active":"2024-09-17T01:59:21.825283+0000","last_peered":"2024-09-17T01:59:21.825283+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:59:09.352921+0000","last_became_peered":"2024-09-17T01:59:09.352921+0000","last_unstale":"2024-09-17T01:59:21.825283+0000","last_undegraded":"2024-09-17T01:59:09.257578+0000","last_fullsized":"2024-09-17T01:59:09.251871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":746,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825491+0000","last_change":"2024-09-17T01:59:09.353921+0000","last_active":"2024-09-17T01:59:21.825491+0000","last_peered":"2024-09-17T01:59:21.825491+0000","last_clean":"2024-09-17T01:56:19.175808+0000","last_became_active":"2024-09-17T01:59:09.347955+0000","last_became_peered":"2024-09-17T01:59:09.347955+0000","last_unstale":"2024-09-17T01:59:21.825491+0000","last_undegraded":"2024-09-17T01:59:09.242382+0000","last_fullsized":"2024-09-17T01:59:09.221213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1043,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.822382+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:21.822382+0000","last_peered":"2024-09-17T01:59:21.822382+0000","last_clean":"2024-09-17T01:59:21.822382+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:21.822382+0000","last_undegraded":"2024-09-17T01:59:21.822382+0000","last_fullsized":"2024-09-17T01:59:21.822382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":636,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824775+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:21.824775+0000","last_peered":"2024-09-17T01:59:21.824775+0000","last_clean":"2024-09-17T01:59:21.824775+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:21.824775+0000","last_undegraded":"2024-09-17T01:59:21.824775+0000","last_fullsized":"2024-09-17T01:59:21.824775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":986,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826849+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:21.826849+0000","last_peered":"2024-09-17T01:59:21.826849+0000","last_clean":"2024-09-17T01:59:21.826849+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:21.826849+0000","last_undegraded":"2024-09-17T01:59:21.826849+0000","last_fullsized":"2024-09-17T01:59:21.826849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1066,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825097+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:21.825097+0000","last_peered":"2024-09-17T01:59:21.825097+0000","last_clean":"2024-09-17T01:59:21.825097+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:21.825097+0000","last_undegraded":"2024-09-17T01:59:21.825097+0000","last_fullsized":"2024-09-17T01:59:21.825097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":580,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.828640+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:21.828640+0000","last_peered":"2024-09-17T01:59:21.828640+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:21.828640+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":929,"reported_epoch":85,"state":"peering","last_fresh":"2024-09-17T01:59:21.336435+0000","last_change":"2024-09-17T01:59:21.827888+0000","last_active":"2024-09-17T01:59:21.827888+0000","last_peered":"2024-09-17T01:59:21.336435+0000","last_clean":"2024-09-17T01:56:19.097605+0000","last_became_active":"2024-09-17T01:59:09.342592+0000","last_became_peered":"2024-09-17T01:59:09.342592+0000","last_unstale":"2024-09-17T01:59:21.336435+0000","last_undegraded":"2024-09-17T01:59:21.336435+0000","last_fullsized":"2024-09-17T01:59:09.222164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":584,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824888+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:21.824888+0000","last_peered":"2024-09-17T01:59:21.824888+0000","last_clean":"2024-09-17T01:59:21.824888+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:21.824888+0000","last_undegraded":"2024-09-17T01:59:21.824888+0000","last_fullsized":"2024-09-17T01:59:21.824888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":624,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826255+0000","last_change":"2024-09-17T01:59:09.353611+0000","last_active":"2024-09-17T01:59:21.826255+0000","last_peered":"2024-09-17T01:59:21.826255+0000","last_clean":"2024-09-17T01:56:19.085369+0000","last_became_active":"2024-09-17T01:59:09.348190+0000","last_became_peered":"2024-09-17T01:59:09.348190+0000","last_unstale":"2024-09-17T01:59:21.826255+0000","last_undegraded":"2024-09-17T01:59:09.241825+0000","last_fullsized":"2024-09-17T01:59:09.221247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":645,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.822595+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:21.822595+0000","last_peered":"2024-09-17T01:59:21.822595+0000","last_clean":"2024-09-17T01:59:21.822595+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:21.822595+0000","last_undegraded":"2024-09-17T01:59:21.822595+0000","last_fullsized":"2024-09-17T01:59:21.822595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":1063,"reported_epoch":86,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:22.130263+0000","last_change":"2024-09-17T01:59:21.341088+0000","last_active":"2024-09-17T01:59:22.130263+0000","last_peered":"2024-09-17T01:59:22.130263+0000","last_clean":"2024-09-17T01:56:18.958056+0000","last_became_active":"2024-09-17T01:59:09.344792+0000","last_became_peered":"2024-09-17T01:59:09.344792+0000","last_unstale":"2024-09-17T01:59:22.130263+0000","last_undegraded":"2024-09-17T01:59:22.130263+0000","last_fullsized":"2024-09-17T01:59:09.216214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":611,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828170+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:21.828170+0000","last_peered":"2024-09-17T01:59:21.828170+0000","last_clean":"2024-09-17T01:59:21.828170+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:21.828170+0000","last_undegraded":"2024-09-17T01:59:21.828170+0000","last_fullsized":"2024-09-17T01:59:21.828170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":546,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346289+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:21.346289+0000","last_peered":"2024-09-17T01:59:21.346289+0000","last_clean":"2024-09-17T01:59:21.346289+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:21.346289+0000","last_undegraded":"2024-09-17T01:59:21.346289+0000","last_fullsized":"2024-09-17T01:59:21.346289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":633,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827769+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:21.827769+0000","last_peered":"2024-09-17T01:59:21.827769+0000","last_clean":"2024-09-17T01:59:21.827769+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:21.827769+0000","last_undegraded":"2024-09-17T01:59:21.827769+0000","last_fullsized":"2024-09-17T01:59:21.827769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":208,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823588+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:21.823588+0000","last_peered":"2024-09-17T01:59:21.823588+0000","last_clean":"2024-09-17T01:59:21.823588+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:21.823588+0000","last_undegraded":"2024-09-17T01:59:21.823588+0000","last_fullsized":"2024-09-17T01:59:21.823588+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":670,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825523+0000","last_change":"2024-09-17T01:59:09.359886+0000","last_active":"2024-09-17T01:59:21.825523+0000","last_peered":"2024-09-17T01:59:21.825523+0000","last_clean":"2024-09-17T01:56:19.307562+0000","last_became_active":"2024-09-17T01:59:09.346790+0000","last_became_peered":"2024-09-17T01:59:09.346790+0000","last_unstale":"2024-09-17T01:59:21.825523+0000","last_undegraded":"2024-09-17T01:59:09.259034+0000","last_fullsized":"2024-09-17T01:59:09.253040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":233,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825464+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:21.825464+0000","last_peered":"2024-09-17T01:59:21.825464+0000","last_clean":"2024-09-17T01:59:21.825464+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:21.825464+0000","last_undegraded":"2024-09-17T01:59:21.825464+0000","last_fullsized":"2024-09-17T01:59:21.825464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":617,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.826125+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:21.826125+0000","last_peered":"2024-09-17T01:59:21.826125+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:21.826125+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345416+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:21.345416+0000","last_peered":"2024-09-17T01:59:21.345416+0000","last_clean":"2024-09-17T01:59:21.345416+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:21.345416+0000","last_undegraded":"2024-09-17T01:59:21.345416+0000","last_fullsized":"2024-09-17T01:59:21.345416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348504+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:21.348504+0000","last_peered":"2024-09-17T01:59:21.348504+0000","last_clean":"2024-09-17T01:59:21.348504+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:21.348504+0000","last_undegraded":"2024-09-17T01:59:21.348504+0000","last_fullsized":"2024-09-17T01:59:21.348504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":586,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824852+0000","last_change":"2024-09-17T01:59:09.350752+0000","last_active":"2024-09-17T01:59:21.824852+0000","last_peered":"2024-09-17T01:59:21.824852+0000","last_clean":"2024-09-17T01:56:19.149880+0000","last_became_active":"2024-09-17T01:59:09.345019+0000","last_became_peered":"2024-09-17T01:59:09.345019+0000","last_unstale":"2024-09-17T01:59:21.824852+0000","last_undegraded":"2024-09-17T01:59:09.238653+0000","last_fullsized":"2024-09-17T01:59:09.221148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":426,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827130+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:21.827130+0000","last_peered":"2024-09-17T01:59:21.827130+0000","last_clean":"2024-09-17T01:59:21.827130+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:21.827130+0000","last_undegraded":"2024-09-17T01:59:21.827130+0000","last_fullsized":"2024-09-17T01:59:21.827130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":619,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825080+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:21.825080+0000","last_peered":"2024-09-17T01:59:21.825080+0000","last_clean":"2024-09-17T01:59:21.825080+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:21.825080+0000","last_undegraded":"2024-09-17T01:59:21.825080+0000","last_fullsized":"2024-09-17T01:59:21.825080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347987+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:21.347987+0000","last_peered":"2024-09-17T01:59:21.347987+0000","last_clean":"2024-09-17T01:59:21.347987+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:21.347987+0000","last_undegraded":"2024-09-17T01:59:21.347987+0000","last_fullsized":"2024-09-17T01:59:21.347987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":664,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823894+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:21.823894+0000","last_peered":"2024-09-17T01:59:21.823894+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:21.823894+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347498+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:21.347498+0000","last_peered":"2024-09-17T01:59:21.347498+0000","last_clean":"2024-09-17T01:59:21.347498+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:21.347498+0000","last_undegraded":"2024-09-17T01:59:21.347498+0000","last_fullsized":"2024-09-17T01:59:21.347498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":975,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824252+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:21.824252+0000","last_peered":"2024-09-17T01:59:21.824252+0000","last_clean":"2024-09-17T01:59:21.824252+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:21.824252+0000","last_undegraded":"2024-09-17T01:59:21.824252+0000","last_fullsized":"2024-09-17T01:59:21.824252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":318,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825397+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:21.825397+0000","last_peered":"2024-09-17T01:59:21.825397+0000","last_clean":"2024-09-17T01:59:21.825397+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:21.825397+0000","last_undegraded":"2024-09-17T01:59:21.825397+0000","last_fullsized":"2024-09-17T01:59:21.825397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":636,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.824001+0000","last_change":"2024-09-17T01:59:09.354142+0000","last_active":"2024-09-17T01:59:21.824001+0000","last_peered":"2024-09-17T01:59:21.824001+0000","last_clean":"2024-09-17T01:56:19.230450+0000","last_became_active":"2024-09-17T01:59:09.346035+0000","last_became_peered":"2024-09-17T01:59:09.346035+0000","last_unstale":"2024-09-17T01:59:21.824001+0000","last_undegraded":"2024-09-17T01:59:09.240022+0000","last_fullsized":"2024-09-17T01:59:09.217749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":203,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346023+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:21.346023+0000","last_peered":"2024-09-17T01:59:21.346023+0000","last_clean":"2024-09-17T01:59:21.346023+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:21.346023+0000","last_undegraded":"2024-09-17T01:59:21.346023+0000","last_fullsized":"2024-09-17T01:59:21.346023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":687,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.828077+0000","last_change":"2024-09-17T01:59:09.358162+0000","last_active":"2024-09-17T01:59:21.828077+0000","last_peered":"2024-09-17T01:59:21.828077+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:21.828077+0000","last_undegraded":"2024-09-17T01:59:09.257380+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":207,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825548+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:21.825548+0000","last_peered":"2024-09-17T01:59:21.825548+0000","last_clean":"2024-09-17T01:59:21.825548+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:21.825548+0000","last_undegraded":"2024-09-17T01:59:21.825548+0000","last_fullsized":"2024-09-17T01:59:21.825548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":542,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348667+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:21.348667+0000","last_peered":"2024-09-17T01:59:21.348667+0000","last_clean":"2024-09-17T01:59:21.348667+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:21.348667+0000","last_undegraded":"2024-09-17T01:59:21.348667+0000","last_fullsized":"2024-09-17T01:59:21.348667+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":602,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825081+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:21.825081+0000","last_peered":"2024-09-17T01:59:21.825081+0000","last_clean":"2024-09-17T01:59:21.825081+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:21.825081+0000","last_undegraded":"2024-09-17T01:59:21.825081+0000","last_fullsized":"2024-09-17T01:59:21.825081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":579,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826519+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:21.826519+0000","last_peered":"2024-09-17T01:59:21.826519+0000","last_clean":"2024-09-17T01:59:21.826519+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:21.826519+0000","last_undegraded":"2024-09-17T01:59:21.826519+0000","last_fullsized":"2024-09-17T01:59:21.826519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":245,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345206+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:21.345206+0000","last_peered":"2024-09-17T01:59:21.345206+0000","last_clean":"2024-09-17T01:59:21.345206+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:21.345206+0000","last_undegraded":"2024-09-17T01:59:21.345206+0000","last_fullsized":"2024-09-17T01:59:21.345206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346082+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:21.346082+0000","last_peered":"2024-09-17T01:59:21.346082+0000","last_clean":"2024-09-17T01:59:21.346082+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:21.346082+0000","last_undegraded":"2024-09-17T01:59:21.346082+0000","last_fullsized":"2024-09-17T01:59:21.346082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346542+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:21.346542+0000","last_peered":"2024-09-17T01:59:21.346542+0000","last_clean":"2024-09-17T01:59:21.346542+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:21.346542+0000","last_undegraded":"2024-09-17T01:59:21.346542+0000","last_fullsized":"2024-09-17T01:59:21.346542+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":606,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.827503+0000","last_change":"2024-09-17T01:59:09.355911+0000","last_active":"2024-09-17T01:59:21.827503+0000","last_peered":"2024-09-17T01:59:21.827503+0000","last_clean":"2024-09-17T01:56:19.185411+0000","last_became_active":"2024-09-17T01:59:09.349985+0000","last_became_peered":"2024-09-17T01:59:09.349985+0000","last_unstale":"2024-09-17T01:59:21.827503+0000","last_undegraded":"2024-09-17T01:59:09.252095+0000","last_fullsized":"2024-09-17T01:59:09.248489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345878+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:21.345878+0000","last_peered":"2024-09-17T01:59:21.345878+0000","last_clean":"2024-09-17T01:59:21.345878+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:21.345878+0000","last_undegraded":"2024-09-17T01:59:21.345878+0000","last_fullsized":"2024-09-17T01:59:21.345878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823481+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:21.823481+0000","last_peered":"2024-09-17T01:59:21.823481+0000","last_clean":"2024-09-17T01:59:21.823481+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:21.823481+0000","last_undegraded":"2024-09-17T01:59:21.823481+0000","last_fullsized":"2024-09-17T01:59:21.823481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":680,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826913+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:21.826913+0000","last_peered":"2024-09-17T01:59:21.826913+0000","last_clean":"2024-09-17T01:59:21.826913+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:21.826913+0000","last_undegraded":"2024-09-17T01:59:21.826913+0000","last_fullsized":"2024-09-17T01:59:21.826913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823723+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:21.823723+0000","last_peered":"2024-09-17T01:59:21.823723+0000","last_clean":"2024-09-17T01:59:21.823723+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:21.823723+0000","last_undegraded":"2024-09-17T01:59:21.823723+0000","last_fullsized":"2024-09-17T01:59:21.823723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":582,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825403+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:21.825403+0000","last_peered":"2024-09-17T01:59:21.825403+0000","last_clean":"2024-09-17T01:59:21.825403+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:21.825403+0000","last_undegraded":"2024-09-17T01:59:21.825403+0000","last_fullsized":"2024-09-17T01:59:21.825403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":542,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826758+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:21.826758+0000","last_peered":"2024-09-17T01:59:21.826758+0000","last_clean":"2024-09-17T01:59:21.826758+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:21.826758+0000","last_undegraded":"2024-09-17T01:59:21.826758+0000","last_fullsized":"2024-09-17T01:59:21.826758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345548+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:21.345548+0000","last_peered":"2024-09-17T01:59:21.345548+0000","last_clean":"2024-09-17T01:59:21.345548+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:21.345548+0000","last_undegraded":"2024-09-17T01:59:21.345548+0000","last_fullsized":"2024-09-17T01:59:21.345548+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.345972+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:21.345972+0000","last_peered":"2024-09-17T01:59:21.345972+0000","last_clean":"2024-09-17T01:59:21.345972+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:21.345972+0000","last_undegraded":"2024-09-17T01:59:21.345972+0000","last_fullsized":"2024-09-17T01:59:21.345972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":587,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825563+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:21.825563+0000","last_peered":"2024-09-17T01:59:21.825563+0000","last_clean":"2024-09-17T01:59:21.825563+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:21.825563+0000","last_undegraded":"2024-09-17T01:59:21.825563+0000","last_fullsized":"2024-09-17T01:59:21.825563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":359,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347234+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:21.347234+0000","last_peered":"2024-09-17T01:59:21.347234+0000","last_clean":"2024-09-17T01:59:21.347234+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:21.347234+0000","last_undegraded":"2024-09-17T01:59:21.347234+0000","last_fullsized":"2024-09-17T01:59:21.347234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826221+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:21.826221+0000","last_peered":"2024-09-17T01:59:21.826221+0000","last_clean":"2024-09-17T01:59:21.826221+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:21.826221+0000","last_undegraded":"2024-09-17T01:59:21.826221+0000","last_fullsized":"2024-09-17T01:59:21.826221+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":557,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.825655+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:21.825655+0000","last_peered":"2024-09-17T01:59:21.825655+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:21.825655+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":207,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826152+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:21.826152+0000","last_peered":"2024-09-17T01:59:21.826152+0000","last_clean":"2024-09-17T01:59:21.826152+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:21.826152+0000","last_undegraded":"2024-09-17T01:59:21.826152+0000","last_fullsized":"2024-09-17T01:59:21.826152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828700+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:21.828700+0000","last_peered":"2024-09-17T01:59:21.828700+0000","last_clean":"2024-09-17T01:59:21.828700+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:21.828700+0000","last_undegraded":"2024-09-17T01:59:21.828700+0000","last_fullsized":"2024-09-17T01:59:21.828700+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":977,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.834309+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:21.834309+0000","last_peered":"2024-09-17T01:59:21.834309+0000","last_clean":"2024-09-17T01:59:21.834309+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:21.834309+0000","last_undegraded":"2024-09-17T01:59:21.834309+0000","last_fullsized":"2024-09-17T01:59:21.834309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827138+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:21.827138+0000","last_peered":"2024-09-17T01:59:21.827138+0000","last_clean":"2024-09-17T01:59:21.827138+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:21.827138+0000","last_undegraded":"2024-09-17T01:59:21.827138+0000","last_fullsized":"2024-09-17T01:59:21.827138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826202+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:21.826202+0000","last_peered":"2024-09-17T01:59:21.826202+0000","last_clean":"2024-09-17T01:59:21.826202+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:21.826202+0000","last_undegraded":"2024-09-17T01:59:21.826202+0000","last_fullsized":"2024-09-17T01:59:21.826202+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":584,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823818+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:21.823818+0000","last_peered":"2024-09-17T01:59:21.823818+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:21.823818+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":274,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825739+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:21.825739+0000","last_peered":"2024-09-17T01:59:21.825739+0000","last_clean":"2024-09-17T01:59:21.825739+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:21.825739+0000","last_undegraded":"2024-09-17T01:59:21.825739+0000","last_fullsized":"2024-09-17T01:59:21.825739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347662+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:21.347662+0000","last_peered":"2024-09-17T01:59:21.347662+0000","last_clean":"2024-09-17T01:59:21.347662+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:21.347662+0000","last_undegraded":"2024-09-17T01:59:21.347662+0000","last_fullsized":"2024-09-17T01:59:21.347662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1011,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825232+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:21.825232+0000","last_peered":"2024-09-17T01:59:21.825232+0000","last_clean":"2024-09-17T01:59:21.825232+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:21.825232+0000","last_undegraded":"2024-09-17T01:59:21.825232+0000","last_fullsized":"2024-09-17T01:59:21.825232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":578,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346595+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:21.346595+0000","last_peered":"2024-09-17T01:59:21.346595+0000","last_clean":"2024-09-17T01:59:21.346595+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:21.346595+0000","last_undegraded":"2024-09-17T01:59:21.346595+0000","last_fullsized":"2024-09-17T01:59:21.346595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":401,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347046+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:21.347046+0000","last_peered":"2024-09-17T01:59:21.347046+0000","last_clean":"2024-09-17T01:59:21.347046+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:21.347046+0000","last_undegraded":"2024-09-17T01:59:21.347046+0000","last_fullsized":"2024-09-17T01:59:21.347046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":635,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823265+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:21.823265+0000","last_peered":"2024-09-17T01:59:21.823265+0000","last_clean":"2024-09-17T01:59:21.823265+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:21.823265+0000","last_undegraded":"2024-09-17T01:59:21.823265+0000","last_fullsized":"2024-09-17T01:59:21.823265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":241,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828159+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:21.828159+0000","last_peered":"2024-09-17T01:59:21.828159+0000","last_clean":"2024-09-17T01:59:21.828159+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:21.828159+0000","last_undegraded":"2024-09-17T01:59:21.828159+0000","last_fullsized":"2024-09-17T01:59:21.828159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":295,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.348200+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:21.348200+0000","last_peered":"2024-09-17T01:59:21.348200+0000","last_clean":"2024-09-17T01:59:21.348200+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:21.348200+0000","last_undegraded":"2024-09-17T01:59:21.348200+0000","last_fullsized":"2024-09-17T01:59:21.348200+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":725,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822751+0000","last_change":"2024-09-17T01:59:09.361052+0000","last_active":"2024-09-17T01:59:21.822751+0000","last_peered":"2024-09-17T01:59:21.822751+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:21.822751+0000","last_undegraded":"2024-09-17T01:59:09.243588+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":206,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826995+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:21.826995+0000","last_peered":"2024-09-17T01:59:21.826995+0000","last_clean":"2024-09-17T01:59:21.826995+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:21.826995+0000","last_undegraded":"2024-09-17T01:59:21.826995+0000","last_fullsized":"2024-09-17T01:59:21.826995+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":662,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823730+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:21.823730+0000","last_peered":"2024-09-17T01:59:21.823730+0000","last_clean":"2024-09-17T01:59:21.823730+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:21.823730+0000","last_undegraded":"2024-09-17T01:59:21.823730+0000","last_fullsized":"2024-09-17T01:59:21.823730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":849,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827209+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:21.827209+0000","last_peered":"2024-09-17T01:59:21.827209+0000","last_clean":"2024-09-17T01:59:21.827209+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:21.827209+0000","last_undegraded":"2024-09-17T01:59:21.827209+0000","last_fullsized":"2024-09-17T01:59:21.827209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":773,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824029+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:21.824029+0000","last_peered":"2024-09-17T01:59:21.824029+0000","last_clean":"2024-09-17T01:59:21.824029+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:21.824029+0000","last_undegraded":"2024-09-17T01:59:21.824029+0000","last_fullsized":"2024-09-17T01:59:21.824029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":932,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.824824+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:21.824824+0000","last_peered":"2024-09-17T01:59:21.824824+0000","last_clean":"2024-09-17T01:59:21.824824+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:21.824824+0000","last_undegraded":"2024-09-17T01:59:21.824824+0000","last_fullsized":"2024-09-17T01:59:21.824824+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":361,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.823149+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:21.823149+0000","last_peered":"2024-09-17T01:59:21.823149+0000","last_clean":"2024-09-17T01:59:21.823149+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:21.823149+0000","last_undegraded":"2024-09-17T01:59:21.823149+0000","last_fullsized":"2024-09-17T01:59:21.823149+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":583,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.827433+0000","last_change":"2024-09-17T01:59:09.355604+0000","last_active":"2024-09-17T01:59:21.827433+0000","last_peered":"2024-09-17T01:59:21.827433+0000","last_clean":"2024-09-17T01:56:19.136297+0000","last_became_active":"2024-09-17T01:59:09.347969+0000","last_became_peered":"2024-09-17T01:59:09.347969+0000","last_unstale":"2024-09-17T01:59:21.827433+0000","last_undegraded":"2024-09-17T01:59:09.248244+0000","last_fullsized":"2024-09-17T01:59:09.223371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":419,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826314+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:21.826314+0000","last_peered":"2024-09-17T01:59:21.826314+0000","last_clean":"2024-09-17T01:59:21.826314+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:21.826314+0000","last_undegraded":"2024-09-17T01:59:21.826314+0000","last_fullsized":"2024-09-17T01:59:21.826314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":559,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.828020+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:21.828020+0000","last_peered":"2024-09-17T01:59:21.828020+0000","last_clean":"2024-09-17T01:59:21.828020+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:21.828020+0000","last_undegraded":"2024-09-17T01:59:21.828020+0000","last_fullsized":"2024-09-17T01:59:21.828020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":208,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827623+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:21.827623+0000","last_peered":"2024-09-17T01:59:21.827623+0000","last_clean":"2024-09-17T01:59:21.827623+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:21.827623+0000","last_undegraded":"2024-09-17T01:59:21.827623+0000","last_fullsized":"2024-09-17T01:59:21.827623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.346589+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:21.346589+0000","last_peered":"2024-09-17T01:59:21.346589+0000","last_clean":"2024-09-17T01:59:21.346589+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:21.346589+0000","last_undegraded":"2024-09-17T01:59:21.346589+0000","last_fullsized":"2024-09-17T01:59:21.346589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.347208+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:21.347208+0000","last_peered":"2024-09-17T01:59:21.347208+0000","last_clean":"2024-09-17T01:59:21.347208+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:21.347208+0000","last_undegraded":"2024-09-17T01:59:21.347208+0000","last_fullsized":"2024-09-17T01:59:21.347208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":554,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823578+0000","last_change":"2024-09-17T01:59:09.359162+0000","last_active":"2024-09-17T01:59:21.823578+0000","last_peered":"2024-09-17T01:59:21.823578+0000","last_clean":"2024-09-17T01:56:19.006818+0000","last_became_active":"2024-09-17T01:59:09.351483+0000","last_became_peered":"2024-09-17T01:59:09.351483+0000","last_unstale":"2024-09-17T01:59:21.823578+0000","last_undegraded":"2024-09-17T01:59:09.240046+0000","last_fullsized":"2024-09-17T01:59:09.225735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":433,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.827918+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:21.827918+0000","last_peered":"2024-09-17T01:59:21.827918+0000","last_clean":"2024-09-17T01:59:21.827918+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:21.827918+0000","last_undegraded":"2024-09-17T01:59:21.827918+0000","last_fullsized":"2024-09-17T01:59:21.827918+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":654,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825920+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:21.825920+0000","last_peered":"2024-09-17T01:59:21.825920+0000","last_clean":"2024-09-17T01:59:21.825920+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:21.825920+0000","last_undegraded":"2024-09-17T01:59:21.825920+0000","last_fullsized":"2024-09-17T01:59:21.825920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":189,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.825399+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:21.825399+0000","last_peered":"2024-09-17T01:59:21.825399+0000","last_clean":"2024-09-17T01:59:21.825399+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:21.825399+0000","last_undegraded":"2024-09-17T01:59:21.825399+0000","last_fullsized":"2024-09-17T01:59:21.825399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":694,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.822141+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:21.822141+0000","last_peered":"2024-09-17T01:59:21.822141+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:21.822141+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":217,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T01:59:21.826875+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:21.826875+0000","last_peered":"2024-09-17T01:59:21.826875+0000","last_clean":"2024-09-17T01:59:21.826875+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:21.826875+0000","last_undegraded":"2024-09-17T01:59:21.826875+0000","last_fullsized":"2024-09-17T01:59:21.826875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4122,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2977,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23330816,"data_stored":22647183,"data_compressed":2044511,"data_compressed_allocated":2809856,"data_compressed_original":10334208,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":104,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678021,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72696,"kb_used_data":35428,"kb_used_omap":174,"kb_used_meta":37073,"kb_avail":94299144,"statfs":{"total":96636764160,"available":96562323456,"internally_reserved":0,"allocated":36278272,"data_stored":121825650,"data_compressed":10099268,"data_compressed_allocated":14524416,"data_compressed_original":108826624,"omap_allocated":179054,"internal_metadata":37962898},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95116,"kb_used_data":23732,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276724,"statfs":{"total":96636764160,"available":96539365376,"internally_reserved":0,"allocated":24301568,"data_stored":84979137,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91740,"kb_used_data":20356,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94280100,"statfs":{"total":96636764160,"available":96542822400,"internally_reserved":0,"allocated":20844544,"data_stored":73136461,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23330816,"data_stored":22647183,"data_compressed":2044511,"data_compressed_allocated":2809856,"data_compressed_original":10334208,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:27.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:28.142 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:28.144 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:28.161 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-17T01:59:28.094989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4106,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":193,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":246808,"kb_used_data":75084,"kb_used_omap":177,"kb_used_meta":171470,"kb_avail":282868712,"statfs":{"total":289910292480,"available":289657561088,"internally_reserved":0,"allocated":76886016,"data_stored":274396826,"data_compressed":21238279,"data_compressed_allocated":34148352,"data_compressed_original":239349760,"omap_allocated":182244,"internal_metadata":175585308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1291,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1107,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001310"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":649,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819637+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:26.819637+0000","last_peered":"2024-09-17T01:59:26.819637+0000","last_clean":"2024-09-17T01:59:26.819637+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:26.819637+0000","last_undegraded":"2024-09-17T01:59:26.819637+0000","last_fullsized":"2024-09-17T01:59:26.819637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":642,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818948+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:26.818948+0000","last_peered":"2024-09-17T01:59:26.818948+0000","last_clean":"2024-09-17T01:59:26.818948+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:26.818948+0000","last_undegraded":"2024-09-17T01:59:26.818948+0000","last_fullsized":"2024-09-17T01:59:26.818948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":490,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.350719+0000","last_change":"2024-09-17T01:59:26.350719+0000","last_active":"2024-09-17T01:59:08.225446+0000","last_peered":"2024-09-17T01:59:06.195436+0000","last_clean":"2024-09-17T01:56:19.055461+0000","last_became_active":"2024-09-17T01:56:20.334039+0000","last_became_peered":"2024-09-17T01:56:20.334039+0000","last_unstale":"2024-09-17T01:59:26.350719+0000","last_undegraded":"2024-09-17T01:59:26.350719+0000","last_fullsized":"2024-09-17T01:59:26.350719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":536,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.350252+0000","last_change":"2024-09-17T01:59:26.350252+0000","last_active":"2024-09-17T01:59:08.223914+0000","last_peered":"2024-09-17T01:59:06.602972+0000","last_clean":"2024-09-17T01:56:18.963805+0000","last_became_active":"2024-09-17T01:56:20.338915+0000","last_became_peered":"2024-09-17T01:56:20.338915+0000","last_unstale":"2024-09-17T01:59:26.350252+0000","last_undegraded":"2024-09-17T01:59:26.350252+0000","last_fullsized":"2024-09-17T01:59:26.350252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817884+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:26.817884+0000","last_peered":"2024-09-17T01:59:26.817884+0000","last_clean":"2024-09-17T01:59:26.817884+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:26.817884+0000","last_undegraded":"2024-09-17T01:59:26.817884+0000","last_fullsized":"2024-09-17T01:59:26.817884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":592,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812445+0000","last_change":"2024-09-17T01:59:09.360065+0000","last_active":"2024-09-17T01:59:26.812445+0000","last_peered":"2024-09-17T01:59:26.812445+0000","last_clean":"2024-09-17T01:56:19.050631+0000","last_became_active":"2024-09-17T01:59:09.350052+0000","last_became_peered":"2024-09-17T01:59:09.350052+0000","last_unstale":"2024-09-17T01:59:26.812445+0000","last_undegraded":"2024-09-17T01:59:09.234190+0000","last_fullsized":"2024-09-17T01:59:09.216778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":665,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347652+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:26.347652+0000","last_peered":"2024-09-17T01:59:26.347652+0000","last_clean":"2024-09-17T01:59:26.347652+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:26.347652+0000","last_undegraded":"2024-09-17T01:59:26.347652+0000","last_fullsized":"2024-09-17T01:59:26.347652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":557,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812710+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:26.812710+0000","last_peered":"2024-09-17T01:59:26.812710+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:26.812710+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":606,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814436+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:26.814436+0000","last_peered":"2024-09-17T01:59:26.814436+0000","last_clean":"2024-09-17T01:59:26.814436+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:26.814436+0000","last_undegraded":"2024-09-17T01:59:26.814436+0000","last_fullsized":"2024-09-17T01:59:26.814436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":572,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819199+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:26.819199+0000","last_peered":"2024-09-17T01:59:26.819199+0000","last_clean":"2024-09-17T01:59:26.819199+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:26.819199+0000","last_undegraded":"2024-09-17T01:59:26.819199+0000","last_fullsized":"2024-09-17T01:59:26.819199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":513,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:26.349935+0000","last_peered":"2024-09-17T01:59:26.349935+0000","last_clean":"2024-09-17T01:59:26.349935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:26.349935+0000","last_undegraded":"2024-09-17T01:59:26.349935+0000","last_fullsized":"2024-09-17T01:59:26.349935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":855,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818325+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:26.818325+0000","last_peered":"2024-09-17T01:59:26.818325+0000","last_clean":"2024-09-17T01:59:26.818325+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:26.818325+0000","last_undegraded":"2024-09-17T01:59:26.818325+0000","last_fullsized":"2024-09-17T01:59:26.818325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":548,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817383+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:26.817383+0000","last_peered":"2024-09-17T01:59:26.817383+0000","last_clean":"2024-09-17T01:59:26.817383+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:26.817383+0000","last_undegraded":"2024-09-17T01:59:26.817383+0000","last_fullsized":"2024-09-17T01:59:26.817383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":661,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.816953+0000","last_change":"2024-09-17T01:59:09.356914+0000","last_active":"2024-09-17T01:59:26.816953+0000","last_peered":"2024-09-17T01:59:26.816953+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:59:09.352444+0000","last_became_peered":"2024-09-17T01:59:09.352444+0000","last_unstale":"2024-09-17T01:59:26.816953+0000","last_undegraded":"2024-09-17T01:59:09.251613+0000","last_fullsized":"2024-09-17T01:59:09.242492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":567,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347576+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:26.347576+0000","last_peered":"2024-09-17T01:59:26.347576+0000","last_clean":"2024-09-17T01:59:26.347576+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:26.347576+0000","last_undegraded":"2024-09-17T01:59:26.347576+0000","last_fullsized":"2024-09-17T01:59:26.347576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":670,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812184+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:26.812184+0000","last_peered":"2024-09-17T01:59:26.812184+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:26.812184+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":570,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816068+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:26.816068+0000","last_peered":"2024-09-17T01:59:26.816068+0000","last_clean":"2024-09-17T01:59:26.816068+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:26.816068+0000","last_undegraded":"2024-09-17T01:59:26.816068+0000","last_fullsized":"2024-09-17T01:59:26.816068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":599,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819789+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:26.819789+0000","last_peered":"2024-09-17T01:59:26.819789+0000","last_clean":"2024-09-17T01:59:26.819789+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:26.819789+0000","last_undegraded":"2024-09-17T01:59:26.819789+0000","last_fullsized":"2024-09-17T01:59:26.819789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":654,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814509+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:26.814509+0000","last_peered":"2024-09-17T01:59:26.814509+0000","last_clean":"2024-09-17T01:59:26.814509+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:26.814509+0000","last_undegraded":"2024-09-17T01:59:26.814509+0000","last_fullsized":"2024-09-17T01:59:26.814509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":667,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349250+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:26.349250+0000","last_peered":"2024-09-17T01:59:26.349250+0000","last_clean":"2024-09-17T01:59:26.349250+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:26.349250+0000","last_undegraded":"2024-09-17T01:59:26.349250+0000","last_fullsized":"2024-09-17T01:59:26.349250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":576,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.814382+0000","last_change":"2024-09-17T01:59:09.360583+0000","last_active":"2024-09-17T01:59:26.814382+0000","last_peered":"2024-09-17T01:59:26.814382+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:59:09.352921+0000","last_became_peered":"2024-09-17T01:59:09.352921+0000","last_unstale":"2024-09-17T01:59:26.814382+0000","last_undegraded":"2024-09-17T01:59:09.257578+0000","last_fullsized":"2024-09-17T01:59:09.251871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1147,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.595518+0000","last_change":"2024-09-17T01:59:26.819342+0000","last_active":"2024-09-17T01:59:26.819342+0000","last_peered":"2024-09-17T01:59:26.595518+0000","last_clean":"2024-09-17T01:56:19.175808+0000","last_became_active":"2024-09-17T01:59:09.347955+0000","last_became_peered":"2024-09-17T01:59:09.347955+0000","last_unstale":"2024-09-17T01:59:26.595518+0000","last_undegraded":"2024-09-17T01:59:26.595518+0000","last_fullsized":"2024-09-17T01:59:09.221213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1053,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812197+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:26.812197+0000","last_peered":"2024-09-17T01:59:26.812197+0000","last_clean":"2024-09-17T01:59:26.812197+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:26.812197+0000","last_undegraded":"2024-09-17T01:59:26.812197+0000","last_fullsized":"2024-09-17T01:59:26.812197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816581+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:26.816581+0000","last_peered":"2024-09-17T01:59:26.816581+0000","last_clean":"2024-09-17T01:59:26.816581+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:26.816581+0000","last_undegraded":"2024-09-17T01:59:26.816581+0000","last_fullsized":"2024-09-17T01:59:26.816581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":996,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819697+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:26.819697+0000","last_peered":"2024-09-17T01:59:26.819697+0000","last_clean":"2024-09-17T01:59:26.819697+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:26.819697+0000","last_undegraded":"2024-09-17T01:59:26.819697+0000","last_fullsized":"2024-09-17T01:59:26.819697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1076,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815283+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:26.815283+0000","last_peered":"2024-09-17T01:59:26.815283+0000","last_clean":"2024-09-17T01:59:26.815283+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:26.815283+0000","last_undegraded":"2024-09-17T01:59:26.815283+0000","last_fullsized":"2024-09-17T01:59:26.815283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":590,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.820427+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:26.820427+0000","last_peered":"2024-09-17T01:59:26.820427+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:26.820427+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":945,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818974+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:26.818974+0000","last_peered":"2024-09-17T01:59:26.818974+0000","last_clean":"2024-09-17T01:59:26.818974+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:26.818974+0000","last_undegraded":"2024-09-17T01:59:26.818974+0000","last_fullsized":"2024-09-17T01:59:26.818974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":594,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814183+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:26.814183+0000","last_peered":"2024-09-17T01:59:26.814183+0000","last_clean":"2024-09-17T01:59:26.814183+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:26.814183+0000","last_undegraded":"2024-09-17T01:59:26.814183+0000","last_fullsized":"2024-09-17T01:59:26.814183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1035,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818367+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:26.818367+0000","last_peered":"2024-09-17T01:59:26.818367+0000","last_clean":"2024-09-17T01:59:26.818367+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:26.818367+0000","last_undegraded":"2024-09-17T01:59:26.818367+0000","last_fullsized":"2024-09-17T01:59:26.818367+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":655,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812372+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:26.812372+0000","last_peered":"2024-09-17T01:59:26.812372+0000","last_clean":"2024-09-17T01:59:26.812372+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:26.812372+0000","last_undegraded":"2024-09-17T01:59:26.812372+0000","last_fullsized":"2024-09-17T01:59:26.812372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":663,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.346955+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:26.346955+0000","last_peered":"2024-09-17T01:59:26.346955+0000","last_clean":"2024-09-17T01:59:26.346955+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:26.346955+0000","last_undegraded":"2024-09-17T01:59:26.346955+0000","last_fullsized":"2024-09-17T01:59:26.346955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":622,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818763+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:26.818763+0000","last_peered":"2024-09-17T01:59:26.818763+0000","last_clean":"2024-09-17T01:59:26.818763+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:26.818763+0000","last_undegraded":"2024-09-17T01:59:26.818763+0000","last_fullsized":"2024-09-17T01:59:26.818763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":556,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348080+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:26.348080+0000","last_peered":"2024-09-17T01:59:26.348080+0000","last_clean":"2024-09-17T01:59:26.348080+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:26.348080+0000","last_undegraded":"2024-09-17T01:59:26.348080+0000","last_fullsized":"2024-09-17T01:59:26.348080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":643,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819619+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:26.819619+0000","last_peered":"2024-09-17T01:59:26.819619+0000","last_clean":"2024-09-17T01:59:26.819619+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:26.819619+0000","last_undegraded":"2024-09-17T01:59:26.819619+0000","last_fullsized":"2024-09-17T01:59:26.819619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815232+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:26.815232+0000","last_peered":"2024-09-17T01:59:26.815232+0000","last_clean":"2024-09-17T01:59:26.815232+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:26.815232+0000","last_undegraded":"2024-09-17T01:59:26.815232+0000","last_fullsized":"2024-09-17T01:59:26.815232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":949,"reported_epoch":91,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:27.129379+0000","last_change":"2024-09-17T01:59:26.600174+0000","last_active":"2024-09-17T01:59:27.129379+0000","last_peered":"2024-09-17T01:59:27.129379+0000","last_clean":"2024-09-17T01:56:19.307562+0000","last_became_active":"2024-09-17T01:59:09.346790+0000","last_became_peered":"2024-09-17T01:59:09.346790+0000","last_unstale":"2024-09-17T01:59:27.129379+0000","last_undegraded":"2024-09-17T01:59:27.129379+0000","last_fullsized":"2024-09-17T01:59:09.253040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":244,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817383+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:26.817383+0000","last_peered":"2024-09-17T01:59:26.817383+0000","last_clean":"2024-09-17T01:59:26.817383+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:26.817383+0000","last_undegraded":"2024-09-17T01:59:26.817383+0000","last_fullsized":"2024-09-17T01:59:26.817383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":627,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.814757+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:26.814757+0000","last_peered":"2024-09-17T01:59:26.814757+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:26.814757+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.346895+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:26.346895+0000","last_peered":"2024-09-17T01:59:26.346895+0000","last_clean":"2024-09-17T01:59:26.346895+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:26.346895+0000","last_undegraded":"2024-09-17T01:59:26.346895+0000","last_fullsized":"2024-09-17T01:59:26.346895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349915+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:26.349915+0000","last_peered":"2024-09-17T01:59:26.349915+0000","last_clean":"2024-09-17T01:59:26.349915+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:26.349915+0000","last_undegraded":"2024-09-17T01:59:26.349915+0000","last_fullsized":"2024-09-17T01:59:26.349915+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":969,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816718+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:26.816718+0000","last_peered":"2024-09-17T01:59:26.816718+0000","last_clean":"2024-09-17T01:59:26.816718+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:26.816718+0000","last_undegraded":"2024-09-17T01:59:26.816718+0000","last_fullsized":"2024-09-17T01:59:26.816718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":436,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819736+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:26.819736+0000","last_peered":"2024-09-17T01:59:26.819736+0000","last_clean":"2024-09-17T01:59:26.819736+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:26.819736+0000","last_undegraded":"2024-09-17T01:59:26.819736+0000","last_fullsized":"2024-09-17T01:59:26.819736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":629,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816919+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:26.816919+0000","last_peered":"2024-09-17T01:59:26.816919+0000","last_clean":"2024-09-17T01:59:26.816919+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:26.816919+0000","last_undegraded":"2024-09-17T01:59:26.816919+0000","last_fullsized":"2024-09-17T01:59:26.816919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":663,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349593+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:26.349593+0000","last_peered":"2024-09-17T01:59:26.349593+0000","last_clean":"2024-09-17T01:59:26.349593+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:26.349593+0000","last_undegraded":"2024-09-17T01:59:26.349593+0000","last_fullsized":"2024-09-17T01:59:26.349593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":674,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.815237+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:26.815237+0000","last_peered":"2024-09-17T01:59:26.815237+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:26.815237+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348745+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:26.348745+0000","last_peered":"2024-09-17T01:59:26.348745+0000","last_clean":"2024-09-17T01:59:26.348745+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:26.348745+0000","last_undegraded":"2024-09-17T01:59:26.348745+0000","last_fullsized":"2024-09-17T01:59:26.348745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":985,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813622+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:26.813622+0000","last_peered":"2024-09-17T01:59:26.813622+0000","last_clean":"2024-09-17T01:59:26.813622+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:26.813622+0000","last_undegraded":"2024-09-17T01:59:26.813622+0000","last_fullsized":"2024-09-17T01:59:26.813622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":328,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814537+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:26.814537+0000","last_peered":"2024-09-17T01:59:26.814537+0000","last_clean":"2024-09-17T01:59:26.814537+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:26.814537+0000","last_undegraded":"2024-09-17T01:59:26.814537+0000","last_fullsized":"2024-09-17T01:59:26.814537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":617,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349754+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:26.349754+0000","last_peered":"2024-09-17T01:59:26.349754+0000","last_clean":"2024-09-17T01:59:26.349754+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:26.349754+0000","last_undegraded":"2024-09-17T01:59:26.349754+0000","last_fullsized":"2024-09-17T01:59:26.349754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":213,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347586+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:26.347586+0000","last_peered":"2024-09-17T01:59:26.347586+0000","last_clean":"2024-09-17T01:59:26.347586+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:26.347586+0000","last_undegraded":"2024-09-17T01:59:26.347586+0000","last_fullsized":"2024-09-17T01:59:26.347586+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":697,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.819902+0000","last_change":"2024-09-17T01:59:09.358162+0000","last_active":"2024-09-17T01:59:26.819902+0000","last_peered":"2024-09-17T01:59:26.819902+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:26.819902+0000","last_undegraded":"2024-09-17T01:59:09.257380+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817250+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:26.817250+0000","last_peered":"2024-09-17T01:59:26.817250+0000","last_clean":"2024-09-17T01:59:26.817250+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:26.817250+0000","last_undegraded":"2024-09-17T01:59:26.817250+0000","last_fullsized":"2024-09-17T01:59:26.817250+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":552,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349729+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:26.349729+0000","last_peered":"2024-09-17T01:59:26.349729+0000","last_clean":"2024-09-17T01:59:26.349729+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:26.349729+0000","last_undegraded":"2024-09-17T01:59:26.349729+0000","last_fullsized":"2024-09-17T01:59:26.349729+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":612,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816916+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:26.816916+0000","last_peered":"2024-09-17T01:59:26.816916+0000","last_clean":"2024-09-17T01:59:26.816916+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:26.816916+0000","last_undegraded":"2024-09-17T01:59:26.816916+0000","last_fullsized":"2024-09-17T01:59:26.816916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":589,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814829+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:26.814829+0000","last_peered":"2024-09-17T01:59:26.814829+0000","last_clean":"2024-09-17T01:59:26.814829+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:26.814829+0000","last_undegraded":"2024-09-17T01:59:26.814829+0000","last_fullsized":"2024-09-17T01:59:26.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.346647+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:26.346647+0000","last_peered":"2024-09-17T01:59:26.346647+0000","last_clean":"2024-09-17T01:59:26.346647+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:26.346647+0000","last_undegraded":"2024-09-17T01:59:26.346647+0000","last_fullsized":"2024-09-17T01:59:26.346647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347282+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:26.347282+0000","last_peered":"2024-09-17T01:59:26.347282+0000","last_clean":"2024-09-17T01:59:26.347282+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:26.347282+0000","last_undegraded":"2024-09-17T01:59:26.347282+0000","last_fullsized":"2024-09-17T01:59:26.347282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349056+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:26.349056+0000","last_peered":"2024-09-17T01:59:26.349056+0000","last_clean":"2024-09-17T01:59:26.349056+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:26.349056+0000","last_undegraded":"2024-09-17T01:59:26.349056+0000","last_fullsized":"2024-09-17T01:59:26.349056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":616,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.818926+0000","last_change":"2024-09-17T01:59:09.355911+0000","last_active":"2024-09-17T01:59:26.818926+0000","last_peered":"2024-09-17T01:59:26.818926+0000","last_clean":"2024-09-17T01:56:19.185411+0000","last_became_active":"2024-09-17T01:59:09.349985+0000","last_became_peered":"2024-09-17T01:59:09.349985+0000","last_unstale":"2024-09-17T01:59:26.818926+0000","last_undegraded":"2024-09-17T01:59:09.252095+0000","last_fullsized":"2024-09-17T01:59:09.248489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347623+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:26.347623+0000","last_peered":"2024-09-17T01:59:26.347623+0000","last_clean":"2024-09-17T01:59:26.347623+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:26.347623+0000","last_undegraded":"2024-09-17T01:59:26.347623+0000","last_fullsized":"2024-09-17T01:59:26.347623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":352,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813130+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:26.813130+0000","last_peered":"2024-09-17T01:59:26.813130+0000","last_clean":"2024-09-17T01:59:26.813130+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:26.813130+0000","last_undegraded":"2024-09-17T01:59:26.813130+0000","last_fullsized":"2024-09-17T01:59:26.813130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":690,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819420+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:26.819420+0000","last_peered":"2024-09-17T01:59:26.819420+0000","last_clean":"2024-09-17T01:59:26.819420+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:26.819420+0000","last_undegraded":"2024-09-17T01:59:26.819420+0000","last_fullsized":"2024-09-17T01:59:26.819420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813432+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:26.813432+0000","last_peered":"2024-09-17T01:59:26.813432+0000","last_clean":"2024-09-17T01:59:26.813432+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:26.813432+0000","last_undegraded":"2024-09-17T01:59:26.813432+0000","last_fullsized":"2024-09-17T01:59:26.813432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":592,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817043+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:26.817043+0000","last_peered":"2024-09-17T01:59:26.817043+0000","last_clean":"2024-09-17T01:59:26.817043+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:26.817043+0000","last_undegraded":"2024-09-17T01:59:26.817043+0000","last_fullsized":"2024-09-17T01:59:26.817043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":552,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815142+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:26.815142+0000","last_peered":"2024-09-17T01:59:26.815142+0000","last_clean":"2024-09-17T01:59:26.815142+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:26.815142+0000","last_undegraded":"2024-09-17T01:59:26.815142+0000","last_fullsized":"2024-09-17T01:59:26.815142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347035+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:26.347035+0000","last_peered":"2024-09-17T01:59:26.347035+0000","last_clean":"2024-09-17T01:59:26.347035+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:26.347035+0000","last_undegraded":"2024-09-17T01:59:26.347035+0000","last_fullsized":"2024-09-17T01:59:26.347035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347307+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:26.347307+0000","last_peered":"2024-09-17T01:59:26.347307+0000","last_clean":"2024-09-17T01:59:26.347307+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:26.347307+0000","last_undegraded":"2024-09-17T01:59:26.347307+0000","last_fullsized":"2024-09-17T01:59:26.347307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":597,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815178+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:26.815178+0000","last_peered":"2024-09-17T01:59:26.815178+0000","last_clean":"2024-09-17T01:59:26.815178+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:26.815178+0000","last_undegraded":"2024-09-17T01:59:26.815178+0000","last_fullsized":"2024-09-17T01:59:26.815178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":369,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349017+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:26.349017+0000","last_peered":"2024-09-17T01:59:26.349017+0000","last_clean":"2024-09-17T01:59:26.349017+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:26.349017+0000","last_undegraded":"2024-09-17T01:59:26.349017+0000","last_fullsized":"2024-09-17T01:59:26.349017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816009+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:26.816009+0000","last_peered":"2024-09-17T01:59:26.816009+0000","last_clean":"2024-09-17T01:59:26.816009+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:26.816009+0000","last_undegraded":"2024-09-17T01:59:26.816009+0000","last_fullsized":"2024-09-17T01:59:26.816009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":567,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.817765+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:26.817765+0000","last_peered":"2024-09-17T01:59:26.817765+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:26.817765+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815807+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:26.815807+0000","last_peered":"2024-09-17T01:59:26.815807+0000","last_clean":"2024-09-17T01:59:26.815807+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:26.815807+0000","last_undegraded":"2024-09-17T01:59:26.815807+0000","last_fullsized":"2024-09-17T01:59:26.815807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.820487+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:26.820487+0000","last_peered":"2024-09-17T01:59:26.820487+0000","last_clean":"2024-09-17T01:59:26.820487+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:26.820487+0000","last_undegraded":"2024-09-17T01:59:26.820487+0000","last_fullsized":"2024-09-17T01:59:26.820487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":987,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817773+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:26.817773+0000","last_peered":"2024-09-17T01:59:26.817773+0000","last_clean":"2024-09-17T01:59:26.817773+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:26.817773+0000","last_undegraded":"2024-09-17T01:59:26.817773+0000","last_fullsized":"2024-09-17T01:59:26.817773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816011+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:26.816011+0000","last_peered":"2024-09-17T01:59:26.816011+0000","last_clean":"2024-09-17T01:59:26.816011+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:26.816011+0000","last_undegraded":"2024-09-17T01:59:26.816011+0000","last_fullsized":"2024-09-17T01:59:26.816011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816435+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:26.816435+0000","last_peered":"2024-09-17T01:59:26.816435+0000","last_clean":"2024-09-17T01:59:26.816435+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:26.816435+0000","last_undegraded":"2024-09-17T01:59:26.816435+0000","last_fullsized":"2024-09-17T01:59:26.816435+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":594,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.813365+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:26.813365+0000","last_peered":"2024-09-17T01:59:26.813365+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:26.813365+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":284,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816283+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:26.816283+0000","last_peered":"2024-09-17T01:59:26.816283+0000","last_clean":"2024-09-17T01:59:26.816283+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:26.816283+0000","last_undegraded":"2024-09-17T01:59:26.816283+0000","last_fullsized":"2024-09-17T01:59:26.816283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349203+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:26.349203+0000","last_peered":"2024-09-17T01:59:26.349203+0000","last_clean":"2024-09-17T01:59:26.349203+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:26.349203+0000","last_undegraded":"2024-09-17T01:59:26.349203+0000","last_fullsized":"2024-09-17T01:59:26.349203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1021,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816938+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:26.816938+0000","last_peered":"2024-09-17T01:59:26.816938+0000","last_clean":"2024-09-17T01:59:26.816938+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:26.816938+0000","last_undegraded":"2024-09-17T01:59:26.816938+0000","last_fullsized":"2024-09-17T01:59:26.816938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":588,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348356+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:26.348356+0000","last_peered":"2024-09-17T01:59:26.348356+0000","last_clean":"2024-09-17T01:59:26.348356+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:26.348356+0000","last_undegraded":"2024-09-17T01:59:26.348356+0000","last_fullsized":"2024-09-17T01:59:26.348356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":411,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348346+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:26.348346+0000","last_peered":"2024-09-17T01:59:26.348346+0000","last_clean":"2024-09-17T01:59:26.348346+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:26.348346+0000","last_undegraded":"2024-09-17T01:59:26.348346+0000","last_fullsized":"2024-09-17T01:59:26.348346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813485+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:26.813485+0000","last_peered":"2024-09-17T01:59:26.813485+0000","last_clean":"2024-09-17T01:59:26.813485+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:26.813485+0000","last_undegraded":"2024-09-17T01:59:26.813485+0000","last_fullsized":"2024-09-17T01:59:26.813485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":251,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.820117+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:26.820117+0000","last_peered":"2024-09-17T01:59:26.820117+0000","last_clean":"2024-09-17T01:59:26.820117+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:26.820117+0000","last_undegraded":"2024-09-17T01:59:26.820117+0000","last_fullsized":"2024-09-17T01:59:26.820117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":305,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349555+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:26.349555+0000","last_peered":"2024-09-17T01:59:26.349555+0000","last_clean":"2024-09-17T01:59:26.349555+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:26.349555+0000","last_undegraded":"2024-09-17T01:59:26.349555+0000","last_fullsized":"2024-09-17T01:59:26.349555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":736,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812920+0000","last_change":"2024-09-17T01:59:09.361052+0000","last_active":"2024-09-17T01:59:26.812920+0000","last_peered":"2024-09-17T01:59:26.812920+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:26.812920+0000","last_undegraded":"2024-09-17T01:59:09.243588+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":216,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815635+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:26.815635+0000","last_peered":"2024-09-17T01:59:26.815635+0000","last_clean":"2024-09-17T01:59:26.815635+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:26.815635+0000","last_undegraded":"2024-09-17T01:59:26.815635+0000","last_fullsized":"2024-09-17T01:59:26.815635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":673,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813587+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:26.813587+0000","last_peered":"2024-09-17T01:59:26.813587+0000","last_clean":"2024-09-17T01:59:26.813587+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:26.813587+0000","last_undegraded":"2024-09-17T01:59:26.813587+0000","last_fullsized":"2024-09-17T01:59:26.813587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":859,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819988+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:26.819988+0000","last_peered":"2024-09-17T01:59:26.819988+0000","last_clean":"2024-09-17T01:59:26.819988+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:26.819988+0000","last_undegraded":"2024-09-17T01:59:26.819988+0000","last_fullsized":"2024-09-17T01:59:26.819988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":783,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813726+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:26.813726+0000","last_peered":"2024-09-17T01:59:26.813726+0000","last_clean":"2024-09-17T01:59:26.813726+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:26.813726+0000","last_undegraded":"2024-09-17T01:59:26.813726+0000","last_fullsized":"2024-09-17T01:59:26.813726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":942,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814812+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:26.814812+0000","last_peered":"2024-09-17T01:59:26.814812+0000","last_clean":"2024-09-17T01:59:26.814812+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:26.814812+0000","last_undegraded":"2024-09-17T01:59:26.814812+0000","last_fullsized":"2024-09-17T01:59:26.814812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":371,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812838+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:26.812838+0000","last_peered":"2024-09-17T01:59:26.812838+0000","last_clean":"2024-09-17T01:59:26.812838+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:26.812838+0000","last_undegraded":"2024-09-17T01:59:26.812838+0000","last_fullsized":"2024-09-17T01:59:26.812838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":593,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.818946+0000","last_change":"2024-09-17T01:59:09.355604+0000","last_active":"2024-09-17T01:59:26.818946+0000","last_peered":"2024-09-17T01:59:26.818946+0000","last_clean":"2024-09-17T01:56:19.136297+0000","last_became_active":"2024-09-17T01:59:09.347969+0000","last_became_peered":"2024-09-17T01:59:09.347969+0000","last_unstale":"2024-09-17T01:59:26.818946+0000","last_undegraded":"2024-09-17T01:59:09.248244+0000","last_fullsized":"2024-09-17T01:59:09.223371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":429,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818696+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:26.818696+0000","last_peered":"2024-09-17T01:59:26.818696+0000","last_clean":"2024-09-17T01:59:26.818696+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:26.818696+0000","last_undegraded":"2024-09-17T01:59:26.818696+0000","last_fullsized":"2024-09-17T01:59:26.818696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":569,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818835+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:26.818835+0000","last_peered":"2024-09-17T01:59:26.818835+0000","last_clean":"2024-09-17T01:59:26.818835+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:26.818835+0000","last_undegraded":"2024-09-17T01:59:26.818835+0000","last_fullsized":"2024-09-17T01:59:26.818835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":218,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818057+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:26.818057+0000","last_peered":"2024-09-17T01:59:26.818057+0000","last_clean":"2024-09-17T01:59:26.818057+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:26.818057+0000","last_undegraded":"2024-09-17T01:59:26.818057+0000","last_fullsized":"2024-09-17T01:59:26.818057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":609,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348332+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:26.348332+0000","last_peered":"2024-09-17T01:59:26.348332+0000","last_clean":"2024-09-17T01:59:26.348332+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:26.348332+0000","last_undegraded":"2024-09-17T01:59:26.348332+0000","last_fullsized":"2024-09-17T01:59:26.348332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348333+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:26.348333+0000","last_peered":"2024-09-17T01:59:26.348333+0000","last_clean":"2024-09-17T01:59:26.348333+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:26.348333+0000","last_undegraded":"2024-09-17T01:59:26.348333+0000","last_fullsized":"2024-09-17T01:59:26.348333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":554,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823578+0000","last_change":"2024-09-17T01:59:09.359162+0000","last_active":"2024-09-17T01:59:21.823578+0000","last_peered":"2024-09-17T01:59:21.823578+0000","last_clean":"2024-09-17T01:56:19.006818+0000","last_became_active":"2024-09-17T01:59:09.351483+0000","last_became_peered":"2024-09-17T01:59:09.351483+0000","last_unstale":"2024-09-17T01:59:21.823578+0000","last_undegraded":"2024-09-17T01:59:09.240046+0000","last_fullsized":"2024-09-17T01:59:09.225735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":443,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819844+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:26.819844+0000","last_peered":"2024-09-17T01:59:26.819844+0000","last_clean":"2024-09-17T01:59:26.819844+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:26.819844+0000","last_undegraded":"2024-09-17T01:59:26.819844+0000","last_fullsized":"2024-09-17T01:59:26.819844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":664,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817576+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:26.817576+0000","last_peered":"2024-09-17T01:59:26.817576+0000","last_clean":"2024-09-17T01:59:26.817576+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:26.817576+0000","last_undegraded":"2024-09-17T01:59:26.817576+0000","last_fullsized":"2024-09-17T01:59:26.817576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":199,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815984+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:26.815984+0000","last_peered":"2024-09-17T01:59:26.815984+0000","last_clean":"2024-09-17T01:59:26.815984+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:26.815984+0000","last_undegraded":"2024-09-17T01:59:26.815984+0000","last_fullsized":"2024-09-17T01:59:26.815984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":704,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.811971+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:26.811971+0000","last_peered":"2024-09-17T01:59:26.811971+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:26.811971+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":227,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815699+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:26.815699+0000","last_peered":"2024-09-17T01:59:26.815699+0000","last_clean":"2024-09-17T01:59:26.815699+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:26.815699+0000","last_undegraded":"2024-09-17T01:59:26.815699+0000","last_fullsized":"2024-09-17T01:59:26.815699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4084,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17346560,"data_stored":16113126,"data_compressed":1427716,"data_compressed_allocated":1867776,"data_compressed_original":6246400,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":111,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59844,"kb_used_data":30888,"kb_used_omap":174,"kb_used_meta":28753,"kb_avail":94311996,"statfs":{"total":96636764160,"available":96575483904,"internally_reserved":0,"allocated":31629312,"data_stored":116237989,"data_compressed":9578200,"data_compressed_allocated":13713408,"data_compressed_original":105086976,"omap_allocated":179054,"internal_metadata":29443218},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95168,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276672,"statfs":{"total":96636764160,"available":96539312128,"internally_reserved":0,"allocated":24350720,"data_stored":84998397,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91796,"kb_used_data":20416,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94280044,"statfs":{"total":96636764160,"available":96542765056,"internally_reserved":0,"allocated":20905984,"data_stored":73160440,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17346560,"data_stored":16113126,"data_compressed":1427716,"data_compressed_allocated":1867776,"data_compressed_original":6246400,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:28.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:59:28.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:28.574 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 4122/114 objects degraded (3615.789%), 23 pgs degraded","count":23},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":306,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":92,"num_osds":3,"num_up_osds":3,"osd_up_since":1726538347,"num_in_osds":3,"osd_in_since":1726538063,"num_remapped_pgs":15},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":79},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":23},{"state_name":"peering","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128027436,"bytes_used":265781248,"bytes_avail":289644511232,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"degraded_objects":4122,"degraded_total":114,"degraded_ratio":36.157894736842103,"recovering_objects_per_sec":30,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":124,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T01:55:53.990553+0000","services":{}},"progress_events":{}} 2024-09-17T01:59:28.593 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-17T01:59:28.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:28.912 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:28.933 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-17T01:59:28.823672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4106,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":193,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":246808,"kb_used_data":75084,"kb_used_omap":177,"kb_used_meta":171470,"kb_avail":282868712,"statfs":{"total":289910292480,"available":289657561088,"internally_reserved":0,"allocated":76886016,"data_stored":274396826,"data_compressed":21238279,"data_compressed_allocated":34148352,"data_compressed_original":239349760,"omap_allocated":182244,"internal_metadata":175585308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1291,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1107,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003677"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":649,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819637+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:26.819637+0000","last_peered":"2024-09-17T01:59:26.819637+0000","last_clean":"2024-09-17T01:59:26.819637+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:26.819637+0000","last_undegraded":"2024-09-17T01:59:26.819637+0000","last_fullsized":"2024-09-17T01:59:26.819637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":642,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818948+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:26.818948+0000","last_peered":"2024-09-17T01:59:26.818948+0000","last_clean":"2024-09-17T01:59:26.818948+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:26.818948+0000","last_undegraded":"2024-09-17T01:59:26.818948+0000","last_fullsized":"2024-09-17T01:59:26.818948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":490,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.350719+0000","last_change":"2024-09-17T01:59:26.350719+0000","last_active":"2024-09-17T01:59:08.225446+0000","last_peered":"2024-09-17T01:59:06.195436+0000","last_clean":"2024-09-17T01:56:19.055461+0000","last_became_active":"2024-09-17T01:56:20.334039+0000","last_became_peered":"2024-09-17T01:56:20.334039+0000","last_unstale":"2024-09-17T01:59:26.350719+0000","last_undegraded":"2024-09-17T01:59:26.350719+0000","last_fullsized":"2024-09-17T01:59:26.350719+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":536,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.350252+0000","last_change":"2024-09-17T01:59:26.350252+0000","last_active":"2024-09-17T01:59:08.223914+0000","last_peered":"2024-09-17T01:59:06.602972+0000","last_clean":"2024-09-17T01:56:18.963805+0000","last_became_active":"2024-09-17T01:56:20.338915+0000","last_became_peered":"2024-09-17T01:56:20.338915+0000","last_unstale":"2024-09-17T01:59:26.350252+0000","last_undegraded":"2024-09-17T01:59:26.350252+0000","last_fullsized":"2024-09-17T01:59:26.350252+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817884+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:26.817884+0000","last_peered":"2024-09-17T01:59:26.817884+0000","last_clean":"2024-09-17T01:59:26.817884+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:26.817884+0000","last_undegraded":"2024-09-17T01:59:26.817884+0000","last_fullsized":"2024-09-17T01:59:26.817884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":592,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812445+0000","last_change":"2024-09-17T01:59:09.360065+0000","last_active":"2024-09-17T01:59:26.812445+0000","last_peered":"2024-09-17T01:59:26.812445+0000","last_clean":"2024-09-17T01:56:19.050631+0000","last_became_active":"2024-09-17T01:59:09.350052+0000","last_became_peered":"2024-09-17T01:59:09.350052+0000","last_unstale":"2024-09-17T01:59:26.812445+0000","last_undegraded":"2024-09-17T01:59:09.234190+0000","last_fullsized":"2024-09-17T01:59:09.216778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":169,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":665,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347652+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:26.347652+0000","last_peered":"2024-09-17T01:59:26.347652+0000","last_clean":"2024-09-17T01:59:26.347652+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:26.347652+0000","last_undegraded":"2024-09-17T01:59:26.347652+0000","last_fullsized":"2024-09-17T01:59:26.347652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":557,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812710+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:26.812710+0000","last_peered":"2024-09-17T01:59:26.812710+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:26.812710+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":606,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814436+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:26.814436+0000","last_peered":"2024-09-17T01:59:26.814436+0000","last_clean":"2024-09-17T01:59:26.814436+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:26.814436+0000","last_undegraded":"2024-09-17T01:59:26.814436+0000","last_fullsized":"2024-09-17T01:59:26.814436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":572,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819199+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:26.819199+0000","last_peered":"2024-09-17T01:59:26.819199+0000","last_clean":"2024-09-17T01:59:26.819199+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:26.819199+0000","last_undegraded":"2024-09-17T01:59:26.819199+0000","last_fullsized":"2024-09-17T01:59:26.819199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":513,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:26.349935+0000","last_peered":"2024-09-17T01:59:26.349935+0000","last_clean":"2024-09-17T01:59:26.349935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:26.349935+0000","last_undegraded":"2024-09-17T01:59:26.349935+0000","last_fullsized":"2024-09-17T01:59:26.349935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":855,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818325+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:26.818325+0000","last_peered":"2024-09-17T01:59:26.818325+0000","last_clean":"2024-09-17T01:59:26.818325+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:26.818325+0000","last_undegraded":"2024-09-17T01:59:26.818325+0000","last_fullsized":"2024-09-17T01:59:26.818325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":548,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817383+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:26.817383+0000","last_peered":"2024-09-17T01:59:26.817383+0000","last_clean":"2024-09-17T01:59:26.817383+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:26.817383+0000","last_undegraded":"2024-09-17T01:59:26.817383+0000","last_fullsized":"2024-09-17T01:59:26.817383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":661,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.816953+0000","last_change":"2024-09-17T01:59:09.356914+0000","last_active":"2024-09-17T01:59:26.816953+0000","last_peered":"2024-09-17T01:59:26.816953+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:59:09.352444+0000","last_became_peered":"2024-09-17T01:59:09.352444+0000","last_unstale":"2024-09-17T01:59:26.816953+0000","last_undegraded":"2024-09-17T01:59:09.251613+0000","last_fullsized":"2024-09-17T01:59:09.242492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":183,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":567,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347576+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:26.347576+0000","last_peered":"2024-09-17T01:59:26.347576+0000","last_clean":"2024-09-17T01:59:26.347576+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:26.347576+0000","last_undegraded":"2024-09-17T01:59:26.347576+0000","last_fullsized":"2024-09-17T01:59:26.347576+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":670,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812184+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:26.812184+0000","last_peered":"2024-09-17T01:59:26.812184+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:26.812184+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":570,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816068+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:26.816068+0000","last_peered":"2024-09-17T01:59:26.816068+0000","last_clean":"2024-09-17T01:59:26.816068+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:26.816068+0000","last_undegraded":"2024-09-17T01:59:26.816068+0000","last_fullsized":"2024-09-17T01:59:26.816068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":599,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819789+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:26.819789+0000","last_peered":"2024-09-17T01:59:26.819789+0000","last_clean":"2024-09-17T01:59:26.819789+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:26.819789+0000","last_undegraded":"2024-09-17T01:59:26.819789+0000","last_fullsized":"2024-09-17T01:59:26.819789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":654,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814509+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:26.814509+0000","last_peered":"2024-09-17T01:59:26.814509+0000","last_clean":"2024-09-17T01:59:26.814509+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:26.814509+0000","last_undegraded":"2024-09-17T01:59:26.814509+0000","last_fullsized":"2024-09-17T01:59:26.814509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":667,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349250+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:26.349250+0000","last_peered":"2024-09-17T01:59:26.349250+0000","last_clean":"2024-09-17T01:59:26.349250+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:26.349250+0000","last_undegraded":"2024-09-17T01:59:26.349250+0000","last_fullsized":"2024-09-17T01:59:26.349250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":576,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.814382+0000","last_change":"2024-09-17T01:59:09.360583+0000","last_active":"2024-09-17T01:59:26.814382+0000","last_peered":"2024-09-17T01:59:26.814382+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:59:09.352921+0000","last_became_peered":"2024-09-17T01:59:09.352921+0000","last_unstale":"2024-09-17T01:59:26.814382+0000","last_undegraded":"2024-09-17T01:59:09.257578+0000","last_fullsized":"2024-09-17T01:59:09.251871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1147,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.595518+0000","last_change":"2024-09-17T01:59:26.819342+0000","last_active":"2024-09-17T01:59:26.819342+0000","last_peered":"2024-09-17T01:59:26.595518+0000","last_clean":"2024-09-17T01:56:19.175808+0000","last_became_active":"2024-09-17T01:59:09.347955+0000","last_became_peered":"2024-09-17T01:59:09.347955+0000","last_unstale":"2024-09-17T01:59:26.595518+0000","last_undegraded":"2024-09-17T01:59:26.595518+0000","last_fullsized":"2024-09-17T01:59:09.221213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1053,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812197+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:26.812197+0000","last_peered":"2024-09-17T01:59:26.812197+0000","last_clean":"2024-09-17T01:59:26.812197+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:26.812197+0000","last_undegraded":"2024-09-17T01:59:26.812197+0000","last_fullsized":"2024-09-17T01:59:26.812197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816581+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:26.816581+0000","last_peered":"2024-09-17T01:59:26.816581+0000","last_clean":"2024-09-17T01:59:26.816581+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:26.816581+0000","last_undegraded":"2024-09-17T01:59:26.816581+0000","last_fullsized":"2024-09-17T01:59:26.816581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":996,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819697+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:26.819697+0000","last_peered":"2024-09-17T01:59:26.819697+0000","last_clean":"2024-09-17T01:59:26.819697+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:26.819697+0000","last_undegraded":"2024-09-17T01:59:26.819697+0000","last_fullsized":"2024-09-17T01:59:26.819697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1076,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815283+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:26.815283+0000","last_peered":"2024-09-17T01:59:26.815283+0000","last_clean":"2024-09-17T01:59:26.815283+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:26.815283+0000","last_undegraded":"2024-09-17T01:59:26.815283+0000","last_fullsized":"2024-09-17T01:59:26.815283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":590,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.820427+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:26.820427+0000","last_peered":"2024-09-17T01:59:26.820427+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:26.820427+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":945,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818974+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:26.818974+0000","last_peered":"2024-09-17T01:59:26.818974+0000","last_clean":"2024-09-17T01:59:26.818974+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:26.818974+0000","last_undegraded":"2024-09-17T01:59:26.818974+0000","last_fullsized":"2024-09-17T01:59:26.818974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":594,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814183+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:26.814183+0000","last_peered":"2024-09-17T01:59:26.814183+0000","last_clean":"2024-09-17T01:59:26.814183+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:26.814183+0000","last_undegraded":"2024-09-17T01:59:26.814183+0000","last_fullsized":"2024-09-17T01:59:26.814183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1035,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818367+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:26.818367+0000","last_peered":"2024-09-17T01:59:26.818367+0000","last_clean":"2024-09-17T01:59:26.818367+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:26.818367+0000","last_undegraded":"2024-09-17T01:59:26.818367+0000","last_fullsized":"2024-09-17T01:59:26.818367+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":655,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812372+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:26.812372+0000","last_peered":"2024-09-17T01:59:26.812372+0000","last_clean":"2024-09-17T01:59:26.812372+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:26.812372+0000","last_undegraded":"2024-09-17T01:59:26.812372+0000","last_fullsized":"2024-09-17T01:59:26.812372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":663,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.346955+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:26.346955+0000","last_peered":"2024-09-17T01:59:26.346955+0000","last_clean":"2024-09-17T01:59:26.346955+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:26.346955+0000","last_undegraded":"2024-09-17T01:59:26.346955+0000","last_fullsized":"2024-09-17T01:59:26.346955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":622,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818763+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:26.818763+0000","last_peered":"2024-09-17T01:59:26.818763+0000","last_clean":"2024-09-17T01:59:26.818763+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:26.818763+0000","last_undegraded":"2024-09-17T01:59:26.818763+0000","last_fullsized":"2024-09-17T01:59:26.818763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":556,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348080+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:26.348080+0000","last_peered":"2024-09-17T01:59:26.348080+0000","last_clean":"2024-09-17T01:59:26.348080+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:26.348080+0000","last_undegraded":"2024-09-17T01:59:26.348080+0000","last_fullsized":"2024-09-17T01:59:26.348080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":643,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819619+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:26.819619+0000","last_peered":"2024-09-17T01:59:26.819619+0000","last_clean":"2024-09-17T01:59:26.819619+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:26.819619+0000","last_undegraded":"2024-09-17T01:59:26.819619+0000","last_fullsized":"2024-09-17T01:59:26.819619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815232+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:26.815232+0000","last_peered":"2024-09-17T01:59:26.815232+0000","last_clean":"2024-09-17T01:59:26.815232+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:26.815232+0000","last_undegraded":"2024-09-17T01:59:26.815232+0000","last_fullsized":"2024-09-17T01:59:26.815232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":949,"reported_epoch":91,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:27.129379+0000","last_change":"2024-09-17T01:59:26.600174+0000","last_active":"2024-09-17T01:59:27.129379+0000","last_peered":"2024-09-17T01:59:27.129379+0000","last_clean":"2024-09-17T01:56:19.307562+0000","last_became_active":"2024-09-17T01:59:09.346790+0000","last_became_peered":"2024-09-17T01:59:09.346790+0000","last_unstale":"2024-09-17T01:59:27.129379+0000","last_undegraded":"2024-09-17T01:59:27.129379+0000","last_fullsized":"2024-09-17T01:59:09.253040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":244,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817383+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:26.817383+0000","last_peered":"2024-09-17T01:59:26.817383+0000","last_clean":"2024-09-17T01:59:26.817383+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:26.817383+0000","last_undegraded":"2024-09-17T01:59:26.817383+0000","last_fullsized":"2024-09-17T01:59:26.817383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":627,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.814757+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:26.814757+0000","last_peered":"2024-09-17T01:59:26.814757+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:26.814757+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.346895+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:26.346895+0000","last_peered":"2024-09-17T01:59:26.346895+0000","last_clean":"2024-09-17T01:59:26.346895+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:26.346895+0000","last_undegraded":"2024-09-17T01:59:26.346895+0000","last_fullsized":"2024-09-17T01:59:26.346895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349915+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:26.349915+0000","last_peered":"2024-09-17T01:59:26.349915+0000","last_clean":"2024-09-17T01:59:26.349915+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:26.349915+0000","last_undegraded":"2024-09-17T01:59:26.349915+0000","last_fullsized":"2024-09-17T01:59:26.349915+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":969,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816718+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:26.816718+0000","last_peered":"2024-09-17T01:59:26.816718+0000","last_clean":"2024-09-17T01:59:26.816718+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:26.816718+0000","last_undegraded":"2024-09-17T01:59:26.816718+0000","last_fullsized":"2024-09-17T01:59:26.816718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":436,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819736+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:26.819736+0000","last_peered":"2024-09-17T01:59:26.819736+0000","last_clean":"2024-09-17T01:59:26.819736+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:26.819736+0000","last_undegraded":"2024-09-17T01:59:26.819736+0000","last_fullsized":"2024-09-17T01:59:26.819736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":629,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816919+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:26.816919+0000","last_peered":"2024-09-17T01:59:26.816919+0000","last_clean":"2024-09-17T01:59:26.816919+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:26.816919+0000","last_undegraded":"2024-09-17T01:59:26.816919+0000","last_fullsized":"2024-09-17T01:59:26.816919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":663,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349593+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:26.349593+0000","last_peered":"2024-09-17T01:59:26.349593+0000","last_clean":"2024-09-17T01:59:26.349593+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:26.349593+0000","last_undegraded":"2024-09-17T01:59:26.349593+0000","last_fullsized":"2024-09-17T01:59:26.349593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":674,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.815237+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:26.815237+0000","last_peered":"2024-09-17T01:59:26.815237+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:26.815237+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348745+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:26.348745+0000","last_peered":"2024-09-17T01:59:26.348745+0000","last_clean":"2024-09-17T01:59:26.348745+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:26.348745+0000","last_undegraded":"2024-09-17T01:59:26.348745+0000","last_fullsized":"2024-09-17T01:59:26.348745+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":985,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813622+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:26.813622+0000","last_peered":"2024-09-17T01:59:26.813622+0000","last_clean":"2024-09-17T01:59:26.813622+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:26.813622+0000","last_undegraded":"2024-09-17T01:59:26.813622+0000","last_fullsized":"2024-09-17T01:59:26.813622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":328,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814537+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:26.814537+0000","last_peered":"2024-09-17T01:59:26.814537+0000","last_clean":"2024-09-17T01:59:26.814537+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:26.814537+0000","last_undegraded":"2024-09-17T01:59:26.814537+0000","last_fullsized":"2024-09-17T01:59:26.814537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":617,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349754+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:26.349754+0000","last_peered":"2024-09-17T01:59:26.349754+0000","last_clean":"2024-09-17T01:59:26.349754+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:26.349754+0000","last_undegraded":"2024-09-17T01:59:26.349754+0000","last_fullsized":"2024-09-17T01:59:26.349754+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":213,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347586+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:26.347586+0000","last_peered":"2024-09-17T01:59:26.347586+0000","last_clean":"2024-09-17T01:59:26.347586+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:26.347586+0000","last_undegraded":"2024-09-17T01:59:26.347586+0000","last_fullsized":"2024-09-17T01:59:26.347586+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":697,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.819902+0000","last_change":"2024-09-17T01:59:09.358162+0000","last_active":"2024-09-17T01:59:26.819902+0000","last_peered":"2024-09-17T01:59:26.819902+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:26.819902+0000","last_undegraded":"2024-09-17T01:59:09.257380+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817250+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:26.817250+0000","last_peered":"2024-09-17T01:59:26.817250+0000","last_clean":"2024-09-17T01:59:26.817250+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:26.817250+0000","last_undegraded":"2024-09-17T01:59:26.817250+0000","last_fullsized":"2024-09-17T01:59:26.817250+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":552,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349729+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:26.349729+0000","last_peered":"2024-09-17T01:59:26.349729+0000","last_clean":"2024-09-17T01:59:26.349729+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:26.349729+0000","last_undegraded":"2024-09-17T01:59:26.349729+0000","last_fullsized":"2024-09-17T01:59:26.349729+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":612,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816916+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:26.816916+0000","last_peered":"2024-09-17T01:59:26.816916+0000","last_clean":"2024-09-17T01:59:26.816916+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:26.816916+0000","last_undegraded":"2024-09-17T01:59:26.816916+0000","last_fullsized":"2024-09-17T01:59:26.816916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":589,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814829+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:26.814829+0000","last_peered":"2024-09-17T01:59:26.814829+0000","last_clean":"2024-09-17T01:59:26.814829+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:26.814829+0000","last_undegraded":"2024-09-17T01:59:26.814829+0000","last_fullsized":"2024-09-17T01:59:26.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.346647+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:26.346647+0000","last_peered":"2024-09-17T01:59:26.346647+0000","last_clean":"2024-09-17T01:59:26.346647+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:26.346647+0000","last_undegraded":"2024-09-17T01:59:26.346647+0000","last_fullsized":"2024-09-17T01:59:26.346647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347282+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:26.347282+0000","last_peered":"2024-09-17T01:59:26.347282+0000","last_clean":"2024-09-17T01:59:26.347282+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:26.347282+0000","last_undegraded":"2024-09-17T01:59:26.347282+0000","last_fullsized":"2024-09-17T01:59:26.347282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349056+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:26.349056+0000","last_peered":"2024-09-17T01:59:26.349056+0000","last_clean":"2024-09-17T01:59:26.349056+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:26.349056+0000","last_undegraded":"2024-09-17T01:59:26.349056+0000","last_fullsized":"2024-09-17T01:59:26.349056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":616,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.818926+0000","last_change":"2024-09-17T01:59:09.355911+0000","last_active":"2024-09-17T01:59:26.818926+0000","last_peered":"2024-09-17T01:59:26.818926+0000","last_clean":"2024-09-17T01:56:19.185411+0000","last_became_active":"2024-09-17T01:59:09.349985+0000","last_became_peered":"2024-09-17T01:59:09.349985+0000","last_unstale":"2024-09-17T01:59:26.818926+0000","last_undegraded":"2024-09-17T01:59:09.252095+0000","last_fullsized":"2024-09-17T01:59:09.248489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347623+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:26.347623+0000","last_peered":"2024-09-17T01:59:26.347623+0000","last_clean":"2024-09-17T01:59:26.347623+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:26.347623+0000","last_undegraded":"2024-09-17T01:59:26.347623+0000","last_fullsized":"2024-09-17T01:59:26.347623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":352,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813130+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:26.813130+0000","last_peered":"2024-09-17T01:59:26.813130+0000","last_clean":"2024-09-17T01:59:26.813130+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:26.813130+0000","last_undegraded":"2024-09-17T01:59:26.813130+0000","last_fullsized":"2024-09-17T01:59:26.813130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":690,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819420+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:26.819420+0000","last_peered":"2024-09-17T01:59:26.819420+0000","last_clean":"2024-09-17T01:59:26.819420+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:26.819420+0000","last_undegraded":"2024-09-17T01:59:26.819420+0000","last_fullsized":"2024-09-17T01:59:26.819420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813432+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:26.813432+0000","last_peered":"2024-09-17T01:59:26.813432+0000","last_clean":"2024-09-17T01:59:26.813432+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:26.813432+0000","last_undegraded":"2024-09-17T01:59:26.813432+0000","last_fullsized":"2024-09-17T01:59:26.813432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":592,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817043+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:26.817043+0000","last_peered":"2024-09-17T01:59:26.817043+0000","last_clean":"2024-09-17T01:59:26.817043+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:26.817043+0000","last_undegraded":"2024-09-17T01:59:26.817043+0000","last_fullsized":"2024-09-17T01:59:26.817043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":552,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815142+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:26.815142+0000","last_peered":"2024-09-17T01:59:26.815142+0000","last_clean":"2024-09-17T01:59:26.815142+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:26.815142+0000","last_undegraded":"2024-09-17T01:59:26.815142+0000","last_fullsized":"2024-09-17T01:59:26.815142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347035+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:26.347035+0000","last_peered":"2024-09-17T01:59:26.347035+0000","last_clean":"2024-09-17T01:59:26.347035+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:26.347035+0000","last_undegraded":"2024-09-17T01:59:26.347035+0000","last_fullsized":"2024-09-17T01:59:26.347035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.347307+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:26.347307+0000","last_peered":"2024-09-17T01:59:26.347307+0000","last_clean":"2024-09-17T01:59:26.347307+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:26.347307+0000","last_undegraded":"2024-09-17T01:59:26.347307+0000","last_fullsized":"2024-09-17T01:59:26.347307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":597,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815178+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:26.815178+0000","last_peered":"2024-09-17T01:59:26.815178+0000","last_clean":"2024-09-17T01:59:26.815178+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:26.815178+0000","last_undegraded":"2024-09-17T01:59:26.815178+0000","last_fullsized":"2024-09-17T01:59:26.815178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":369,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349017+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:26.349017+0000","last_peered":"2024-09-17T01:59:26.349017+0000","last_clean":"2024-09-17T01:59:26.349017+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:26.349017+0000","last_undegraded":"2024-09-17T01:59:26.349017+0000","last_fullsized":"2024-09-17T01:59:26.349017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816009+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:26.816009+0000","last_peered":"2024-09-17T01:59:26.816009+0000","last_clean":"2024-09-17T01:59:26.816009+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:26.816009+0000","last_undegraded":"2024-09-17T01:59:26.816009+0000","last_fullsized":"2024-09-17T01:59:26.816009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":567,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.817765+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:26.817765+0000","last_peered":"2024-09-17T01:59:26.817765+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:26.817765+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815807+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:26.815807+0000","last_peered":"2024-09-17T01:59:26.815807+0000","last_clean":"2024-09-17T01:59:26.815807+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:26.815807+0000","last_undegraded":"2024-09-17T01:59:26.815807+0000","last_fullsized":"2024-09-17T01:59:26.815807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.820487+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:26.820487+0000","last_peered":"2024-09-17T01:59:26.820487+0000","last_clean":"2024-09-17T01:59:26.820487+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:26.820487+0000","last_undegraded":"2024-09-17T01:59:26.820487+0000","last_fullsized":"2024-09-17T01:59:26.820487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":987,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817773+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:26.817773+0000","last_peered":"2024-09-17T01:59:26.817773+0000","last_clean":"2024-09-17T01:59:26.817773+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:26.817773+0000","last_undegraded":"2024-09-17T01:59:26.817773+0000","last_fullsized":"2024-09-17T01:59:26.817773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816011+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:26.816011+0000","last_peered":"2024-09-17T01:59:26.816011+0000","last_clean":"2024-09-17T01:59:26.816011+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:26.816011+0000","last_undegraded":"2024-09-17T01:59:26.816011+0000","last_fullsized":"2024-09-17T01:59:26.816011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816435+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:26.816435+0000","last_peered":"2024-09-17T01:59:26.816435+0000","last_clean":"2024-09-17T01:59:26.816435+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:26.816435+0000","last_undegraded":"2024-09-17T01:59:26.816435+0000","last_fullsized":"2024-09-17T01:59:26.816435+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":594,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.813365+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:26.813365+0000","last_peered":"2024-09-17T01:59:26.813365+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:26.813365+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":284,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816283+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:26.816283+0000","last_peered":"2024-09-17T01:59:26.816283+0000","last_clean":"2024-09-17T01:59:26.816283+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:26.816283+0000","last_undegraded":"2024-09-17T01:59:26.816283+0000","last_fullsized":"2024-09-17T01:59:26.816283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349203+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:26.349203+0000","last_peered":"2024-09-17T01:59:26.349203+0000","last_clean":"2024-09-17T01:59:26.349203+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:26.349203+0000","last_undegraded":"2024-09-17T01:59:26.349203+0000","last_fullsized":"2024-09-17T01:59:26.349203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1021,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816938+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:26.816938+0000","last_peered":"2024-09-17T01:59:26.816938+0000","last_clean":"2024-09-17T01:59:26.816938+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:26.816938+0000","last_undegraded":"2024-09-17T01:59:26.816938+0000","last_fullsized":"2024-09-17T01:59:26.816938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":588,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348356+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:26.348356+0000","last_peered":"2024-09-17T01:59:26.348356+0000","last_clean":"2024-09-17T01:59:26.348356+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:26.348356+0000","last_undegraded":"2024-09-17T01:59:26.348356+0000","last_fullsized":"2024-09-17T01:59:26.348356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":411,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348346+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:26.348346+0000","last_peered":"2024-09-17T01:59:26.348346+0000","last_clean":"2024-09-17T01:59:26.348346+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:26.348346+0000","last_undegraded":"2024-09-17T01:59:26.348346+0000","last_fullsized":"2024-09-17T01:59:26.348346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813485+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:26.813485+0000","last_peered":"2024-09-17T01:59:26.813485+0000","last_clean":"2024-09-17T01:59:26.813485+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:26.813485+0000","last_undegraded":"2024-09-17T01:59:26.813485+0000","last_fullsized":"2024-09-17T01:59:26.813485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":251,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.820117+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:26.820117+0000","last_peered":"2024-09-17T01:59:26.820117+0000","last_clean":"2024-09-17T01:59:26.820117+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:26.820117+0000","last_undegraded":"2024-09-17T01:59:26.820117+0000","last_fullsized":"2024-09-17T01:59:26.820117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":305,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.349555+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:26.349555+0000","last_peered":"2024-09-17T01:59:26.349555+0000","last_clean":"2024-09-17T01:59:26.349555+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:26.349555+0000","last_undegraded":"2024-09-17T01:59:26.349555+0000","last_fullsized":"2024-09-17T01:59:26.349555+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":736,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812920+0000","last_change":"2024-09-17T01:59:09.361052+0000","last_active":"2024-09-17T01:59:26.812920+0000","last_peered":"2024-09-17T01:59:26.812920+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:26.812920+0000","last_undegraded":"2024-09-17T01:59:09.243588+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":216,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815635+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:26.815635+0000","last_peered":"2024-09-17T01:59:26.815635+0000","last_clean":"2024-09-17T01:59:26.815635+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:26.815635+0000","last_undegraded":"2024-09-17T01:59:26.815635+0000","last_fullsized":"2024-09-17T01:59:26.815635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":673,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813587+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:26.813587+0000","last_peered":"2024-09-17T01:59:26.813587+0000","last_clean":"2024-09-17T01:59:26.813587+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:26.813587+0000","last_undegraded":"2024-09-17T01:59:26.813587+0000","last_fullsized":"2024-09-17T01:59:26.813587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":859,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819988+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:26.819988+0000","last_peered":"2024-09-17T01:59:26.819988+0000","last_clean":"2024-09-17T01:59:26.819988+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:26.819988+0000","last_undegraded":"2024-09-17T01:59:26.819988+0000","last_fullsized":"2024-09-17T01:59:26.819988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":783,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813726+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:26.813726+0000","last_peered":"2024-09-17T01:59:26.813726+0000","last_clean":"2024-09-17T01:59:26.813726+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:26.813726+0000","last_undegraded":"2024-09-17T01:59:26.813726+0000","last_fullsized":"2024-09-17T01:59:26.813726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":942,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814812+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:26.814812+0000","last_peered":"2024-09-17T01:59:26.814812+0000","last_clean":"2024-09-17T01:59:26.814812+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:26.814812+0000","last_undegraded":"2024-09-17T01:59:26.814812+0000","last_fullsized":"2024-09-17T01:59:26.814812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":371,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812838+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:26.812838+0000","last_peered":"2024-09-17T01:59:26.812838+0000","last_clean":"2024-09-17T01:59:26.812838+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:26.812838+0000","last_undegraded":"2024-09-17T01:59:26.812838+0000","last_fullsized":"2024-09-17T01:59:26.812838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":593,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.818946+0000","last_change":"2024-09-17T01:59:09.355604+0000","last_active":"2024-09-17T01:59:26.818946+0000","last_peered":"2024-09-17T01:59:26.818946+0000","last_clean":"2024-09-17T01:56:19.136297+0000","last_became_active":"2024-09-17T01:59:09.347969+0000","last_became_peered":"2024-09-17T01:59:09.347969+0000","last_unstale":"2024-09-17T01:59:26.818946+0000","last_undegraded":"2024-09-17T01:59:09.248244+0000","last_fullsized":"2024-09-17T01:59:09.223371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":429,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818696+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:26.818696+0000","last_peered":"2024-09-17T01:59:26.818696+0000","last_clean":"2024-09-17T01:59:26.818696+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:26.818696+0000","last_undegraded":"2024-09-17T01:59:26.818696+0000","last_fullsized":"2024-09-17T01:59:26.818696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":569,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818835+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:26.818835+0000","last_peered":"2024-09-17T01:59:26.818835+0000","last_clean":"2024-09-17T01:59:26.818835+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:26.818835+0000","last_undegraded":"2024-09-17T01:59:26.818835+0000","last_fullsized":"2024-09-17T01:59:26.818835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":218,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818057+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:26.818057+0000","last_peered":"2024-09-17T01:59:26.818057+0000","last_clean":"2024-09-17T01:59:26.818057+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:26.818057+0000","last_undegraded":"2024-09-17T01:59:26.818057+0000","last_fullsized":"2024-09-17T01:59:26.818057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":609,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348332+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:26.348332+0000","last_peered":"2024-09-17T01:59:26.348332+0000","last_clean":"2024-09-17T01:59:26.348332+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:26.348332+0000","last_undegraded":"2024-09-17T01:59:26.348332+0000","last_fullsized":"2024-09-17T01:59:26.348332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.348333+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:26.348333+0000","last_peered":"2024-09-17T01:59:26.348333+0000","last_clean":"2024-09-17T01:59:26.348333+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:26.348333+0000","last_undegraded":"2024-09-17T01:59:26.348333+0000","last_fullsized":"2024-09-17T01:59:26.348333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":554,"reported_epoch":86,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:21.823578+0000","last_change":"2024-09-17T01:59:09.359162+0000","last_active":"2024-09-17T01:59:21.823578+0000","last_peered":"2024-09-17T01:59:21.823578+0000","last_clean":"2024-09-17T01:56:19.006818+0000","last_became_active":"2024-09-17T01:59:09.351483+0000","last_became_peered":"2024-09-17T01:59:09.351483+0000","last_unstale":"2024-09-17T01:59:21.823578+0000","last_undegraded":"2024-09-17T01:59:09.240046+0000","last_fullsized":"2024-09-17T01:59:09.225735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":443,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819844+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:26.819844+0000","last_peered":"2024-09-17T01:59:26.819844+0000","last_clean":"2024-09-17T01:59:26.819844+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:26.819844+0000","last_undegraded":"2024-09-17T01:59:26.819844+0000","last_fullsized":"2024-09-17T01:59:26.819844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":664,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817576+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:26.817576+0000","last_peered":"2024-09-17T01:59:26.817576+0000","last_clean":"2024-09-17T01:59:26.817576+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:26.817576+0000","last_undegraded":"2024-09-17T01:59:26.817576+0000","last_fullsized":"2024-09-17T01:59:26.817576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":199,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815984+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:26.815984+0000","last_peered":"2024-09-17T01:59:26.815984+0000","last_clean":"2024-09-17T01:59:26.815984+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:26.815984+0000","last_undegraded":"2024-09-17T01:59:26.815984+0000","last_fullsized":"2024-09-17T01:59:26.815984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":704,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.811971+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:26.811971+0000","last_peered":"2024-09-17T01:59:26.811971+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:26.811971+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":227,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815699+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:26.815699+0000","last_peered":"2024-09-17T01:59:26.815699+0000","last_clean":"2024-09-17T01:59:26.815699+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:26.815699+0000","last_undegraded":"2024-09-17T01:59:26.815699+0000","last_fullsized":"2024-09-17T01:59:26.815699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2831,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4084,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17346560,"data_stored":16113126,"data_compressed":1427716,"data_compressed_allocated":1867776,"data_compressed_original":6246400,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":111,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59844,"kb_used_data":30888,"kb_used_omap":174,"kb_used_meta":28753,"kb_avail":94311996,"statfs":{"total":96636764160,"available":96575483904,"internally_reserved":0,"allocated":31629312,"data_stored":116237989,"data_compressed":9578200,"data_compressed_allocated":13713408,"data_compressed_original":105086976,"omap_allocated":179054,"internal_metadata":29443218},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95168,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276672,"statfs":{"total":96636764160,"available":96539312128,"internally_reserved":0,"allocated":24350720,"data_stored":84998397,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91796,"kb_used_data":20416,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94280044,"statfs":{"total":96636764160,"available":96542765056,"internally_reserved":0,"allocated":20905984,"data_stored":73160440,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17346560,"data_stored":16113126,"data_compressed":1427716,"data_compressed_allocated":1867776,"data_compressed_original":6246400,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:31.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:32.260 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:32.276 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-17T01:59:32.096197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1965,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4947,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":249040,"kb_used_data":64844,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282866480,"statfs":{"total":289910292480,"available":289655275520,"internally_reserved":0,"allocated":66400256,"data_stored":264906600,"data_compressed":20499781,"data_compressed_allocated":33206272,"data_compressed_original":236683264,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-866,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":841,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001208"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":649,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819637+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:26.819637+0000","last_peered":"2024-09-17T01:59:26.819637+0000","last_clean":"2024-09-17T01:59:26.819637+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:26.819637+0000","last_undegraded":"2024-09-17T01:59:26.819637+0000","last_fullsized":"2024-09-17T01:59:26.819637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":642,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818948+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:26.818948+0000","last_peered":"2024-09-17T01:59:26.818948+0000","last_clean":"2024-09-17T01:59:26.818948+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:26.818948+0000","last_undegraded":"2024-09-17T01:59:26.818948+0000","last_fullsized":"2024-09-17T01:59:26.818948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377351+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:31.377351+0000","last_peered":"2024-09-17T01:59:31.377351+0000","last_clean":"2024-09-17T01:59:31.377351+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:31.377351+0000","last_undegraded":"2024-09-17T01:59:31.377351+0000","last_fullsized":"2024-09-17T01:59:31.377351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376146+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:31.376146+0000","last_peered":"2024-09-17T01:59:31.376146+0000","last_clean":"2024-09-17T01:59:31.376146+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:31.376146+0000","last_undegraded":"2024-09-17T01:59:31.376146+0000","last_fullsized":"2024-09-17T01:59:31.376146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817884+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:26.817884+0000","last_peered":"2024-09-17T01:59:26.817884+0000","last_clean":"2024-09-17T01:59:26.817884+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:26.817884+0000","last_undegraded":"2024-09-17T01:59:26.817884+0000","last_fullsized":"2024-09-17T01:59:26.817884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376297+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:31.376297+0000","last_peered":"2024-09-17T01:59:31.376297+0000","last_clean":"2024-09-17T01:59:31.376297+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:31.376297+0000","last_undegraded":"2024-09-17T01:59:31.376297+0000","last_fullsized":"2024-09-17T01:59:31.376297+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":675,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375036+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:31.375036+0000","last_peered":"2024-09-17T01:59:31.375036+0000","last_clean":"2024-09-17T01:59:31.375036+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:31.375036+0000","last_undegraded":"2024-09-17T01:59:31.375036+0000","last_fullsized":"2024-09-17T01:59:31.375036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":557,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812710+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:26.812710+0000","last_peered":"2024-09-17T01:59:26.812710+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:26.812710+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":606,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814436+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:26.814436+0000","last_peered":"2024-09-17T01:59:26.814436+0000","last_clean":"2024-09-17T01:59:26.814436+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:26.814436+0000","last_undegraded":"2024-09-17T01:59:26.814436+0000","last_fullsized":"2024-09-17T01:59:26.814436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":572,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819199+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:26.819199+0000","last_peered":"2024-09-17T01:59:26.819199+0000","last_clean":"2024-09-17T01:59:26.819199+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:26.819199+0000","last_undegraded":"2024-09-17T01:59:26.819199+0000","last_fullsized":"2024-09-17T01:59:26.819199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":523,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377074+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:31.377074+0000","last_peered":"2024-09-17T01:59:31.377074+0000","last_clean":"2024-09-17T01:59:31.377074+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:31.377074+0000","last_undegraded":"2024-09-17T01:59:31.377074+0000","last_fullsized":"2024-09-17T01:59:31.377074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":855,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818325+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:26.818325+0000","last_peered":"2024-09-17T01:59:26.818325+0000","last_clean":"2024-09-17T01:59:26.818325+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:26.818325+0000","last_undegraded":"2024-09-17T01:59:26.818325+0000","last_fullsized":"2024-09-17T01:59:26.818325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":548,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817383+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:26.817383+0000","last_peered":"2024-09-17T01:59:26.817383+0000","last_clean":"2024-09-17T01:59:26.817383+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:26.817383+0000","last_undegraded":"2024-09-17T01:59:26.817383+0000","last_fullsized":"2024-09-17T01:59:26.817383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":622,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.376391+0000","last_change":"2024-09-17T01:59:31.376391+0000","last_active":"2024-09-17T01:59:08.216700+0000","last_peered":"2024-09-17T01:59:06.196479+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:56:20.334288+0000","last_became_peered":"2024-09-17T01:56:20.334288+0000","last_unstale":"2024-09-17T01:59:31.376391+0000","last_undegraded":"2024-09-17T01:59:31.376391+0000","last_fullsized":"2024-09-17T01:59:31.376391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375006+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:31.375006+0000","last_peered":"2024-09-17T01:59:31.375006+0000","last_clean":"2024-09-17T01:59:31.375006+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:31.375006+0000","last_undegraded":"2024-09-17T01:59:31.375006+0000","last_fullsized":"2024-09-17T01:59:31.375006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":670,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812184+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:26.812184+0000","last_peered":"2024-09-17T01:59:26.812184+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:26.812184+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":570,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816068+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:26.816068+0000","last_peered":"2024-09-17T01:59:26.816068+0000","last_clean":"2024-09-17T01:59:26.816068+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:26.816068+0000","last_undegraded":"2024-09-17T01:59:26.816068+0000","last_fullsized":"2024-09-17T01:59:26.816068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":599,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819789+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:26.819789+0000","last_peered":"2024-09-17T01:59:26.819789+0000","last_clean":"2024-09-17T01:59:26.819789+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:26.819789+0000","last_undegraded":"2024-09-17T01:59:26.819789+0000","last_fullsized":"2024-09-17T01:59:26.819789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":654,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814509+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:26.814509+0000","last_peered":"2024-09-17T01:59:26.814509+0000","last_clean":"2024-09-17T01:59:26.814509+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:26.814509+0000","last_undegraded":"2024-09-17T01:59:26.814509+0000","last_fullsized":"2024-09-17T01:59:26.814509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":677,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376984+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:31.376984+0000","last_peered":"2024-09-17T01:59:31.376984+0000","last_clean":"2024-09-17T01:59:31.376984+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:31.376984+0000","last_undegraded":"2024-09-17T01:59:31.376984+0000","last_fullsized":"2024-09-17T01:59:31.376984+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":537,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.378383+0000","last_change":"2024-09-17T01:59:31.378383+0000","last_active":"2024-09-17T01:59:08.228666+0000","last_peered":"2024-09-17T01:59:06.603880+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:56:20.342833+0000","last_became_peered":"2024-09-17T01:56:20.342833+0000","last_unstale":"2024-09-17T01:59:31.378383+0000","last_undegraded":"2024-09-17T01:59:31.378383+0000","last_fullsized":"2024-09-17T01:59:31.378383+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1147,"reported_epoch":90,"state":"peering","last_fresh":"2024-09-17T01:59:26.595518+0000","last_change":"2024-09-17T01:59:26.819342+0000","last_active":"2024-09-17T01:59:26.819342+0000","last_peered":"2024-09-17T01:59:26.595518+0000","last_clean":"2024-09-17T01:56:19.175808+0000","last_became_active":"2024-09-17T01:59:09.347955+0000","last_became_peered":"2024-09-17T01:59:09.347955+0000","last_unstale":"2024-09-17T01:59:26.595518+0000","last_undegraded":"2024-09-17T01:59:26.595518+0000","last_fullsized":"2024-09-17T01:59:09.221213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1053,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812197+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:26.812197+0000","last_peered":"2024-09-17T01:59:26.812197+0000","last_clean":"2024-09-17T01:59:26.812197+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:26.812197+0000","last_undegraded":"2024-09-17T01:59:26.812197+0000","last_fullsized":"2024-09-17T01:59:26.812197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816581+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:26.816581+0000","last_peered":"2024-09-17T01:59:26.816581+0000","last_clean":"2024-09-17T01:59:26.816581+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:26.816581+0000","last_undegraded":"2024-09-17T01:59:26.816581+0000","last_fullsized":"2024-09-17T01:59:26.816581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":996,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819697+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:26.819697+0000","last_peered":"2024-09-17T01:59:26.819697+0000","last_clean":"2024-09-17T01:59:26.819697+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:26.819697+0000","last_undegraded":"2024-09-17T01:59:26.819697+0000","last_fullsized":"2024-09-17T01:59:26.819697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1076,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815283+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:26.815283+0000","last_peered":"2024-09-17T01:59:26.815283+0000","last_clean":"2024-09-17T01:59:26.815283+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:26.815283+0000","last_undegraded":"2024-09-17T01:59:26.815283+0000","last_fullsized":"2024-09-17T01:59:26.815283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":590,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.820427+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:26.820427+0000","last_peered":"2024-09-17T01:59:26.820427+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:26.820427+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":945,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818974+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:26.818974+0000","last_peered":"2024-09-17T01:59:26.818974+0000","last_clean":"2024-09-17T01:59:26.818974+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:26.818974+0000","last_undegraded":"2024-09-17T01:59:26.818974+0000","last_fullsized":"2024-09-17T01:59:26.818974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":594,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814183+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:26.814183+0000","last_peered":"2024-09-17T01:59:26.814183+0000","last_clean":"2024-09-17T01:59:26.814183+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:26.814183+0000","last_undegraded":"2024-09-17T01:59:26.814183+0000","last_fullsized":"2024-09-17T01:59:26.814183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1035,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818367+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:26.818367+0000","last_peered":"2024-09-17T01:59:26.818367+0000","last_clean":"2024-09-17T01:59:26.818367+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:26.818367+0000","last_undegraded":"2024-09-17T01:59:26.818367+0000","last_fullsized":"2024-09-17T01:59:26.818367+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":655,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812372+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:26.812372+0000","last_peered":"2024-09-17T01:59:26.812372+0000","last_clean":"2024-09-17T01:59:26.812372+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:26.812372+0000","last_undegraded":"2024-09-17T01:59:26.812372+0000","last_fullsized":"2024-09-17T01:59:26.812372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374437+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:31.374437+0000","last_peered":"2024-09-17T01:59:31.374437+0000","last_clean":"2024-09-17T01:59:31.374437+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:31.374437+0000","last_undegraded":"2024-09-17T01:59:31.374437+0000","last_fullsized":"2024-09-17T01:59:31.374437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":622,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818763+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:26.818763+0000","last_peered":"2024-09-17T01:59:26.818763+0000","last_clean":"2024-09-17T01:59:26.818763+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:26.818763+0000","last_undegraded":"2024-09-17T01:59:26.818763+0000","last_fullsized":"2024-09-17T01:59:26.818763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":566,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375754+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:31.375754+0000","last_peered":"2024-09-17T01:59:31.375754+0000","last_clean":"2024-09-17T01:59:31.375754+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:31.375754+0000","last_undegraded":"2024-09-17T01:59:31.375754+0000","last_fullsized":"2024-09-17T01:59:31.375754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":643,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819619+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:26.819619+0000","last_peered":"2024-09-17T01:59:26.819619+0000","last_clean":"2024-09-17T01:59:26.819619+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:26.819619+0000","last_undegraded":"2024-09-17T01:59:26.819619+0000","last_fullsized":"2024-09-17T01:59:26.819619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815232+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:26.815232+0000","last_peered":"2024-09-17T01:59:26.815232+0000","last_clean":"2024-09-17T01:59:26.815232+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:26.815232+0000","last_undegraded":"2024-09-17T01:59:26.815232+0000","last_fullsized":"2024-09-17T01:59:26.815232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":949,"reported_epoch":91,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:27.129379+0000","last_change":"2024-09-17T01:59:26.600174+0000","last_active":"2024-09-17T01:59:27.129379+0000","last_peered":"2024-09-17T01:59:27.129379+0000","last_clean":"2024-09-17T01:56:19.307562+0000","last_became_active":"2024-09-17T01:59:09.346790+0000","last_became_peered":"2024-09-17T01:59:09.346790+0000","last_unstale":"2024-09-17T01:59:27.129379+0000","last_undegraded":"2024-09-17T01:59:27.129379+0000","last_fullsized":"2024-09-17T01:59:09.253040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":244,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817383+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:26.817383+0000","last_peered":"2024-09-17T01:59:26.817383+0000","last_clean":"2024-09-17T01:59:26.817383+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:26.817383+0000","last_undegraded":"2024-09-17T01:59:26.817383+0000","last_fullsized":"2024-09-17T01:59:26.817383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":627,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.814757+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:26.814757+0000","last_peered":"2024-09-17T01:59:26.814757+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:26.814757+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374343+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:31.374343+0000","last_peered":"2024-09-17T01:59:31.374343+0000","last_clean":"2024-09-17T01:59:31.374343+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:31.374343+0000","last_undegraded":"2024-09-17T01:59:31.374343+0000","last_fullsized":"2024-09-17T01:59:31.374343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376911+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:31.376911+0000","last_peered":"2024-09-17T01:59:31.376911+0000","last_clean":"2024-09-17T01:59:31.376911+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:31.376911+0000","last_undegraded":"2024-09-17T01:59:31.376911+0000","last_fullsized":"2024-09-17T01:59:31.376911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":969,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816718+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:26.816718+0000","last_peered":"2024-09-17T01:59:26.816718+0000","last_clean":"2024-09-17T01:59:26.816718+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:26.816718+0000","last_undegraded":"2024-09-17T01:59:26.816718+0000","last_fullsized":"2024-09-17T01:59:26.816718+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":436,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819736+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:26.819736+0000","last_peered":"2024-09-17T01:59:26.819736+0000","last_clean":"2024-09-17T01:59:26.819736+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:26.819736+0000","last_undegraded":"2024-09-17T01:59:26.819736+0000","last_fullsized":"2024-09-17T01:59:26.819736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":629,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816919+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:26.816919+0000","last_peered":"2024-09-17T01:59:26.816919+0000","last_clean":"2024-09-17T01:59:26.816919+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:26.816919+0000","last_undegraded":"2024-09-17T01:59:26.816919+0000","last_fullsized":"2024-09-17T01:59:26.816919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376497+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:31.376497+0000","last_peered":"2024-09-17T01:59:31.376497+0000","last_clean":"2024-09-17T01:59:31.376497+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:31.376497+0000","last_undegraded":"2024-09-17T01:59:31.376497+0000","last_fullsized":"2024-09-17T01:59:31.376497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":674,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.815237+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:26.815237+0000","last_peered":"2024-09-17T01:59:26.815237+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:26.815237+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376412+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:31.376412+0000","last_peered":"2024-09-17T01:59:31.376412+0000","last_clean":"2024-09-17T01:59:31.376412+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:31.376412+0000","last_undegraded":"2024-09-17T01:59:31.376412+0000","last_fullsized":"2024-09-17T01:59:31.376412+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":985,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813622+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:26.813622+0000","last_peered":"2024-09-17T01:59:26.813622+0000","last_clean":"2024-09-17T01:59:26.813622+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:26.813622+0000","last_undegraded":"2024-09-17T01:59:26.813622+0000","last_fullsized":"2024-09-17T01:59:26.813622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":328,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814537+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:26.814537+0000","last_peered":"2024-09-17T01:59:26.814537+0000","last_clean":"2024-09-17T01:59:26.814537+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:26.814537+0000","last_undegraded":"2024-09-17T01:59:26.814537+0000","last_fullsized":"2024-09-17T01:59:26.814537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":627,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377444+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:31.377444+0000","last_peered":"2024-09-17T01:59:31.377444+0000","last_clean":"2024-09-17T01:59:31.377444+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:31.377444+0000","last_undegraded":"2024-09-17T01:59:31.377444+0000","last_fullsized":"2024-09-17T01:59:31.377444+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375212+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:31.375212+0000","last_peered":"2024-09-17T01:59:31.375212+0000","last_clean":"2024-09-17T01:59:31.375212+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:31.375212+0000","last_undegraded":"2024-09-17T01:59:31.375212+0000","last_fullsized":"2024-09-17T01:59:31.375212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":697,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.819902+0000","last_change":"2024-09-17T01:59:09.358162+0000","last_active":"2024-09-17T01:59:26.819902+0000","last_peered":"2024-09-17T01:59:26.819902+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:26.819902+0000","last_undegraded":"2024-09-17T01:59:09.257380+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817250+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:26.817250+0000","last_peered":"2024-09-17T01:59:26.817250+0000","last_clean":"2024-09-17T01:59:26.817250+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:26.817250+0000","last_undegraded":"2024-09-17T01:59:26.817250+0000","last_fullsized":"2024-09-17T01:59:26.817250+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377192+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:31.377192+0000","last_peered":"2024-09-17T01:59:31.377192+0000","last_clean":"2024-09-17T01:59:31.377192+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:31.377192+0000","last_undegraded":"2024-09-17T01:59:31.377192+0000","last_fullsized":"2024-09-17T01:59:31.377192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":612,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816916+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:26.816916+0000","last_peered":"2024-09-17T01:59:26.816916+0000","last_clean":"2024-09-17T01:59:26.816916+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:26.816916+0000","last_undegraded":"2024-09-17T01:59:26.816916+0000","last_fullsized":"2024-09-17T01:59:26.816916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":589,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814829+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:26.814829+0000","last_peered":"2024-09-17T01:59:26.814829+0000","last_clean":"2024-09-17T01:59:26.814829+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:26.814829+0000","last_undegraded":"2024-09-17T01:59:26.814829+0000","last_fullsized":"2024-09-17T01:59:26.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":265,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374111+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:31.374111+0000","last_peered":"2024-09-17T01:59:31.374111+0000","last_clean":"2024-09-17T01:59:31.374111+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:31.374111+0000","last_undegraded":"2024-09-17T01:59:31.374111+0000","last_fullsized":"2024-09-17T01:59:31.374111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374901+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:31.374901+0000","last_peered":"2024-09-17T01:59:31.374901+0000","last_clean":"2024-09-17T01:59:31.374901+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:31.374901+0000","last_undegraded":"2024-09-17T01:59:31.374901+0000","last_fullsized":"2024-09-17T01:59:31.374901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":510,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376571+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:31.376571+0000","last_peered":"2024-09-17T01:59:31.376571+0000","last_clean":"2024-09-17T01:59:31.376571+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:31.376571+0000","last_undegraded":"2024-09-17T01:59:31.376571+0000","last_fullsized":"2024-09-17T01:59:31.376571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.388121+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:31.388121+0000","last_peered":"2024-09-17T01:59:31.388121+0000","last_clean":"2024-09-17T01:59:31.388121+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:31.388121+0000","last_undegraded":"2024-09-17T01:59:31.388121+0000","last_fullsized":"2024-09-17T01:59:31.388121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374943+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:31.374943+0000","last_peered":"2024-09-17T01:59:31.374943+0000","last_clean":"2024-09-17T01:59:31.374943+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:31.374943+0000","last_undegraded":"2024-09-17T01:59:31.374943+0000","last_fullsized":"2024-09-17T01:59:31.374943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":352,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813130+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:26.813130+0000","last_peered":"2024-09-17T01:59:26.813130+0000","last_clean":"2024-09-17T01:59:26.813130+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:26.813130+0000","last_undegraded":"2024-09-17T01:59:26.813130+0000","last_fullsized":"2024-09-17T01:59:26.813130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":690,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819420+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:26.819420+0000","last_peered":"2024-09-17T01:59:26.819420+0000","last_clean":"2024-09-17T01:59:26.819420+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:26.819420+0000","last_undegraded":"2024-09-17T01:59:26.819420+0000","last_fullsized":"2024-09-17T01:59:26.819420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813432+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:26.813432+0000","last_peered":"2024-09-17T01:59:26.813432+0000","last_clean":"2024-09-17T01:59:26.813432+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:26.813432+0000","last_undegraded":"2024-09-17T01:59:26.813432+0000","last_fullsized":"2024-09-17T01:59:26.813432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":592,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817043+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:26.817043+0000","last_peered":"2024-09-17T01:59:26.817043+0000","last_clean":"2024-09-17T01:59:26.817043+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:26.817043+0000","last_undegraded":"2024-09-17T01:59:26.817043+0000","last_fullsized":"2024-09-17T01:59:26.817043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":552,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815142+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:26.815142+0000","last_peered":"2024-09-17T01:59:26.815142+0000","last_clean":"2024-09-17T01:59:26.815142+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:26.815142+0000","last_undegraded":"2024-09-17T01:59:26.815142+0000","last_fullsized":"2024-09-17T01:59:26.815142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374605+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:31.374605+0000","last_peered":"2024-09-17T01:59:31.374605+0000","last_clean":"2024-09-17T01:59:31.374605+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:31.374605+0000","last_undegraded":"2024-09-17T01:59:31.374605+0000","last_fullsized":"2024-09-17T01:59:31.374605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375434+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:31.375434+0000","last_peered":"2024-09-17T01:59:31.375434+0000","last_clean":"2024-09-17T01:59:31.375434+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:31.375434+0000","last_undegraded":"2024-09-17T01:59:31.375434+0000","last_fullsized":"2024-09-17T01:59:31.375434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":597,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815178+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:26.815178+0000","last_peered":"2024-09-17T01:59:26.815178+0000","last_clean":"2024-09-17T01:59:26.815178+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:26.815178+0000","last_undegraded":"2024-09-17T01:59:26.815178+0000","last_fullsized":"2024-09-17T01:59:26.815178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":379,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375814+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:31.375814+0000","last_peered":"2024-09-17T01:59:31.375814+0000","last_clean":"2024-09-17T01:59:31.375814+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:31.375814+0000","last_undegraded":"2024-09-17T01:59:31.375814+0000","last_fullsized":"2024-09-17T01:59:31.375814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816009+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:26.816009+0000","last_peered":"2024-09-17T01:59:26.816009+0000","last_clean":"2024-09-17T01:59:26.816009+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:26.816009+0000","last_undegraded":"2024-09-17T01:59:26.816009+0000","last_fullsized":"2024-09-17T01:59:26.816009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":567,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.817765+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:26.817765+0000","last_peered":"2024-09-17T01:59:26.817765+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:26.817765+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":217,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815807+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:26.815807+0000","last_peered":"2024-09-17T01:59:26.815807+0000","last_clean":"2024-09-17T01:59:26.815807+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:26.815807+0000","last_undegraded":"2024-09-17T01:59:26.815807+0000","last_fullsized":"2024-09-17T01:59:26.815807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.820487+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:26.820487+0000","last_peered":"2024-09-17T01:59:26.820487+0000","last_clean":"2024-09-17T01:59:26.820487+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:26.820487+0000","last_undegraded":"2024-09-17T01:59:26.820487+0000","last_fullsized":"2024-09-17T01:59:26.820487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":987,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817773+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:26.817773+0000","last_peered":"2024-09-17T01:59:26.817773+0000","last_clean":"2024-09-17T01:59:26.817773+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:26.817773+0000","last_undegraded":"2024-09-17T01:59:26.817773+0000","last_fullsized":"2024-09-17T01:59:26.817773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":210,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816011+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:26.816011+0000","last_peered":"2024-09-17T01:59:26.816011+0000","last_clean":"2024-09-17T01:59:26.816011+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:26.816011+0000","last_undegraded":"2024-09-17T01:59:26.816011+0000","last_fullsized":"2024-09-17T01:59:26.816011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816435+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:26.816435+0000","last_peered":"2024-09-17T01:59:26.816435+0000","last_clean":"2024-09-17T01:59:26.816435+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:26.816435+0000","last_undegraded":"2024-09-17T01:59:26.816435+0000","last_fullsized":"2024-09-17T01:59:26.816435+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":594,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.813365+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:26.813365+0000","last_peered":"2024-09-17T01:59:26.813365+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:26.813365+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":284,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816283+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:26.816283+0000","last_peered":"2024-09-17T01:59:26.816283+0000","last_clean":"2024-09-17T01:59:26.816283+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:26.816283+0000","last_undegraded":"2024-09-17T01:59:26.816283+0000","last_fullsized":"2024-09-17T01:59:26.816283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376188+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:31.376188+0000","last_peered":"2024-09-17T01:59:31.376188+0000","last_clean":"2024-09-17T01:59:31.376188+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:31.376188+0000","last_undegraded":"2024-09-17T01:59:31.376188+0000","last_fullsized":"2024-09-17T01:59:31.376188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1021,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.816938+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:26.816938+0000","last_peered":"2024-09-17T01:59:26.816938+0000","last_clean":"2024-09-17T01:59:26.816938+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:26.816938+0000","last_undegraded":"2024-09-17T01:59:26.816938+0000","last_fullsized":"2024-09-17T01:59:26.816938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":598,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376759+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:31.376759+0000","last_peered":"2024-09-17T01:59:31.376759+0000","last_clean":"2024-09-17T01:59:31.376759+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:31.376759+0000","last_undegraded":"2024-09-17T01:59:31.376759+0000","last_fullsized":"2024-09-17T01:59:31.376759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":421,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375465+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:31.375465+0000","last_peered":"2024-09-17T01:59:31.375465+0000","last_clean":"2024-09-17T01:59:31.375465+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:31.375465+0000","last_undegraded":"2024-09-17T01:59:31.375465+0000","last_fullsized":"2024-09-17T01:59:31.375465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":646,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813485+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:26.813485+0000","last_peered":"2024-09-17T01:59:26.813485+0000","last_clean":"2024-09-17T01:59:26.813485+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:26.813485+0000","last_undegraded":"2024-09-17T01:59:26.813485+0000","last_fullsized":"2024-09-17T01:59:26.813485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":251,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.820117+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:26.820117+0000","last_peered":"2024-09-17T01:59:26.820117+0000","last_clean":"2024-09-17T01:59:26.820117+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:26.820117+0000","last_undegraded":"2024-09-17T01:59:26.820117+0000","last_fullsized":"2024-09-17T01:59:26.820117+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":315,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376928+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:31.376928+0000","last_peered":"2024-09-17T01:59:31.376928+0000","last_clean":"2024-09-17T01:59:31.376928+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:31.376928+0000","last_undegraded":"2024-09-17T01:59:31.376928+0000","last_fullsized":"2024-09-17T01:59:31.376928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":736,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.812920+0000","last_change":"2024-09-17T01:59:09.361052+0000","last_active":"2024-09-17T01:59:26.812920+0000","last_peered":"2024-09-17T01:59:26.812920+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:26.812920+0000","last_undegraded":"2024-09-17T01:59:09.243588+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":206,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":216,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815635+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:26.815635+0000","last_peered":"2024-09-17T01:59:26.815635+0000","last_clean":"2024-09-17T01:59:26.815635+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:26.815635+0000","last_undegraded":"2024-09-17T01:59:26.815635+0000","last_fullsized":"2024-09-17T01:59:26.815635+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":673,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813587+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:26.813587+0000","last_peered":"2024-09-17T01:59:26.813587+0000","last_clean":"2024-09-17T01:59:26.813587+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:26.813587+0000","last_undegraded":"2024-09-17T01:59:26.813587+0000","last_fullsized":"2024-09-17T01:59:26.813587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":859,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819988+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:26.819988+0000","last_peered":"2024-09-17T01:59:26.819988+0000","last_clean":"2024-09-17T01:59:26.819988+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:26.819988+0000","last_undegraded":"2024-09-17T01:59:26.819988+0000","last_fullsized":"2024-09-17T01:59:26.819988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":783,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.813726+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:26.813726+0000","last_peered":"2024-09-17T01:59:26.813726+0000","last_clean":"2024-09-17T01:59:26.813726+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:26.813726+0000","last_undegraded":"2024-09-17T01:59:26.813726+0000","last_fullsized":"2024-09-17T01:59:26.813726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":942,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.814812+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:26.814812+0000","last_peered":"2024-09-17T01:59:26.814812+0000","last_clean":"2024-09-17T01:59:26.814812+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:26.814812+0000","last_undegraded":"2024-09-17T01:59:26.814812+0000","last_fullsized":"2024-09-17T01:59:26.814812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":371,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.812838+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:26.812838+0000","last_peered":"2024-09-17T01:59:26.812838+0000","last_clean":"2024-09-17T01:59:26.812838+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:26.812838+0000","last_undegraded":"2024-09-17T01:59:26.812838+0000","last_fullsized":"2024-09-17T01:59:26.812838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":593,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.818946+0000","last_change":"2024-09-17T01:59:09.355604+0000","last_active":"2024-09-17T01:59:26.818946+0000","last_peered":"2024-09-17T01:59:26.818946+0000","last_clean":"2024-09-17T01:56:19.136297+0000","last_became_active":"2024-09-17T01:59:09.347969+0000","last_became_peered":"2024-09-17T01:59:09.347969+0000","last_unstale":"2024-09-17T01:59:26.818946+0000","last_undegraded":"2024-09-17T01:59:09.248244+0000","last_fullsized":"2024-09-17T01:59:09.223371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":429,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818696+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:26.818696+0000","last_peered":"2024-09-17T01:59:26.818696+0000","last_clean":"2024-09-17T01:59:26.818696+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:26.818696+0000","last_undegraded":"2024-09-17T01:59:26.818696+0000","last_fullsized":"2024-09-17T01:59:26.818696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":569,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818835+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:26.818835+0000","last_peered":"2024-09-17T01:59:26.818835+0000","last_clean":"2024-09-17T01:59:26.818835+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:26.818835+0000","last_undegraded":"2024-09-17T01:59:26.818835+0000","last_fullsized":"2024-09-17T01:59:26.818835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":218,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.818057+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:26.818057+0000","last_peered":"2024-09-17T01:59:26.818057+0000","last_clean":"2024-09-17T01:59:26.818057+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:26.818057+0000","last_undegraded":"2024-09-17T01:59:26.818057+0000","last_fullsized":"2024-09-17T01:59:26.818057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":619,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376104+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:31.376104+0000","last_peered":"2024-09-17T01:59:31.376104+0000","last_clean":"2024-09-17T01:59:31.376104+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:31.376104+0000","last_undegraded":"2024-09-17T01:59:31.376104+0000","last_fullsized":"2024-09-17T01:59:31.376104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":284,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375758+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:31.375758+0000","last_peered":"2024-09-17T01:59:31.375758+0000","last_clean":"2024-09-17T01:59:31.375758+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:31.375758+0000","last_undegraded":"2024-09-17T01:59:31.375758+0000","last_fullsized":"2024-09-17T01:59:31.375758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375677+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:31.375677+0000","last_peered":"2024-09-17T01:59:31.375677+0000","last_clean":"2024-09-17T01:59:31.375677+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:31.375677+0000","last_undegraded":"2024-09-17T01:59:31.375677+0000","last_fullsized":"2024-09-17T01:59:31.375677+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":443,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.819844+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:26.819844+0000","last_peered":"2024-09-17T01:59:26.819844+0000","last_clean":"2024-09-17T01:59:26.819844+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:26.819844+0000","last_undegraded":"2024-09-17T01:59:26.819844+0000","last_fullsized":"2024-09-17T01:59:26.819844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":664,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.817576+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:26.817576+0000","last_peered":"2024-09-17T01:59:26.817576+0000","last_clean":"2024-09-17T01:59:26.817576+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:26.817576+0000","last_undegraded":"2024-09-17T01:59:26.817576+0000","last_fullsized":"2024-09-17T01:59:26.817576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":199,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815984+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:26.815984+0000","last_peered":"2024-09-17T01:59:26.815984+0000","last_clean":"2024-09-17T01:59:26.815984+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:26.815984+0000","last_undegraded":"2024-09-17T01:59:26.815984+0000","last_fullsized":"2024-09-17T01:59:26.815984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":704,"reported_epoch":91,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:26.811971+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:26.811971+0000","last_peered":"2024-09-17T01:59:26.811971+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:26.811971+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":227,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-17T01:59:26.815699+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:26.815699+0000","last_peered":"2024-09-17T01:59:26.815699+0000","last_clean":"2024-09-17T01:59:26.815699+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:26.815699+0000","last_undegraded":"2024-09-17T01:59:26.815699+0000","last_fullsized":"2024-09-17T01:59:26.815699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1965,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4925,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":6104691,"data_compressed":655244,"data_compressed_allocated":864256,"data_compressed_original":2859008,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":116,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":20648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":21143552,"data_stored":106747763,"data_compressed":8839702,"data_compressed_allocated":12771328,"data_compressed_original":102420480,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95168,"kb_used_data":23780,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276672,"statfs":{"total":96636764160,"available":96539312128,"internally_reserved":0,"allocated":24350720,"data_stored":84998397,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91796,"kb_used_data":20416,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94280044,"statfs":{"total":96636764160,"available":96542765056,"internally_reserved":0,"allocated":20905984,"data_stored":73160440,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":6104691,"data_compressed":655244,"data_compressed_allocated":864256,"data_compressed_original":2859008,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:32.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:59:32.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:32.681 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2831/114 objects degraded (2483.333%), 16 pgs degraded","count":16},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":310,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":96,"num_osds":3,"num_up_osds":3,"osd_up_since":1726538347,"num_in_osds":3,"osd_in_since":1726538063,"num_remapped_pgs":9},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":16},{"state_name":"peering","count":3},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128027436,"bytes_used":252731392,"bytes_avail":289657561088,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":2831,"degraded_total":114,"degraded_ratio":24.833333333333329,"recovering_objects_per_sec":276,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1107,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T01:55:53.990553+0000","services":{}},"progress_events":{}} 2024-09-17T01:59:32.699 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-17T01:59:32.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:33.020 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:33.022 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:33.040 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-17T01:59:32.813937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1417,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5521,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":201,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":249180,"kb_used_data":64976,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282866340,"statfs":{"total":289910292480,"available":289655132160,"internally_reserved":0,"allocated":66535424,"data_stored":264957285,"data_compressed":20499781,"data_compressed_allocated":33206272,"data_compressed_original":236683264,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1414,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1415,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.990265"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":659,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816405+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:31.816405+0000","last_peered":"2024-09-17T01:59:31.816405+0000","last_clean":"2024-09-17T01:59:31.816405+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:31.816405+0000","last_undegraded":"2024-09-17T01:59:31.816405+0000","last_fullsized":"2024-09-17T01:59:31.816405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":652,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815296+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:31.815296+0000","last_peered":"2024-09-17T01:59:31.815296+0000","last_clean":"2024-09-17T01:59:31.815296+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:31.815296+0000","last_undegraded":"2024-09-17T01:59:31.815296+0000","last_fullsized":"2024-09-17T01:59:31.815296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377351+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:31.377351+0000","last_peered":"2024-09-17T01:59:31.377351+0000","last_clean":"2024-09-17T01:59:31.377351+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:31.377351+0000","last_undegraded":"2024-09-17T01:59:31.377351+0000","last_fullsized":"2024-09-17T01:59:31.377351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376146+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:31.376146+0000","last_peered":"2024-09-17T01:59:31.376146+0000","last_clean":"2024-09-17T01:59:31.376146+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:31.376146+0000","last_undegraded":"2024-09-17T01:59:31.376146+0000","last_fullsized":"2024-09-17T01:59:31.376146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814816+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:31.814816+0000","last_peered":"2024-09-17T01:59:31.814816+0000","last_clean":"2024-09-17T01:59:31.814816+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:31.814816+0000","last_undegraded":"2024-09-17T01:59:31.814816+0000","last_fullsized":"2024-09-17T01:59:31.814816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376297+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:31.376297+0000","last_peered":"2024-09-17T01:59:31.376297+0000","last_clean":"2024-09-17T01:59:31.376297+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:31.376297+0000","last_undegraded":"2024-09-17T01:59:31.376297+0000","last_fullsized":"2024-09-17T01:59:31.376297+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":675,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375036+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:31.375036+0000","last_peered":"2024-09-17T01:59:31.375036+0000","last_clean":"2024-09-17T01:59:31.375036+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:31.375036+0000","last_undegraded":"2024-09-17T01:59:31.375036+0000","last_fullsized":"2024-09-17T01:59:31.375036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":567,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.819499+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:31.819499+0000","last_peered":"2024-09-17T01:59:31.819499+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:31.819499+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":616,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821753+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:31.821753+0000","last_peered":"2024-09-17T01:59:31.821753+0000","last_clean":"2024-09-17T01:59:31.821753+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:31.821753+0000","last_undegraded":"2024-09-17T01:59:31.821753+0000","last_fullsized":"2024-09-17T01:59:31.821753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":582,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815723+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:31.815723+0000","last_peered":"2024-09-17T01:59:31.815723+0000","last_clean":"2024-09-17T01:59:31.815723+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:31.815723+0000","last_undegraded":"2024-09-17T01:59:31.815723+0000","last_fullsized":"2024-09-17T01:59:31.815723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":523,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377074+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:31.377074+0000","last_peered":"2024-09-17T01:59:31.377074+0000","last_clean":"2024-09-17T01:59:31.377074+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:31.377074+0000","last_undegraded":"2024-09-17T01:59:31.377074+0000","last_fullsized":"2024-09-17T01:59:31.377074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815235+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:31.815235+0000","last_peered":"2024-09-17T01:59:31.815235+0000","last_clean":"2024-09-17T01:59:31.815235+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:31.815235+0000","last_undegraded":"2024-09-17T01:59:31.815235+0000","last_fullsized":"2024-09-17T01:59:31.815235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":558,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814507+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:31.814507+0000","last_peered":"2024-09-17T01:59:31.814507+0000","last_clean":"2024-09-17T01:59:31.814507+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:31.814507+0000","last_undegraded":"2024-09-17T01:59:31.814507+0000","last_fullsized":"2024-09-17T01:59:31.814507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":622,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.376391+0000","last_change":"2024-09-17T01:59:31.376391+0000","last_active":"2024-09-17T01:59:08.216700+0000","last_peered":"2024-09-17T01:59:06.196479+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:56:20.334288+0000","last_became_peered":"2024-09-17T01:56:20.334288+0000","last_unstale":"2024-09-17T01:59:31.376391+0000","last_undegraded":"2024-09-17T01:59:31.376391+0000","last_fullsized":"2024-09-17T01:59:31.376391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375006+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:31.375006+0000","last_peered":"2024-09-17T01:59:31.375006+0000","last_clean":"2024-09-17T01:59:31.375006+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:31.375006+0000","last_undegraded":"2024-09-17T01:59:31.375006+0000","last_fullsized":"2024-09-17T01:59:31.375006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":680,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818981+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:31.818981+0000","last_peered":"2024-09-17T01:59:31.818981+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:31.818981+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":580,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823236+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:31.823236+0000","last_peered":"2024-09-17T01:59:31.823236+0000","last_clean":"2024-09-17T01:59:31.823236+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:31.823236+0000","last_undegraded":"2024-09-17T01:59:31.823236+0000","last_fullsized":"2024-09-17T01:59:31.823236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":609,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816020+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:31.816020+0000","last_peered":"2024-09-17T01:59:31.816020+0000","last_clean":"2024-09-17T01:59:31.816020+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:31.816020+0000","last_undegraded":"2024-09-17T01:59:31.816020+0000","last_fullsized":"2024-09-17T01:59:31.816020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":664,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821678+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:31.821678+0000","last_peered":"2024-09-17T01:59:31.821678+0000","last_clean":"2024-09-17T01:59:31.821678+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:31.821678+0000","last_undegraded":"2024-09-17T01:59:31.821678+0000","last_fullsized":"2024-09-17T01:59:31.821678+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":677,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376984+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:31.376984+0000","last_peered":"2024-09-17T01:59:31.376984+0000","last_clean":"2024-09-17T01:59:31.376984+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:31.376984+0000","last_undegraded":"2024-09-17T01:59:31.376984+0000","last_fullsized":"2024-09-17T01:59:31.376984+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":537,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.378383+0000","last_change":"2024-09-17T01:59:31.378383+0000","last_active":"2024-09-17T01:59:08.228666+0000","last_peered":"2024-09-17T01:59:06.603880+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:56:20.342833+0000","last_became_peered":"2024-09-17T01:56:20.342833+0000","last_unstale":"2024-09-17T01:59:31.378383+0000","last_undegraded":"2024-09-17T01:59:31.378383+0000","last_fullsized":"2024-09-17T01:59:31.378383+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1163,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814487+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:31.814487+0000","last_peered":"2024-09-17T01:59:31.814487+0000","last_clean":"2024-09-17T01:59:31.814487+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:31.814487+0000","last_undegraded":"2024-09-17T01:59:31.814487+0000","last_fullsized":"2024-09-17T01:59:31.814487+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1063,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819202+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:31.819202+0000","last_peered":"2024-09-17T01:59:31.819202+0000","last_clean":"2024-09-17T01:59:31.819202+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:31.819202+0000","last_undegraded":"2024-09-17T01:59:31.819202+0000","last_fullsized":"2024-09-17T01:59:31.819202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.813863+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:31.813863+0000","last_peered":"2024-09-17T01:59:31.813863+0000","last_clean":"2024-09-17T01:59:31.813863+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:31.813863+0000","last_undegraded":"2024-09-17T01:59:31.813863+0000","last_fullsized":"2024-09-17T01:59:31.813863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1006,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816595+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:31.816595+0000","last_peered":"2024-09-17T01:59:31.816595+0000","last_clean":"2024-09-17T01:59:31.816595+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:31.816595+0000","last_undegraded":"2024-09-17T01:59:31.816595+0000","last_fullsized":"2024-09-17T01:59:31.816595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822014+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:31.822014+0000","last_peered":"2024-09-17T01:59:31.822014+0000","last_clean":"2024-09-17T01:59:31.822014+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:31.822014+0000","last_undegraded":"2024-09-17T01:59:31.822014+0000","last_fullsized":"2024-09-17T01:59:31.822014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":600,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.816995+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:31.816995+0000","last_peered":"2024-09-17T01:59:31.816995+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:31.816995+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":955,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815595+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:31.815595+0000","last_peered":"2024-09-17T01:59:31.815595+0000","last_clean":"2024-09-17T01:59:31.815595+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:31.815595+0000","last_undegraded":"2024-09-17T01:59:31.815595+0000","last_fullsized":"2024-09-17T01:59:31.815595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":604,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820432+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:31.820432+0000","last_peered":"2024-09-17T01:59:31.820432+0000","last_clean":"2024-09-17T01:59:31.820432+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:31.820432+0000","last_undegraded":"2024-09-17T01:59:31.820432+0000","last_fullsized":"2024-09-17T01:59:31.820432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1045,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815449+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:31.815449+0000","last_peered":"2024-09-17T01:59:31.815449+0000","last_clean":"2024-09-17T01:59:31.815449+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:31.815449+0000","last_undegraded":"2024-09-17T01:59:31.815449+0000","last_fullsized":"2024-09-17T01:59:31.815449+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":665,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819495+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:31.819495+0000","last_peered":"2024-09-17T01:59:31.819495+0000","last_clean":"2024-09-17T01:59:31.819495+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:31.819495+0000","last_undegraded":"2024-09-17T01:59:31.819495+0000","last_fullsized":"2024-09-17T01:59:31.819495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374437+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:31.374437+0000","last_peered":"2024-09-17T01:59:31.374437+0000","last_clean":"2024-09-17T01:59:31.374437+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:31.374437+0000","last_undegraded":"2024-09-17T01:59:31.374437+0000","last_fullsized":"2024-09-17T01:59:31.374437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":632,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815590+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:31.815590+0000","last_peered":"2024-09-17T01:59:31.815590+0000","last_clean":"2024-09-17T01:59:31.815590+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:31.815590+0000","last_undegraded":"2024-09-17T01:59:31.815590+0000","last_fullsized":"2024-09-17T01:59:31.815590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":566,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375754+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:31.375754+0000","last_peered":"2024-09-17T01:59:31.375754+0000","last_clean":"2024-09-17T01:59:31.375754+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:31.375754+0000","last_undegraded":"2024-09-17T01:59:31.375754+0000","last_fullsized":"2024-09-17T01:59:31.375754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":653,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816128+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:31.816128+0000","last_peered":"2024-09-17T01:59:31.816128+0000","last_clean":"2024-09-17T01:59:31.816128+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:31.816128+0000","last_undegraded":"2024-09-17T01:59:31.816128+0000","last_fullsized":"2024-09-17T01:59:31.816128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":229,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820185+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:31.820185+0000","last_peered":"2024-09-17T01:59:31.820185+0000","last_clean":"2024-09-17T01:59:31.820185+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:31.820185+0000","last_undegraded":"2024-09-17T01:59:31.820185+0000","last_fullsized":"2024-09-17T01:59:31.820185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1073,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822515+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:31.822515+0000","last_peered":"2024-09-17T01:59:31.822515+0000","last_clean":"2024-09-17T01:59:31.822515+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:31.822515+0000","last_undegraded":"2024-09-17T01:59:31.822515+0000","last_fullsized":"2024-09-17T01:59:31.822515+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":254,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814482+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:31.814482+0000","last_peered":"2024-09-17T01:59:31.814482+0000","last_clean":"2024-09-17T01:59:31.814482+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:31.814482+0000","last_undegraded":"2024-09-17T01:59:31.814482+0000","last_fullsized":"2024-09-17T01:59:31.814482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":637,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.821822+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:31.821822+0000","last_peered":"2024-09-17T01:59:31.821822+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:31.821822+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374343+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:31.374343+0000","last_peered":"2024-09-17T01:59:31.374343+0000","last_clean":"2024-09-17T01:59:31.374343+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:31.374343+0000","last_undegraded":"2024-09-17T01:59:31.374343+0000","last_fullsized":"2024-09-17T01:59:31.374343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376911+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:31.376911+0000","last_peered":"2024-09-17T01:59:31.376911+0000","last_clean":"2024-09-17T01:59:31.376911+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:31.376911+0000","last_undegraded":"2024-09-17T01:59:31.376911+0000","last_fullsized":"2024-09-17T01:59:31.376911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":979,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.813878+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:31.813878+0000","last_peered":"2024-09-17T01:59:31.813878+0000","last_clean":"2024-09-17T01:59:31.813878+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:31.813878+0000","last_undegraded":"2024-09-17T01:59:31.813878+0000","last_fullsized":"2024-09-17T01:59:31.813878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":446,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816166+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:31.816166+0000","last_peered":"2024-09-17T01:59:31.816166+0000","last_clean":"2024-09-17T01:59:31.816166+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:31.816166+0000","last_undegraded":"2024-09-17T01:59:31.816166+0000","last_fullsized":"2024-09-17T01:59:31.816166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":639,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814040+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:31.814040+0000","last_peered":"2024-09-17T01:59:31.814040+0000","last_clean":"2024-09-17T01:59:31.814040+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:31.814040+0000","last_undegraded":"2024-09-17T01:59:31.814040+0000","last_fullsized":"2024-09-17T01:59:31.814040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376497+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:31.376497+0000","last_peered":"2024-09-17T01:59:31.376497+0000","last_clean":"2024-09-17T01:59:31.376497+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:31.376497+0000","last_undegraded":"2024-09-17T01:59:31.376497+0000","last_fullsized":"2024-09-17T01:59:31.376497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":684,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.820593+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:31.820593+0000","last_peered":"2024-09-17T01:59:31.820593+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:31.820593+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376412+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:31.376412+0000","last_peered":"2024-09-17T01:59:31.376412+0000","last_clean":"2024-09-17T01:59:31.376412+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:31.376412+0000","last_undegraded":"2024-09-17T01:59:31.376412+0000","last_fullsized":"2024-09-17T01:59:31.376412+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":995,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820145+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:31.820145+0000","last_peered":"2024-09-17T01:59:31.820145+0000","last_clean":"2024-09-17T01:59:31.820145+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:31.820145+0000","last_undegraded":"2024-09-17T01:59:31.820145+0000","last_fullsized":"2024-09-17T01:59:31.820145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":338,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820788+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:31.820788+0000","last_peered":"2024-09-17T01:59:31.820788+0000","last_clean":"2024-09-17T01:59:31.820788+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:31.820788+0000","last_undegraded":"2024-09-17T01:59:31.820788+0000","last_fullsized":"2024-09-17T01:59:31.820788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":627,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377444+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:31.377444+0000","last_peered":"2024-09-17T01:59:31.377444+0000","last_clean":"2024-09-17T01:59:31.377444+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:31.377444+0000","last_undegraded":"2024-09-17T01:59:31.377444+0000","last_fullsized":"2024-09-17T01:59:31.377444+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375212+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:31.375212+0000","last_peered":"2024-09-17T01:59:31.375212+0000","last_clean":"2024-09-17T01:59:31.375212+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:31.375212+0000","last_undegraded":"2024-09-17T01:59:31.375212+0000","last_fullsized":"2024-09-17T01:59:31.375212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":1022,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:32.118730+0000","last_change":"2024-09-17T01:59:31.449175+0000","last_active":"2024-09-17T01:59:32.118730+0000","last_peered":"2024-09-17T01:59:32.118730+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:32.118730+0000","last_undegraded":"2024-09-17T01:59:32.118730+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":227,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814526+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:31.814526+0000","last_peered":"2024-09-17T01:59:31.814526+0000","last_clean":"2024-09-17T01:59:31.814526+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:31.814526+0000","last_undegraded":"2024-09-17T01:59:31.814526+0000","last_fullsized":"2024-09-17T01:59:31.814526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377192+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:31.377192+0000","last_peered":"2024-09-17T01:59:31.377192+0000","last_clean":"2024-09-17T01:59:31.377192+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:31.377192+0000","last_undegraded":"2024-09-17T01:59:31.377192+0000","last_fullsized":"2024-09-17T01:59:31.377192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":622,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814404+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:31.814404+0000","last_peered":"2024-09-17T01:59:31.814404+0000","last_clean":"2024-09-17T01:59:31.814404+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:31.814404+0000","last_undegraded":"2024-09-17T01:59:31.814404+0000","last_fullsized":"2024-09-17T01:59:31.814404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":599,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822682+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:31.822682+0000","last_peered":"2024-09-17T01:59:31.822682+0000","last_clean":"2024-09-17T01:59:31.822682+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:31.822682+0000","last_undegraded":"2024-09-17T01:59:31.822682+0000","last_fullsized":"2024-09-17T01:59:31.822682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":265,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374111+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:31.374111+0000","last_peered":"2024-09-17T01:59:31.374111+0000","last_clean":"2024-09-17T01:59:31.374111+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:31.374111+0000","last_undegraded":"2024-09-17T01:59:31.374111+0000","last_fullsized":"2024-09-17T01:59:31.374111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374901+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:31.374901+0000","last_peered":"2024-09-17T01:59:31.374901+0000","last_clean":"2024-09-17T01:59:31.374901+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:31.374901+0000","last_undegraded":"2024-09-17T01:59:31.374901+0000","last_fullsized":"2024-09-17T01:59:31.374901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":510,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376571+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:31.376571+0000","last_peered":"2024-09-17T01:59:31.376571+0000","last_clean":"2024-09-17T01:59:31.376571+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:31.376571+0000","last_undegraded":"2024-09-17T01:59:31.376571+0000","last_fullsized":"2024-09-17T01:59:31.376571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.388121+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:31.388121+0000","last_peered":"2024-09-17T01:59:31.388121+0000","last_clean":"2024-09-17T01:59:31.388121+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:31.388121+0000","last_undegraded":"2024-09-17T01:59:31.388121+0000","last_fullsized":"2024-09-17T01:59:31.388121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374943+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:31.374943+0000","last_peered":"2024-09-17T01:59:31.374943+0000","last_clean":"2024-09-17T01:59:31.374943+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:31.374943+0000","last_undegraded":"2024-09-17T01:59:31.374943+0000","last_fullsized":"2024-09-17T01:59:31.374943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":362,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822297+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:31.822297+0000","last_peered":"2024-09-17T01:59:31.822297+0000","last_clean":"2024-09-17T01:59:31.822297+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:31.822297+0000","last_undegraded":"2024-09-17T01:59:31.822297+0000","last_fullsized":"2024-09-17T01:59:31.822297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":700,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815649+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:31.815649+0000","last_peered":"2024-09-17T01:59:31.815649+0000","last_clean":"2024-09-17T01:59:31.815649+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:31.815649+0000","last_undegraded":"2024-09-17T01:59:31.815649+0000","last_fullsized":"2024-09-17T01:59:31.815649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822831+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:31.822831+0000","last_peered":"2024-09-17T01:59:31.822831+0000","last_clean":"2024-09-17T01:59:31.822831+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:31.822831+0000","last_undegraded":"2024-09-17T01:59:31.822831+0000","last_fullsized":"2024-09-17T01:59:31.822831+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":602,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814197+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:31.814197+0000","last_peered":"2024-09-17T01:59:31.814197+0000","last_clean":"2024-09-17T01:59:31.814197+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:31.814197+0000","last_undegraded":"2024-09-17T01:59:31.814197+0000","last_fullsized":"2024-09-17T01:59:31.814197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":562,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822789+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:31.822789+0000","last_peered":"2024-09-17T01:59:31.822789+0000","last_clean":"2024-09-17T01:59:31.822789+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:31.822789+0000","last_undegraded":"2024-09-17T01:59:31.822789+0000","last_fullsized":"2024-09-17T01:59:31.822789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374605+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:31.374605+0000","last_peered":"2024-09-17T01:59:31.374605+0000","last_clean":"2024-09-17T01:59:31.374605+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:31.374605+0000","last_undegraded":"2024-09-17T01:59:31.374605+0000","last_fullsized":"2024-09-17T01:59:31.374605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375434+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:31.375434+0000","last_peered":"2024-09-17T01:59:31.375434+0000","last_clean":"2024-09-17T01:59:31.375434+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:31.375434+0000","last_undegraded":"2024-09-17T01:59:31.375434+0000","last_fullsized":"2024-09-17T01:59:31.375434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":607,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821040+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:31.821040+0000","last_peered":"2024-09-17T01:59:31.821040+0000","last_clean":"2024-09-17T01:59:31.821040+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:31.821040+0000","last_undegraded":"2024-09-17T01:59:31.821040+0000","last_fullsized":"2024-09-17T01:59:31.821040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":379,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375814+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:31.375814+0000","last_peered":"2024-09-17T01:59:31.375814+0000","last_clean":"2024-09-17T01:59:31.375814+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:31.375814+0000","last_undegraded":"2024-09-17T01:59:31.375814+0000","last_fullsized":"2024-09-17T01:59:31.375814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821560+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:31.821560+0000","last_peered":"2024-09-17T01:59:31.821560+0000","last_clean":"2024-09-17T01:59:31.821560+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:31.821560+0000","last_undegraded":"2024-09-17T01:59:31.821560+0000","last_fullsized":"2024-09-17T01:59:31.821560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":577,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.814806+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:31.814806+0000","last_peered":"2024-09-17T01:59:31.814806+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:31.814806+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":227,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821355+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:31.821355+0000","last_peered":"2024-09-17T01:59:31.821355+0000","last_clean":"2024-09-17T01:59:31.821355+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:31.821355+0000","last_undegraded":"2024-09-17T01:59:31.821355+0000","last_fullsized":"2024-09-17T01:59:31.821355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.817019+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:31.817019+0000","last_peered":"2024-09-17T01:59:31.817019+0000","last_clean":"2024-09-17T01:59:31.817019+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:31.817019+0000","last_undegraded":"2024-09-17T01:59:31.817019+0000","last_fullsized":"2024-09-17T01:59:31.817019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":997,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814653+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:31.814653+0000","last_peered":"2024-09-17T01:59:31.814653+0000","last_clean":"2024-09-17T01:59:31.814653+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:31.814653+0000","last_undegraded":"2024-09-17T01:59:31.814653+0000","last_fullsized":"2024-09-17T01:59:31.814653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":220,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823330+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:31.823330+0000","last_peered":"2024-09-17T01:59:31.823330+0000","last_clean":"2024-09-17T01:59:31.823330+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:31.823330+0000","last_undegraded":"2024-09-17T01:59:31.823330+0000","last_fullsized":"2024-09-17T01:59:31.823330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822824+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:31.822824+0000","last_peered":"2024-09-17T01:59:31.822824+0000","last_clean":"2024-09-17T01:59:31.822824+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:31.822824+0000","last_undegraded":"2024-09-17T01:59:31.822824+0000","last_fullsized":"2024-09-17T01:59:31.822824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":604,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.820212+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:31.820212+0000","last_peered":"2024-09-17T01:59:31.820212+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:31.820212+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":294,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822621+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:31.822621+0000","last_peered":"2024-09-17T01:59:31.822621+0000","last_clean":"2024-09-17T01:59:31.822621+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:31.822621+0000","last_undegraded":"2024-09-17T01:59:31.822621+0000","last_fullsized":"2024-09-17T01:59:31.822621+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376188+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:31.376188+0000","last_peered":"2024-09-17T01:59:31.376188+0000","last_clean":"2024-09-17T01:59:31.376188+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:31.376188+0000","last_undegraded":"2024-09-17T01:59:31.376188+0000","last_fullsized":"2024-09-17T01:59:31.376188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1031,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814096+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:31.814096+0000","last_peered":"2024-09-17T01:59:31.814096+0000","last_clean":"2024-09-17T01:59:31.814096+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:31.814096+0000","last_undegraded":"2024-09-17T01:59:31.814096+0000","last_fullsized":"2024-09-17T01:59:31.814096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":598,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376759+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:31.376759+0000","last_peered":"2024-09-17T01:59:31.376759+0000","last_clean":"2024-09-17T01:59:31.376759+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:31.376759+0000","last_undegraded":"2024-09-17T01:59:31.376759+0000","last_fullsized":"2024-09-17T01:59:31.376759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":421,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375465+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:31.375465+0000","last_peered":"2024-09-17T01:59:31.375465+0000","last_clean":"2024-09-17T01:59:31.375465+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:31.375465+0000","last_undegraded":"2024-09-17T01:59:31.375465+0000","last_fullsized":"2024-09-17T01:59:31.375465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819524+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:31.819524+0000","last_peered":"2024-09-17T01:59:31.819524+0000","last_clean":"2024-09-17T01:59:31.819524+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:31.819524+0000","last_undegraded":"2024-09-17T01:59:31.819524+0000","last_fullsized":"2024-09-17T01:59:31.819524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816655+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:31.816655+0000","last_peered":"2024-09-17T01:59:31.816655+0000","last_clean":"2024-09-17T01:59:31.816655+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:31.816655+0000","last_undegraded":"2024-09-17T01:59:31.816655+0000","last_fullsized":"2024-09-17T01:59:31.816655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":315,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376928+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:31.376928+0000","last_peered":"2024-09-17T01:59:31.376928+0000","last_clean":"2024-09-17T01:59:31.376928+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:31.376928+0000","last_undegraded":"2024-09-17T01:59:31.376928+0000","last_fullsized":"2024-09-17T01:59:31.376928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1159,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.444353+0000","last_change":"2024-09-17T01:59:31.819986+0000","last_active":"2024-09-17T01:59:31.819986+0000","last_peered":"2024-09-17T01:59:31.444353+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:31.444353+0000","last_undegraded":"2024-09-17T01:59:31.444353+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":226,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823177+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:31.823177+0000","last_peered":"2024-09-17T01:59:31.823177+0000","last_clean":"2024-09-17T01:59:31.823177+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:31.823177+0000","last_undegraded":"2024-09-17T01:59:31.823177+0000","last_fullsized":"2024-09-17T01:59:31.823177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":683,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819990+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:31.819990+0000","last_peered":"2024-09-17T01:59:31.819990+0000","last_clean":"2024-09-17T01:59:31.819990+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:31.819990+0000","last_undegraded":"2024-09-17T01:59:31.819990+0000","last_fullsized":"2024-09-17T01:59:31.819990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":869,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816601+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:31.816601+0000","last_peered":"2024-09-17T01:59:31.816601+0000","last_clean":"2024-09-17T01:59:31.816601+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:31.816601+0000","last_undegraded":"2024-09-17T01:59:31.816601+0000","last_fullsized":"2024-09-17T01:59:31.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":793,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820313+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:31.820313+0000","last_peered":"2024-09-17T01:59:31.820313+0000","last_clean":"2024-09-17T01:59:31.820313+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:31.820313+0000","last_undegraded":"2024-09-17T01:59:31.820313+0000","last_fullsized":"2024-09-17T01:59:31.820313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":952,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821820+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:31.821820+0000","last_peered":"2024-09-17T01:59:31.821820+0000","last_clean":"2024-09-17T01:59:31.821820+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:31.821820+0000","last_undegraded":"2024-09-17T01:59:31.821820+0000","last_fullsized":"2024-09-17T01:59:31.821820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":381,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821997+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:31.821997+0000","last_peered":"2024-09-17T01:59:31.821997+0000","last_clean":"2024-09-17T01:59:31.821997+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:31.821997+0000","last_undegraded":"2024-09-17T01:59:31.821997+0000","last_fullsized":"2024-09-17T01:59:31.821997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":924,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815818+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:31.815818+0000","last_peered":"2024-09-17T01:59:31.815818+0000","last_clean":"2024-09-17T01:59:31.815818+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:31.815818+0000","last_undegraded":"2024-09-17T01:59:31.815818+0000","last_fullsized":"2024-09-17T01:59:31.815818+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":439,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816790+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:31.816790+0000","last_peered":"2024-09-17T01:59:31.816790+0000","last_clean":"2024-09-17T01:59:31.816790+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:31.816790+0000","last_undegraded":"2024-09-17T01:59:31.816790+0000","last_fullsized":"2024-09-17T01:59:31.816790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":579,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815304+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:31.815304+0000","last_peered":"2024-09-17T01:59:31.815304+0000","last_clean":"2024-09-17T01:59:31.815304+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:31.815304+0000","last_undegraded":"2024-09-17T01:59:31.815304+0000","last_fullsized":"2024-09-17T01:59:31.815304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":228,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814978+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:31.814978+0000","last_peered":"2024-09-17T01:59:31.814978+0000","last_clean":"2024-09-17T01:59:31.814978+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:31.814978+0000","last_undegraded":"2024-09-17T01:59:31.814978+0000","last_fullsized":"2024-09-17T01:59:31.814978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":619,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376104+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:31.376104+0000","last_peered":"2024-09-17T01:59:31.376104+0000","last_clean":"2024-09-17T01:59:31.376104+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:31.376104+0000","last_undegraded":"2024-09-17T01:59:31.376104+0000","last_fullsized":"2024-09-17T01:59:31.376104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":284,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375758+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:31.375758+0000","last_peered":"2024-09-17T01:59:31.375758+0000","last_clean":"2024-09-17T01:59:31.375758+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:31.375758+0000","last_undegraded":"2024-09-17T01:59:31.375758+0000","last_fullsized":"2024-09-17T01:59:31.375758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375677+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:31.375677+0000","last_peered":"2024-09-17T01:59:31.375677+0000","last_clean":"2024-09-17T01:59:31.375677+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:31.375677+0000","last_undegraded":"2024-09-17T01:59:31.375677+0000","last_fullsized":"2024-09-17T01:59:31.375677+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":453,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816355+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:31.816355+0000","last_peered":"2024-09-17T01:59:31.816355+0000","last_clean":"2024-09-17T01:59:31.816355+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:31.816355+0000","last_undegraded":"2024-09-17T01:59:31.816355+0000","last_fullsized":"2024-09-17T01:59:31.816355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":674,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814801+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:31.814801+0000","last_peered":"2024-09-17T01:59:31.814801+0000","last_clean":"2024-09-17T01:59:31.814801+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:31.814801+0000","last_undegraded":"2024-09-17T01:59:31.814801+0000","last_fullsized":"2024-09-17T01:59:31.814801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":209,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822325+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:31.822325+0000","last_peered":"2024-09-17T01:59:31.822325+0000","last_clean":"2024-09-17T01:59:31.822325+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:31.822325+0000","last_undegraded":"2024-09-17T01:59:31.822325+0000","last_fullsized":"2024-09-17T01:59:31.822325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":714,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818790+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:31.818790+0000","last_peered":"2024-09-17T01:59:31.818790+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:31.818790+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":237,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823009+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:31.823009+0000","last_peered":"2024-09-17T01:59:31.823009+0000","last_clean":"2024-09-17T01:59:31.823009+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:31.823009+0000","last_undegraded":"2024-09-17T01:59:31.823009+0000","last_fullsized":"2024-09-17T01:59:31.823009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1417,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5499,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":6104691,"data_compressed":655244,"data_compressed_allocated":864256,"data_compressed_original":2859008,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":119,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":20648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":21143552,"data_stored":106747763,"data_compressed":8839702,"data_compressed_allocated":12771328,"data_compressed_original":102420480,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95240,"kb_used_data":23852,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276600,"statfs":{"total":96636764160,"available":96539238400,"internally_reserved":0,"allocated":24424448,"data_stored":85026099,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91864,"kb_used_data":20476,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279976,"statfs":{"total":96636764160,"available":96542695424,"internally_reserved":0,"allocated":20967424,"data_stored":73183423,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":6104691,"data_compressed":655244,"data_compressed_allocated":864256,"data_compressed_original":2859008,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:36.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:36.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:36.394 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-09-17T01:59:36.097266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1417,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5521,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":201,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":249180,"kb_used_data":64976,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282866340,"statfs":{"total":289910292480,"available":289655132160,"internally_reserved":0,"allocated":66535424,"data_stored":264957285,"data_compressed":20499781,"data_compressed_allocated":33206272,"data_compressed_original":236683264,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-548,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":574,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001068"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":659,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816405+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:31.816405+0000","last_peered":"2024-09-17T01:59:31.816405+0000","last_clean":"2024-09-17T01:59:31.816405+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:31.816405+0000","last_undegraded":"2024-09-17T01:59:31.816405+0000","last_fullsized":"2024-09-17T01:59:31.816405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":652,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815296+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:31.815296+0000","last_peered":"2024-09-17T01:59:31.815296+0000","last_clean":"2024-09-17T01:59:31.815296+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:31.815296+0000","last_undegraded":"2024-09-17T01:59:31.815296+0000","last_fullsized":"2024-09-17T01:59:31.815296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":506,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377351+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:31.377351+0000","last_peered":"2024-09-17T01:59:31.377351+0000","last_clean":"2024-09-17T01:59:31.377351+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:31.377351+0000","last_undegraded":"2024-09-17T01:59:31.377351+0000","last_fullsized":"2024-09-17T01:59:31.377351+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376146+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:31.376146+0000","last_peered":"2024-09-17T01:59:31.376146+0000","last_clean":"2024-09-17T01:59:31.376146+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:31.376146+0000","last_undegraded":"2024-09-17T01:59:31.376146+0000","last_fullsized":"2024-09-17T01:59:31.376146+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814816+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:31.814816+0000","last_peered":"2024-09-17T01:59:31.814816+0000","last_clean":"2024-09-17T01:59:31.814816+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:31.814816+0000","last_undegraded":"2024-09-17T01:59:31.814816+0000","last_fullsized":"2024-09-17T01:59:31.814816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":563,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376297+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:31.376297+0000","last_peered":"2024-09-17T01:59:31.376297+0000","last_clean":"2024-09-17T01:59:31.376297+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:31.376297+0000","last_undegraded":"2024-09-17T01:59:31.376297+0000","last_fullsized":"2024-09-17T01:59:31.376297+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":675,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375036+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:31.375036+0000","last_peered":"2024-09-17T01:59:31.375036+0000","last_clean":"2024-09-17T01:59:31.375036+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:31.375036+0000","last_undegraded":"2024-09-17T01:59:31.375036+0000","last_fullsized":"2024-09-17T01:59:31.375036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":567,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.819499+0000","last_change":"2024-09-17T01:59:09.362274+0000","last_active":"2024-09-17T01:59:31.819499+0000","last_peered":"2024-09-17T01:59:31.819499+0000","last_clean":"2024-09-17T01:56:18.673020+0000","last_became_active":"2024-09-17T01:59:09.350863+0000","last_became_peered":"2024-09-17T01:59:09.350863+0000","last_unstale":"2024-09-17T01:59:31.819499+0000","last_undegraded":"2024-09-17T01:59:09.240250+0000","last_fullsized":"2024-09-17T01:59:09.229046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":616,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821753+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:31.821753+0000","last_peered":"2024-09-17T01:59:31.821753+0000","last_clean":"2024-09-17T01:59:31.821753+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:31.821753+0000","last_undegraded":"2024-09-17T01:59:31.821753+0000","last_fullsized":"2024-09-17T01:59:31.821753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":582,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815723+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:31.815723+0000","last_peered":"2024-09-17T01:59:31.815723+0000","last_clean":"2024-09-17T01:59:31.815723+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:31.815723+0000","last_undegraded":"2024-09-17T01:59:31.815723+0000","last_fullsized":"2024-09-17T01:59:31.815723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":523,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377074+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:31.377074+0000","last_peered":"2024-09-17T01:59:31.377074+0000","last_clean":"2024-09-17T01:59:31.377074+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:31.377074+0000","last_undegraded":"2024-09-17T01:59:31.377074+0000","last_fullsized":"2024-09-17T01:59:31.377074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815235+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:31.815235+0000","last_peered":"2024-09-17T01:59:31.815235+0000","last_clean":"2024-09-17T01:59:31.815235+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:31.815235+0000","last_undegraded":"2024-09-17T01:59:31.815235+0000","last_fullsized":"2024-09-17T01:59:31.815235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":558,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814507+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:31.814507+0000","last_peered":"2024-09-17T01:59:31.814507+0000","last_clean":"2024-09-17T01:59:31.814507+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:31.814507+0000","last_undegraded":"2024-09-17T01:59:31.814507+0000","last_fullsized":"2024-09-17T01:59:31.814507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":622,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.376391+0000","last_change":"2024-09-17T01:59:31.376391+0000","last_active":"2024-09-17T01:59:08.216700+0000","last_peered":"2024-09-17T01:59:06.196479+0000","last_clean":"2024-09-17T01:56:18.921405+0000","last_became_active":"2024-09-17T01:56:20.334288+0000","last_became_peered":"2024-09-17T01:56:20.334288+0000","last_unstale":"2024-09-17T01:59:31.376391+0000","last_undegraded":"2024-09-17T01:59:31.376391+0000","last_fullsized":"2024-09-17T01:59:31.376391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":577,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375006+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:31.375006+0000","last_peered":"2024-09-17T01:59:31.375006+0000","last_clean":"2024-09-17T01:59:31.375006+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:31.375006+0000","last_undegraded":"2024-09-17T01:59:31.375006+0000","last_fullsized":"2024-09-17T01:59:31.375006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":680,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818981+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:31.818981+0000","last_peered":"2024-09-17T01:59:31.818981+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:31.818981+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":580,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823236+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:31.823236+0000","last_peered":"2024-09-17T01:59:31.823236+0000","last_clean":"2024-09-17T01:59:31.823236+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:31.823236+0000","last_undegraded":"2024-09-17T01:59:31.823236+0000","last_fullsized":"2024-09-17T01:59:31.823236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":609,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816020+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:31.816020+0000","last_peered":"2024-09-17T01:59:31.816020+0000","last_clean":"2024-09-17T01:59:31.816020+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:31.816020+0000","last_undegraded":"2024-09-17T01:59:31.816020+0000","last_fullsized":"2024-09-17T01:59:31.816020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":664,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821678+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:31.821678+0000","last_peered":"2024-09-17T01:59:31.821678+0000","last_clean":"2024-09-17T01:59:31.821678+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:31.821678+0000","last_undegraded":"2024-09-17T01:59:31.821678+0000","last_fullsized":"2024-09-17T01:59:31.821678+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":677,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376984+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:31.376984+0000","last_peered":"2024-09-17T01:59:31.376984+0000","last_clean":"2024-09-17T01:59:31.376984+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:31.376984+0000","last_undegraded":"2024-09-17T01:59:31.376984+0000","last_fullsized":"2024-09-17T01:59:31.376984+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":537,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.378383+0000","last_change":"2024-09-17T01:59:31.378383+0000","last_active":"2024-09-17T01:59:08.228666+0000","last_peered":"2024-09-17T01:59:06.603880+0000","last_clean":"2024-09-17T01:56:19.190356+0000","last_became_active":"2024-09-17T01:56:20.342833+0000","last_became_peered":"2024-09-17T01:56:20.342833+0000","last_unstale":"2024-09-17T01:59:31.378383+0000","last_undegraded":"2024-09-17T01:59:31.378383+0000","last_fullsized":"2024-09-17T01:59:31.378383+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1163,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814487+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:31.814487+0000","last_peered":"2024-09-17T01:59:31.814487+0000","last_clean":"2024-09-17T01:59:31.814487+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:31.814487+0000","last_undegraded":"2024-09-17T01:59:31.814487+0000","last_fullsized":"2024-09-17T01:59:31.814487+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1063,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819202+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:31.819202+0000","last_peered":"2024-09-17T01:59:31.819202+0000","last_clean":"2024-09-17T01:59:31.819202+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:31.819202+0000","last_undegraded":"2024-09-17T01:59:31.819202+0000","last_fullsized":"2024-09-17T01:59:31.819202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.813863+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:31.813863+0000","last_peered":"2024-09-17T01:59:31.813863+0000","last_clean":"2024-09-17T01:59:31.813863+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:31.813863+0000","last_undegraded":"2024-09-17T01:59:31.813863+0000","last_fullsized":"2024-09-17T01:59:31.813863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1006,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816595+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:31.816595+0000","last_peered":"2024-09-17T01:59:31.816595+0000","last_clean":"2024-09-17T01:59:31.816595+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:31.816595+0000","last_undegraded":"2024-09-17T01:59:31.816595+0000","last_fullsized":"2024-09-17T01:59:31.816595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822014+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:31.822014+0000","last_peered":"2024-09-17T01:59:31.822014+0000","last_clean":"2024-09-17T01:59:31.822014+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:31.822014+0000","last_undegraded":"2024-09-17T01:59:31.822014+0000","last_fullsized":"2024-09-17T01:59:31.822014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":600,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.816995+0000","last_change":"2024-09-17T01:59:09.361228+0000","last_active":"2024-09-17T01:59:31.816995+0000","last_peered":"2024-09-17T01:59:31.816995+0000","last_clean":"2024-09-17T01:56:18.717264+0000","last_became_active":"2024-09-17T01:59:09.356683+0000","last_became_peered":"2024-09-17T01:59:09.356683+0000","last_unstale":"2024-09-17T01:59:31.816995+0000","last_undegraded":"2024-09-17T01:59:09.258038+0000","last_fullsized":"2024-09-17T01:59:09.254918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":178,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":955,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815595+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:31.815595+0000","last_peered":"2024-09-17T01:59:31.815595+0000","last_clean":"2024-09-17T01:59:31.815595+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:31.815595+0000","last_undegraded":"2024-09-17T01:59:31.815595+0000","last_fullsized":"2024-09-17T01:59:31.815595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":604,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820432+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:31.820432+0000","last_peered":"2024-09-17T01:59:31.820432+0000","last_clean":"2024-09-17T01:59:31.820432+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:31.820432+0000","last_undegraded":"2024-09-17T01:59:31.820432+0000","last_fullsized":"2024-09-17T01:59:31.820432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1045,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815449+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:31.815449+0000","last_peered":"2024-09-17T01:59:31.815449+0000","last_clean":"2024-09-17T01:59:31.815449+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:31.815449+0000","last_undegraded":"2024-09-17T01:59:31.815449+0000","last_fullsized":"2024-09-17T01:59:31.815449+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":665,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819495+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:31.819495+0000","last_peered":"2024-09-17T01:59:31.819495+0000","last_clean":"2024-09-17T01:59:31.819495+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:31.819495+0000","last_undegraded":"2024-09-17T01:59:31.819495+0000","last_fullsized":"2024-09-17T01:59:31.819495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374437+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:31.374437+0000","last_peered":"2024-09-17T01:59:31.374437+0000","last_clean":"2024-09-17T01:59:31.374437+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:31.374437+0000","last_undegraded":"2024-09-17T01:59:31.374437+0000","last_fullsized":"2024-09-17T01:59:31.374437+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":632,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815590+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:31.815590+0000","last_peered":"2024-09-17T01:59:31.815590+0000","last_clean":"2024-09-17T01:59:31.815590+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:31.815590+0000","last_undegraded":"2024-09-17T01:59:31.815590+0000","last_fullsized":"2024-09-17T01:59:31.815590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":566,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375754+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:31.375754+0000","last_peered":"2024-09-17T01:59:31.375754+0000","last_clean":"2024-09-17T01:59:31.375754+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:31.375754+0000","last_undegraded":"2024-09-17T01:59:31.375754+0000","last_fullsized":"2024-09-17T01:59:31.375754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":653,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816128+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:31.816128+0000","last_peered":"2024-09-17T01:59:31.816128+0000","last_clean":"2024-09-17T01:59:31.816128+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:31.816128+0000","last_undegraded":"2024-09-17T01:59:31.816128+0000","last_fullsized":"2024-09-17T01:59:31.816128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":229,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820185+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:31.820185+0000","last_peered":"2024-09-17T01:59:31.820185+0000","last_clean":"2024-09-17T01:59:31.820185+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:31.820185+0000","last_undegraded":"2024-09-17T01:59:31.820185+0000","last_fullsized":"2024-09-17T01:59:31.820185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1073,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822515+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:31.822515+0000","last_peered":"2024-09-17T01:59:31.822515+0000","last_clean":"2024-09-17T01:59:31.822515+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:31.822515+0000","last_undegraded":"2024-09-17T01:59:31.822515+0000","last_fullsized":"2024-09-17T01:59:31.822515+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":254,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814482+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:31.814482+0000","last_peered":"2024-09-17T01:59:31.814482+0000","last_clean":"2024-09-17T01:59:31.814482+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:31.814482+0000","last_undegraded":"2024-09-17T01:59:31.814482+0000","last_fullsized":"2024-09-17T01:59:31.814482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":637,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.821822+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:31.821822+0000","last_peered":"2024-09-17T01:59:31.821822+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:31.821822+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374343+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:31.374343+0000","last_peered":"2024-09-17T01:59:31.374343+0000","last_clean":"2024-09-17T01:59:31.374343+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:31.374343+0000","last_undegraded":"2024-09-17T01:59:31.374343+0000","last_fullsized":"2024-09-17T01:59:31.374343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376911+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:31.376911+0000","last_peered":"2024-09-17T01:59:31.376911+0000","last_clean":"2024-09-17T01:59:31.376911+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:31.376911+0000","last_undegraded":"2024-09-17T01:59:31.376911+0000","last_fullsized":"2024-09-17T01:59:31.376911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":979,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.813878+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:31.813878+0000","last_peered":"2024-09-17T01:59:31.813878+0000","last_clean":"2024-09-17T01:59:31.813878+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:31.813878+0000","last_undegraded":"2024-09-17T01:59:31.813878+0000","last_fullsized":"2024-09-17T01:59:31.813878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":446,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816166+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:31.816166+0000","last_peered":"2024-09-17T01:59:31.816166+0000","last_clean":"2024-09-17T01:59:31.816166+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:31.816166+0000","last_undegraded":"2024-09-17T01:59:31.816166+0000","last_fullsized":"2024-09-17T01:59:31.816166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":639,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814040+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:31.814040+0000","last_peered":"2024-09-17T01:59:31.814040+0000","last_clean":"2024-09-17T01:59:31.814040+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:31.814040+0000","last_undegraded":"2024-09-17T01:59:31.814040+0000","last_fullsized":"2024-09-17T01:59:31.814040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":673,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376497+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:31.376497+0000","last_peered":"2024-09-17T01:59:31.376497+0000","last_clean":"2024-09-17T01:59:31.376497+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:31.376497+0000","last_undegraded":"2024-09-17T01:59:31.376497+0000","last_fullsized":"2024-09-17T01:59:31.376497+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":684,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.820593+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:31.820593+0000","last_peered":"2024-09-17T01:59:31.820593+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:31.820593+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376412+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:31.376412+0000","last_peered":"2024-09-17T01:59:31.376412+0000","last_clean":"2024-09-17T01:59:31.376412+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:31.376412+0000","last_undegraded":"2024-09-17T01:59:31.376412+0000","last_fullsized":"2024-09-17T01:59:31.376412+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":995,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820145+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:31.820145+0000","last_peered":"2024-09-17T01:59:31.820145+0000","last_clean":"2024-09-17T01:59:31.820145+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:31.820145+0000","last_undegraded":"2024-09-17T01:59:31.820145+0000","last_fullsized":"2024-09-17T01:59:31.820145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":338,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820788+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:31.820788+0000","last_peered":"2024-09-17T01:59:31.820788+0000","last_clean":"2024-09-17T01:59:31.820788+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:31.820788+0000","last_undegraded":"2024-09-17T01:59:31.820788+0000","last_fullsized":"2024-09-17T01:59:31.820788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":627,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377444+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:31.377444+0000","last_peered":"2024-09-17T01:59:31.377444+0000","last_clean":"2024-09-17T01:59:31.377444+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:31.377444+0000","last_undegraded":"2024-09-17T01:59:31.377444+0000","last_fullsized":"2024-09-17T01:59:31.377444+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375212+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:31.375212+0000","last_peered":"2024-09-17T01:59:31.375212+0000","last_clean":"2024-09-17T01:59:31.375212+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:31.375212+0000","last_undegraded":"2024-09-17T01:59:31.375212+0000","last_fullsized":"2024-09-17T01:59:31.375212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":1022,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:32.118730+0000","last_change":"2024-09-17T01:59:31.449175+0000","last_active":"2024-09-17T01:59:32.118730+0000","last_peered":"2024-09-17T01:59:32.118730+0000","last_clean":"2024-09-17T01:56:19.204491+0000","last_became_active":"2024-09-17T01:59:09.352976+0000","last_became_peered":"2024-09-17T01:59:09.352976+0000","last_unstale":"2024-09-17T01:59:32.118730+0000","last_undegraded":"2024-09-17T01:59:32.118730+0000","last_fullsized":"2024-09-17T01:59:09.253624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":227,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814526+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:31.814526+0000","last_peered":"2024-09-17T01:59:31.814526+0000","last_clean":"2024-09-17T01:59:31.814526+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:31.814526+0000","last_undegraded":"2024-09-17T01:59:31.814526+0000","last_fullsized":"2024-09-17T01:59:31.814526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":562,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.377192+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:31.377192+0000","last_peered":"2024-09-17T01:59:31.377192+0000","last_clean":"2024-09-17T01:59:31.377192+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:31.377192+0000","last_undegraded":"2024-09-17T01:59:31.377192+0000","last_fullsized":"2024-09-17T01:59:31.377192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":622,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814404+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:31.814404+0000","last_peered":"2024-09-17T01:59:31.814404+0000","last_clean":"2024-09-17T01:59:31.814404+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:31.814404+0000","last_undegraded":"2024-09-17T01:59:31.814404+0000","last_fullsized":"2024-09-17T01:59:31.814404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":599,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822682+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:31.822682+0000","last_peered":"2024-09-17T01:59:31.822682+0000","last_clean":"2024-09-17T01:59:31.822682+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:31.822682+0000","last_undegraded":"2024-09-17T01:59:31.822682+0000","last_fullsized":"2024-09-17T01:59:31.822682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":265,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374111+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:31.374111+0000","last_peered":"2024-09-17T01:59:31.374111+0000","last_clean":"2024-09-17T01:59:31.374111+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:31.374111+0000","last_undegraded":"2024-09-17T01:59:31.374111+0000","last_fullsized":"2024-09-17T01:59:31.374111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":89,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374901+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:31.374901+0000","last_peered":"2024-09-17T01:59:31.374901+0000","last_clean":"2024-09-17T01:59:31.374901+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:31.374901+0000","last_undegraded":"2024-09-17T01:59:31.374901+0000","last_fullsized":"2024-09-17T01:59:31.374901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":510,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376571+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:31.376571+0000","last_peered":"2024-09-17T01:59:31.376571+0000","last_clean":"2024-09-17T01:59:31.376571+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:31.376571+0000","last_undegraded":"2024-09-17T01:59:31.376571+0000","last_fullsized":"2024-09-17T01:59:31.376571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":585,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.388121+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:31.388121+0000","last_peered":"2024-09-17T01:59:31.388121+0000","last_clean":"2024-09-17T01:59:31.388121+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:31.388121+0000","last_undegraded":"2024-09-17T01:59:31.388121+0000","last_fullsized":"2024-09-17T01:59:31.388121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374943+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:31.374943+0000","last_peered":"2024-09-17T01:59:31.374943+0000","last_clean":"2024-09-17T01:59:31.374943+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:31.374943+0000","last_undegraded":"2024-09-17T01:59:31.374943+0000","last_fullsized":"2024-09-17T01:59:31.374943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":362,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822297+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:31.822297+0000","last_peered":"2024-09-17T01:59:31.822297+0000","last_clean":"2024-09-17T01:59:31.822297+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:31.822297+0000","last_undegraded":"2024-09-17T01:59:31.822297+0000","last_fullsized":"2024-09-17T01:59:31.822297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":700,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815649+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:31.815649+0000","last_peered":"2024-09-17T01:59:31.815649+0000","last_clean":"2024-09-17T01:59:31.815649+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:31.815649+0000","last_undegraded":"2024-09-17T01:59:31.815649+0000","last_fullsized":"2024-09-17T01:59:31.815649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822831+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:31.822831+0000","last_peered":"2024-09-17T01:59:31.822831+0000","last_clean":"2024-09-17T01:59:31.822831+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:31.822831+0000","last_undegraded":"2024-09-17T01:59:31.822831+0000","last_fullsized":"2024-09-17T01:59:31.822831+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":602,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814197+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:31.814197+0000","last_peered":"2024-09-17T01:59:31.814197+0000","last_clean":"2024-09-17T01:59:31.814197+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:31.814197+0000","last_undegraded":"2024-09-17T01:59:31.814197+0000","last_fullsized":"2024-09-17T01:59:31.814197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":562,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822789+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:31.822789+0000","last_peered":"2024-09-17T01:59:31.822789+0000","last_clean":"2024-09-17T01:59:31.822789+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:31.822789+0000","last_undegraded":"2024-09-17T01:59:31.822789+0000","last_fullsized":"2024-09-17T01:59:31.822789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":90,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.374605+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:31.374605+0000","last_peered":"2024-09-17T01:59:31.374605+0000","last_clean":"2024-09-17T01:59:31.374605+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:31.374605+0000","last_undegraded":"2024-09-17T01:59:31.374605+0000","last_fullsized":"2024-09-17T01:59:31.374605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375434+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:31.375434+0000","last_peered":"2024-09-17T01:59:31.375434+0000","last_clean":"2024-09-17T01:59:31.375434+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:31.375434+0000","last_undegraded":"2024-09-17T01:59:31.375434+0000","last_fullsized":"2024-09-17T01:59:31.375434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":607,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821040+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:31.821040+0000","last_peered":"2024-09-17T01:59:31.821040+0000","last_clean":"2024-09-17T01:59:31.821040+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:31.821040+0000","last_undegraded":"2024-09-17T01:59:31.821040+0000","last_fullsized":"2024-09-17T01:59:31.821040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":379,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375814+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:31.375814+0000","last_peered":"2024-09-17T01:59:31.375814+0000","last_clean":"2024-09-17T01:59:31.375814+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:31.375814+0000","last_undegraded":"2024-09-17T01:59:31.375814+0000","last_fullsized":"2024-09-17T01:59:31.375814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821560+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:31.821560+0000","last_peered":"2024-09-17T01:59:31.821560+0000","last_clean":"2024-09-17T01:59:31.821560+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:31.821560+0000","last_undegraded":"2024-09-17T01:59:31.821560+0000","last_fullsized":"2024-09-17T01:59:31.821560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":577,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.814806+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:31.814806+0000","last_peered":"2024-09-17T01:59:31.814806+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:31.814806+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":227,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821355+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:31.821355+0000","last_peered":"2024-09-17T01:59:31.821355+0000","last_clean":"2024-09-17T01:59:31.821355+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:31.821355+0000","last_undegraded":"2024-09-17T01:59:31.821355+0000","last_fullsized":"2024-09-17T01:59:31.821355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.817019+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:31.817019+0000","last_peered":"2024-09-17T01:59:31.817019+0000","last_clean":"2024-09-17T01:59:31.817019+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:31.817019+0000","last_undegraded":"2024-09-17T01:59:31.817019+0000","last_fullsized":"2024-09-17T01:59:31.817019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":997,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814653+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:31.814653+0000","last_peered":"2024-09-17T01:59:31.814653+0000","last_clean":"2024-09-17T01:59:31.814653+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:31.814653+0000","last_undegraded":"2024-09-17T01:59:31.814653+0000","last_fullsized":"2024-09-17T01:59:31.814653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":220,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823330+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:31.823330+0000","last_peered":"2024-09-17T01:59:31.823330+0000","last_clean":"2024-09-17T01:59:31.823330+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:31.823330+0000","last_undegraded":"2024-09-17T01:59:31.823330+0000","last_fullsized":"2024-09-17T01:59:31.823330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822824+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:31.822824+0000","last_peered":"2024-09-17T01:59:31.822824+0000","last_clean":"2024-09-17T01:59:31.822824+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:31.822824+0000","last_undegraded":"2024-09-17T01:59:31.822824+0000","last_fullsized":"2024-09-17T01:59:31.822824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":604,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.820212+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:31.820212+0000","last_peered":"2024-09-17T01:59:31.820212+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:31.820212+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":294,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822621+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:31.822621+0000","last_peered":"2024-09-17T01:59:31.822621+0000","last_clean":"2024-09-17T01:59:31.822621+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:31.822621+0000","last_undegraded":"2024-09-17T01:59:31.822621+0000","last_fullsized":"2024-09-17T01:59:31.822621+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376188+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:31.376188+0000","last_peered":"2024-09-17T01:59:31.376188+0000","last_clean":"2024-09-17T01:59:31.376188+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:31.376188+0000","last_undegraded":"2024-09-17T01:59:31.376188+0000","last_fullsized":"2024-09-17T01:59:31.376188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1031,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814096+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:31.814096+0000","last_peered":"2024-09-17T01:59:31.814096+0000","last_clean":"2024-09-17T01:59:31.814096+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:31.814096+0000","last_undegraded":"2024-09-17T01:59:31.814096+0000","last_fullsized":"2024-09-17T01:59:31.814096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":598,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376759+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:31.376759+0000","last_peered":"2024-09-17T01:59:31.376759+0000","last_clean":"2024-09-17T01:59:31.376759+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:31.376759+0000","last_undegraded":"2024-09-17T01:59:31.376759+0000","last_fullsized":"2024-09-17T01:59:31.376759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":421,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375465+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:31.375465+0000","last_peered":"2024-09-17T01:59:31.375465+0000","last_clean":"2024-09-17T01:59:31.375465+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:31.375465+0000","last_undegraded":"2024-09-17T01:59:31.375465+0000","last_fullsized":"2024-09-17T01:59:31.375465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819524+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:31.819524+0000","last_peered":"2024-09-17T01:59:31.819524+0000","last_clean":"2024-09-17T01:59:31.819524+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:31.819524+0000","last_undegraded":"2024-09-17T01:59:31.819524+0000","last_fullsized":"2024-09-17T01:59:31.819524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816655+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:31.816655+0000","last_peered":"2024-09-17T01:59:31.816655+0000","last_clean":"2024-09-17T01:59:31.816655+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:31.816655+0000","last_undegraded":"2024-09-17T01:59:31.816655+0000","last_fullsized":"2024-09-17T01:59:31.816655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":315,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376928+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:31.376928+0000","last_peered":"2024-09-17T01:59:31.376928+0000","last_clean":"2024-09-17T01:59:31.376928+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:31.376928+0000","last_undegraded":"2024-09-17T01:59:31.376928+0000","last_fullsized":"2024-09-17T01:59:31.376928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1159,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.444353+0000","last_change":"2024-09-17T01:59:31.819986+0000","last_active":"2024-09-17T01:59:31.819986+0000","last_peered":"2024-09-17T01:59:31.444353+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:31.444353+0000","last_undegraded":"2024-09-17T01:59:31.444353+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":226,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823177+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:31.823177+0000","last_peered":"2024-09-17T01:59:31.823177+0000","last_clean":"2024-09-17T01:59:31.823177+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:31.823177+0000","last_undegraded":"2024-09-17T01:59:31.823177+0000","last_fullsized":"2024-09-17T01:59:31.823177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":683,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819990+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:31.819990+0000","last_peered":"2024-09-17T01:59:31.819990+0000","last_clean":"2024-09-17T01:59:31.819990+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:31.819990+0000","last_undegraded":"2024-09-17T01:59:31.819990+0000","last_fullsized":"2024-09-17T01:59:31.819990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":869,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816601+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:31.816601+0000","last_peered":"2024-09-17T01:59:31.816601+0000","last_clean":"2024-09-17T01:59:31.816601+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:31.816601+0000","last_undegraded":"2024-09-17T01:59:31.816601+0000","last_fullsized":"2024-09-17T01:59:31.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":793,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820313+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:31.820313+0000","last_peered":"2024-09-17T01:59:31.820313+0000","last_clean":"2024-09-17T01:59:31.820313+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:31.820313+0000","last_undegraded":"2024-09-17T01:59:31.820313+0000","last_fullsized":"2024-09-17T01:59:31.820313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":952,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821820+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:31.821820+0000","last_peered":"2024-09-17T01:59:31.821820+0000","last_clean":"2024-09-17T01:59:31.821820+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:31.821820+0000","last_undegraded":"2024-09-17T01:59:31.821820+0000","last_fullsized":"2024-09-17T01:59:31.821820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":381,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821997+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:31.821997+0000","last_peered":"2024-09-17T01:59:31.821997+0000","last_clean":"2024-09-17T01:59:31.821997+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:31.821997+0000","last_undegraded":"2024-09-17T01:59:31.821997+0000","last_fullsized":"2024-09-17T01:59:31.821997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":924,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815818+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:31.815818+0000","last_peered":"2024-09-17T01:59:31.815818+0000","last_clean":"2024-09-17T01:59:31.815818+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:31.815818+0000","last_undegraded":"2024-09-17T01:59:31.815818+0000","last_fullsized":"2024-09-17T01:59:31.815818+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":439,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816790+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:31.816790+0000","last_peered":"2024-09-17T01:59:31.816790+0000","last_clean":"2024-09-17T01:59:31.816790+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:31.816790+0000","last_undegraded":"2024-09-17T01:59:31.816790+0000","last_fullsized":"2024-09-17T01:59:31.816790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":579,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815304+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:31.815304+0000","last_peered":"2024-09-17T01:59:31.815304+0000","last_clean":"2024-09-17T01:59:31.815304+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:31.815304+0000","last_undegraded":"2024-09-17T01:59:31.815304+0000","last_fullsized":"2024-09-17T01:59:31.815304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":228,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814978+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:31.814978+0000","last_peered":"2024-09-17T01:59:31.814978+0000","last_clean":"2024-09-17T01:59:31.814978+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:31.814978+0000","last_undegraded":"2024-09-17T01:59:31.814978+0000","last_fullsized":"2024-09-17T01:59:31.814978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":619,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.376104+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:31.376104+0000","last_peered":"2024-09-17T01:59:31.376104+0000","last_clean":"2024-09-17T01:59:31.376104+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:31.376104+0000","last_undegraded":"2024-09-17T01:59:31.376104+0000","last_fullsized":"2024-09-17T01:59:31.376104+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":284,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375758+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:31.375758+0000","last_peered":"2024-09-17T01:59:31.375758+0000","last_clean":"2024-09-17T01:59:31.375758+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:31.375758+0000","last_undegraded":"2024-09-17T01:59:31.375758+0000","last_fullsized":"2024-09-17T01:59:31.375758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":539,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.375677+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:31.375677+0000","last_peered":"2024-09-17T01:59:31.375677+0000","last_clean":"2024-09-17T01:59:31.375677+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:31.375677+0000","last_undegraded":"2024-09-17T01:59:31.375677+0000","last_fullsized":"2024-09-17T01:59:31.375677+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":453,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816355+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:31.816355+0000","last_peered":"2024-09-17T01:59:31.816355+0000","last_clean":"2024-09-17T01:59:31.816355+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:31.816355+0000","last_undegraded":"2024-09-17T01:59:31.816355+0000","last_fullsized":"2024-09-17T01:59:31.816355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":674,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814801+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:31.814801+0000","last_peered":"2024-09-17T01:59:31.814801+0000","last_clean":"2024-09-17T01:59:31.814801+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:31.814801+0000","last_undegraded":"2024-09-17T01:59:31.814801+0000","last_fullsized":"2024-09-17T01:59:31.814801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":209,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822325+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:31.822325+0000","last_peered":"2024-09-17T01:59:31.822325+0000","last_clean":"2024-09-17T01:59:31.822325+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:31.822325+0000","last_undegraded":"2024-09-17T01:59:31.822325+0000","last_fullsized":"2024-09-17T01:59:31.822325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":714,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818790+0000","last_change":"2024-09-17T01:59:09.362231+0000","last_active":"2024-09-17T01:59:31.818790+0000","last_peered":"2024-09-17T01:59:31.818790+0000","last_clean":"2024-09-17T01:56:19.109499+0000","last_became_active":"2024-09-17T01:59:09.344645+0000","last_became_peered":"2024-09-17T01:59:09.344645+0000","last_unstale":"2024-09-17T01:59:31.818790+0000","last_undegraded":"2024-09-17T01:59:09.224016+0000","last_fullsized":"2024-09-17T01:59:09.216174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":237,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823009+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:31.823009+0000","last_peered":"2024-09-17T01:59:31.823009+0000","last_clean":"2024-09-17T01:59:31.823009+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:31.823009+0000","last_undegraded":"2024-09-17T01:59:31.823009+0000","last_fullsized":"2024-09-17T01:59:31.823009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1417,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5499,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":6104691,"data_compressed":655244,"data_compressed_allocated":864256,"data_compressed_original":2859008,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":119,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62076,"kb_used_data":20648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94309764,"statfs":{"total":96636764160,"available":96573198336,"internally_reserved":0,"allocated":21143552,"data_stored":106747763,"data_compressed":8839702,"data_compressed_allocated":12771328,"data_compressed_original":102420480,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95240,"kb_used_data":23852,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276600,"statfs":{"total":96636764160,"available":96539238400,"internally_reserved":0,"allocated":24424448,"data_stored":85026099,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91864,"kb_used_data":20476,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279976,"statfs":{"total":96636764160,"available":96542695424,"internally_reserved":0,"allocated":20967424,"data_stored":73183423,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7217152,"data_stored":6104691,"data_compressed":655244,"data_compressed_allocated":864256,"data_compressed_original":2859008,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:36.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:59:36.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:36.797 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1417/114 objects degraded (1242.982%), 8 pgs degraded","count":8},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":314,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":100,"num_osds":3,"num_up_osds":3,"osd_up_since":1726538347,"num_in_osds":3,"osd_in_since":1726538063,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":8},{"state_name":"peering","count":3},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128027436,"bytes_used":255160320,"bytes_avail":289655132160,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":1417,"degraded_total":114,"degraded_ratio":12.429824561403509,"recovering_objects_per_sec":353,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1415,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T01:55:53.990553+0000","services":{}},"progress_events":{}} 2024-09-17T01:59:36.816 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-17T01:59:36.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:37.114 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:37.116 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:37.133 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-17T01:59:36.814440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":883,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6434,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":239288,"kb_used_data":59236,"kb_used_omap":177,"kb_used_meta":179790,"kb_avail":282876232,"statfs":{"total":289910292480,"available":289665261568,"internally_reserved":0,"allocated":60657664,"data_stored":259453877,"data_compressed":19966327,"data_compressed_allocated":32468992,"data_compressed_original":233771008,"omap_allocated":182244,"internal_metadata":184104988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-534,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":913,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000502"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":659,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816405+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:31.816405+0000","last_peered":"2024-09-17T01:59:31.816405+0000","last_clean":"2024-09-17T01:59:31.816405+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:31.816405+0000","last_undegraded":"2024-09-17T01:59:31.816405+0000","last_fullsized":"2024-09-17T01:59:31.816405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":652,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815296+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:31.815296+0000","last_peered":"2024-09-17T01:59:31.815296+0000","last_clean":"2024-09-17T01:59:31.815296+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:31.815296+0000","last_undegraded":"2024-09-17T01:59:31.815296+0000","last_fullsized":"2024-09-17T01:59:31.815296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":516,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354712+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:36.354712+0000","last_peered":"2024-09-17T01:59:36.354712+0000","last_clean":"2024-09-17T01:59:36.354712+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:36.354712+0000","last_undegraded":"2024-09-17T01:59:36.354712+0000","last_fullsized":"2024-09-17T01:59:36.354712+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":562,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352061+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:36.352061+0000","last_peered":"2024-09-17T01:59:36.352061+0000","last_clean":"2024-09-17T01:59:36.352061+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:36.352061+0000","last_undegraded":"2024-09-17T01:59:36.352061+0000","last_fullsized":"2024-09-17T01:59:36.352061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814816+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:31.814816+0000","last_peered":"2024-09-17T01:59:31.814816+0000","last_clean":"2024-09-17T01:59:31.814816+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:31.814816+0000","last_undegraded":"2024-09-17T01:59:31.814816+0000","last_fullsized":"2024-09-17T01:59:31.814816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":573,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350941+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:36.350941+0000","last_peered":"2024-09-17T01:59:36.350941+0000","last_clean":"2024-09-17T01:59:36.350941+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:36.350941+0000","last_undegraded":"2024-09-17T01:59:36.350941+0000","last_fullsized":"2024-09-17T01:59:36.350941+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":685,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350572+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:36.350572+0000","last_peered":"2024-09-17T01:59:36.350572+0000","last_clean":"2024-09-17T01:59:36.350572+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:36.350572+0000","last_undegraded":"2024-09-17T01:59:36.350572+0000","last_fullsized":"2024-09-17T01:59:36.350572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":526,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.358770+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:36.358770+0000","last_peered":"2024-09-17T01:59:36.358770+0000","last_clean":"2024-09-17T01:59:36.358770+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:36.358770+0000","last_undegraded":"2024-09-17T01:59:36.358770+0000","last_fullsized":"2024-09-17T01:59:36.358770+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":616,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821753+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:31.821753+0000","last_peered":"2024-09-17T01:59:31.821753+0000","last_clean":"2024-09-17T01:59:31.821753+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:31.821753+0000","last_undegraded":"2024-09-17T01:59:31.821753+0000","last_fullsized":"2024-09-17T01:59:31.821753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":582,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815723+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:31.815723+0000","last_peered":"2024-09-17T01:59:31.815723+0000","last_clean":"2024-09-17T01:59:31.815723+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:31.815723+0000","last_undegraded":"2024-09-17T01:59:31.815723+0000","last_fullsized":"2024-09-17T01:59:31.815723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":533,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354348+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:36.354348+0000","last_peered":"2024-09-17T01:59:36.354348+0000","last_clean":"2024-09-17T01:59:36.354348+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:36.354348+0000","last_undegraded":"2024-09-17T01:59:36.354348+0000","last_fullsized":"2024-09-17T01:59:36.354348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":865,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815235+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:31.815235+0000","last_peered":"2024-09-17T01:59:31.815235+0000","last_clean":"2024-09-17T01:59:31.815235+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:31.815235+0000","last_undegraded":"2024-09-17T01:59:31.815235+0000","last_fullsized":"2024-09-17T01:59:31.815235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":558,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814507+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:31.814507+0000","last_peered":"2024-09-17T01:59:31.814507+0000","last_clean":"2024-09-17T01:59:31.814507+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:31.814507+0000","last_undegraded":"2024-09-17T01:59:31.814507+0000","last_fullsized":"2024-09-17T01:59:31.814507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":638,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350020+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:36.350020+0000","last_peered":"2024-09-17T01:59:36.350020+0000","last_clean":"2024-09-17T01:59:36.350020+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:36.350020+0000","last_undegraded":"2024-09-17T01:59:36.350020+0000","last_fullsized":"2024-09-17T01:59:36.350020+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":587,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350449+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:36.350449+0000","last_peered":"2024-09-17T01:59:36.350449+0000","last_clean":"2024-09-17T01:59:36.350449+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:36.350449+0000","last_undegraded":"2024-09-17T01:59:36.350449+0000","last_fullsized":"2024-09-17T01:59:36.350449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":680,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818981+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:31.818981+0000","last_peered":"2024-09-17T01:59:31.818981+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:31.818981+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":580,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823236+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:31.823236+0000","last_peered":"2024-09-17T01:59:31.823236+0000","last_clean":"2024-09-17T01:59:31.823236+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:31.823236+0000","last_undegraded":"2024-09-17T01:59:31.823236+0000","last_fullsized":"2024-09-17T01:59:31.823236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":609,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816020+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:31.816020+0000","last_peered":"2024-09-17T01:59:31.816020+0000","last_clean":"2024-09-17T01:59:31.816020+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:31.816020+0000","last_undegraded":"2024-09-17T01:59:31.816020+0000","last_fullsized":"2024-09-17T01:59:31.816020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":664,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821678+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:31.821678+0000","last_peered":"2024-09-17T01:59:31.821678+0000","last_clean":"2024-09-17T01:59:31.821678+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:31.821678+0000","last_undegraded":"2024-09-17T01:59:31.821678+0000","last_fullsized":"2024-09-17T01:59:31.821678+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":687,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352538+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:36.352538+0000","last_peered":"2024-09-17T01:59:36.352538+0000","last_clean":"2024-09-17T01:59:36.352538+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:36.352538+0000","last_undegraded":"2024-09-17T01:59:36.352538+0000","last_fullsized":"2024-09-17T01:59:36.352538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":553,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352128+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:36.352128+0000","last_peered":"2024-09-17T01:59:36.352128+0000","last_clean":"2024-09-17T01:59:36.352128+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:36.352128+0000","last_undegraded":"2024-09-17T01:59:36.352128+0000","last_fullsized":"2024-09-17T01:59:36.352128+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1163,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814487+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:31.814487+0000","last_peered":"2024-09-17T01:59:31.814487+0000","last_clean":"2024-09-17T01:59:31.814487+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:31.814487+0000","last_undegraded":"2024-09-17T01:59:31.814487+0000","last_fullsized":"2024-09-17T01:59:31.814487+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1063,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819202+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:31.819202+0000","last_peered":"2024-09-17T01:59:31.819202+0000","last_clean":"2024-09-17T01:59:31.819202+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:31.819202+0000","last_undegraded":"2024-09-17T01:59:31.819202+0000","last_fullsized":"2024-09-17T01:59:31.819202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.813863+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:31.813863+0000","last_peered":"2024-09-17T01:59:31.813863+0000","last_clean":"2024-09-17T01:59:31.813863+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:31.813863+0000","last_undegraded":"2024-09-17T01:59:31.813863+0000","last_fullsized":"2024-09-17T01:59:31.813863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1006,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816595+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:31.816595+0000","last_peered":"2024-09-17T01:59:31.816595+0000","last_clean":"2024-09-17T01:59:31.816595+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:31.816595+0000","last_undegraded":"2024-09-17T01:59:31.816595+0000","last_fullsized":"2024-09-17T01:59:31.816595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822014+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:31.822014+0000","last_peered":"2024-09-17T01:59:31.822014+0000","last_clean":"2024-09-17T01:59:31.822014+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:31.822014+0000","last_undegraded":"2024-09-17T01:59:31.822014+0000","last_fullsized":"2024-09-17T01:59:31.822014+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":559,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.368477+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:36.368477+0000","last_peered":"2024-09-17T01:59:36.368477+0000","last_clean":"2024-09-17T01:59:36.368477+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:36.368477+0000","last_undegraded":"2024-09-17T01:59:36.368477+0000","last_fullsized":"2024-09-17T01:59:36.368477+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":955,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815595+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:31.815595+0000","last_peered":"2024-09-17T01:59:31.815595+0000","last_clean":"2024-09-17T01:59:31.815595+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:31.815595+0000","last_undegraded":"2024-09-17T01:59:31.815595+0000","last_fullsized":"2024-09-17T01:59:31.815595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":604,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820432+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:31.820432+0000","last_peered":"2024-09-17T01:59:31.820432+0000","last_clean":"2024-09-17T01:59:31.820432+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:31.820432+0000","last_undegraded":"2024-09-17T01:59:31.820432+0000","last_fullsized":"2024-09-17T01:59:31.820432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1045,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815449+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:31.815449+0000","last_peered":"2024-09-17T01:59:31.815449+0000","last_clean":"2024-09-17T01:59:31.815449+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:31.815449+0000","last_undegraded":"2024-09-17T01:59:31.815449+0000","last_fullsized":"2024-09-17T01:59:31.815449+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":665,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819495+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:31.819495+0000","last_peered":"2024-09-17T01:59:31.819495+0000","last_clean":"2024-09-17T01:59:31.819495+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:31.819495+0000","last_undegraded":"2024-09-17T01:59:31.819495+0000","last_fullsized":"2024-09-17T01:59:31.819495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":683,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349797+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:36.349797+0000","last_peered":"2024-09-17T01:59:36.349797+0000","last_clean":"2024-09-17T01:59:36.349797+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:36.349797+0000","last_undegraded":"2024-09-17T01:59:36.349797+0000","last_fullsized":"2024-09-17T01:59:36.349797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":632,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815590+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:31.815590+0000","last_peered":"2024-09-17T01:59:31.815590+0000","last_clean":"2024-09-17T01:59:31.815590+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:31.815590+0000","last_undegraded":"2024-09-17T01:59:31.815590+0000","last_fullsized":"2024-09-17T01:59:31.815590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":576,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351472+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:36.351472+0000","last_peered":"2024-09-17T01:59:36.351472+0000","last_clean":"2024-09-17T01:59:36.351472+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:36.351472+0000","last_undegraded":"2024-09-17T01:59:36.351472+0000","last_fullsized":"2024-09-17T01:59:36.351472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":653,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816128+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:31.816128+0000","last_peered":"2024-09-17T01:59:31.816128+0000","last_clean":"2024-09-17T01:59:31.816128+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:31.816128+0000","last_undegraded":"2024-09-17T01:59:31.816128+0000","last_fullsized":"2024-09-17T01:59:31.816128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":229,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820185+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:31.820185+0000","last_peered":"2024-09-17T01:59:31.820185+0000","last_clean":"2024-09-17T01:59:31.820185+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:31.820185+0000","last_undegraded":"2024-09-17T01:59:31.820185+0000","last_fullsized":"2024-09-17T01:59:31.820185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1073,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822515+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:31.822515+0000","last_peered":"2024-09-17T01:59:31.822515+0000","last_clean":"2024-09-17T01:59:31.822515+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:31.822515+0000","last_undegraded":"2024-09-17T01:59:31.822515+0000","last_fullsized":"2024-09-17T01:59:31.822515+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":254,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814482+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:31.814482+0000","last_peered":"2024-09-17T01:59:31.814482+0000","last_clean":"2024-09-17T01:59:31.814482+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:31.814482+0000","last_undegraded":"2024-09-17T01:59:31.814482+0000","last_fullsized":"2024-09-17T01:59:31.814482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":637,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.821822+0000","last_change":"2024-09-17T01:59:10.251005+0000","last_active":"2024-09-17T01:59:31.821822+0000","last_peered":"2024-09-17T01:59:31.821822+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:31.821822+0000","last_undegraded":"2024-09-17T01:59:10.250777+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":86,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349652+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:36.349652+0000","last_peered":"2024-09-17T01:59:36.349652+0000","last_clean":"2024-09-17T01:59:36.349652+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:36.349652+0000","last_undegraded":"2024-09-17T01:59:36.349652+0000","last_fullsized":"2024-09-17T01:59:36.349652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":256,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353263+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:36.353263+0000","last_peered":"2024-09-17T01:59:36.353263+0000","last_clean":"2024-09-17T01:59:36.353263+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:36.353263+0000","last_undegraded":"2024-09-17T01:59:36.353263+0000","last_fullsized":"2024-09-17T01:59:36.353263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":979,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.813878+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:31.813878+0000","last_peered":"2024-09-17T01:59:31.813878+0000","last_clean":"2024-09-17T01:59:31.813878+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:31.813878+0000","last_undegraded":"2024-09-17T01:59:31.813878+0000","last_fullsized":"2024-09-17T01:59:31.813878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":446,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816166+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:31.816166+0000","last_peered":"2024-09-17T01:59:31.816166+0000","last_clean":"2024-09-17T01:59:31.816166+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:31.816166+0000","last_undegraded":"2024-09-17T01:59:31.816166+0000","last_fullsized":"2024-09-17T01:59:31.816166+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":639,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814040+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:31.814040+0000","last_peered":"2024-09-17T01:59:31.814040+0000","last_clean":"2024-09-17T01:59:31.814040+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:31.814040+0000","last_undegraded":"2024-09-17T01:59:31.814040+0000","last_fullsized":"2024-09-17T01:59:31.814040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":683,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352856+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:36.352856+0000","last_peered":"2024-09-17T01:59:36.352856+0000","last_clean":"2024-09-17T01:59:36.352856+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:36.352856+0000","last_undegraded":"2024-09-17T01:59:36.352856+0000","last_fullsized":"2024-09-17T01:59:36.352856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":684,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.820593+0000","last_change":"2024-09-17T01:59:09.364058+0000","last_active":"2024-09-17T01:59:31.820593+0000","last_peered":"2024-09-17T01:59:31.820593+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:31.820593+0000","last_undegraded":"2024-09-17T01:59:09.255018+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":76,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352165+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:36.352165+0000","last_peered":"2024-09-17T01:59:36.352165+0000","last_clean":"2024-09-17T01:59:36.352165+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:36.352165+0000","last_undegraded":"2024-09-17T01:59:36.352165+0000","last_fullsized":"2024-09-17T01:59:36.352165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":995,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820145+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:31.820145+0000","last_peered":"2024-09-17T01:59:31.820145+0000","last_clean":"2024-09-17T01:59:31.820145+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:31.820145+0000","last_undegraded":"2024-09-17T01:59:31.820145+0000","last_fullsized":"2024-09-17T01:59:31.820145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":338,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820788+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:31.820788+0000","last_peered":"2024-09-17T01:59:31.820788+0000","last_clean":"2024-09-17T01:59:31.820788+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:31.820788+0000","last_undegraded":"2024-09-17T01:59:31.820788+0000","last_fullsized":"2024-09-17T01:59:31.820788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":637,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352764+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:36.352764+0000","last_peered":"2024-09-17T01:59:36.352764+0000","last_clean":"2024-09-17T01:59:36.352764+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:36.352764+0000","last_undegraded":"2024-09-17T01:59:36.352764+0000","last_fullsized":"2024-09-17T01:59:36.352764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":233,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350244+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:36.350244+0000","last_peered":"2024-09-17T01:59:36.350244+0000","last_clean":"2024-09-17T01:59:36.350244+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:36.350244+0000","last_undegraded":"2024-09-17T01:59:36.350244+0000","last_fullsized":"2024-09-17T01:59:36.350244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":670,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354610+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:36.354610+0000","last_peered":"2024-09-17T01:59:36.354610+0000","last_clean":"2024-09-17T01:59:36.354610+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:36.354610+0000","last_undegraded":"2024-09-17T01:59:36.354610+0000","last_fullsized":"2024-09-17T01:59:36.354610+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":227,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814526+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:31.814526+0000","last_peered":"2024-09-17T01:59:31.814526+0000","last_clean":"2024-09-17T01:59:31.814526+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:31.814526+0000","last_undegraded":"2024-09-17T01:59:31.814526+0000","last_fullsized":"2024-09-17T01:59:31.814526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":572,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353296+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:36.353296+0000","last_peered":"2024-09-17T01:59:36.353296+0000","last_clean":"2024-09-17T01:59:36.353296+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:36.353296+0000","last_undegraded":"2024-09-17T01:59:36.353296+0000","last_fullsized":"2024-09-17T01:59:36.353296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":622,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814404+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:31.814404+0000","last_peered":"2024-09-17T01:59:31.814404+0000","last_clean":"2024-09-17T01:59:31.814404+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:31.814404+0000","last_undegraded":"2024-09-17T01:59:31.814404+0000","last_fullsized":"2024-09-17T01:59:31.814404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":599,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822682+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:31.822682+0000","last_peered":"2024-09-17T01:59:31.822682+0000","last_clean":"2024-09-17T01:59:31.822682+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:31.822682+0000","last_undegraded":"2024-09-17T01:59:31.822682+0000","last_fullsized":"2024-09-17T01:59:31.822682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":275,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349326+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:36.349326+0000","last_peered":"2024-09-17T01:59:36.349326+0000","last_clean":"2024-09-17T01:59:36.349326+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:36.349326+0000","last_undegraded":"2024-09-17T01:59:36.349326+0000","last_fullsized":"2024-09-17T01:59:36.349326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349991+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:36.349991+0000","last_peered":"2024-09-17T01:59:36.349991+0000","last_clean":"2024-09-17T01:59:36.349991+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:36.349991+0000","last_undegraded":"2024-09-17T01:59:36.349991+0000","last_fullsized":"2024-09-17T01:59:36.349991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":520,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351033+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:36.351033+0000","last_peered":"2024-09-17T01:59:36.351033+0000","last_clean":"2024-09-17T01:59:36.351033+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:36.351033+0000","last_undegraded":"2024-09-17T01:59:36.351033+0000","last_fullsized":"2024-09-17T01:59:36.351033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":595,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353137+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:36.353137+0000","last_peered":"2024-09-17T01:59:36.353137+0000","last_clean":"2024-09-17T01:59:36.353137+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:36.353137+0000","last_undegraded":"2024-09-17T01:59:36.353137+0000","last_fullsized":"2024-09-17T01:59:36.353137+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351115+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:36.351115+0000","last_peered":"2024-09-17T01:59:36.351115+0000","last_clean":"2024-09-17T01:59:36.351115+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:36.351115+0000","last_undegraded":"2024-09-17T01:59:36.351115+0000","last_fullsized":"2024-09-17T01:59:36.351115+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":362,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822297+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:31.822297+0000","last_peered":"2024-09-17T01:59:31.822297+0000","last_clean":"2024-09-17T01:59:31.822297+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:31.822297+0000","last_undegraded":"2024-09-17T01:59:31.822297+0000","last_fullsized":"2024-09-17T01:59:31.822297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":700,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815649+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:31.815649+0000","last_peered":"2024-09-17T01:59:31.815649+0000","last_clean":"2024-09-17T01:59:31.815649+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:31.815649+0000","last_undegraded":"2024-09-17T01:59:31.815649+0000","last_fullsized":"2024-09-17T01:59:31.815649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822831+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:31.822831+0000","last_peered":"2024-09-17T01:59:31.822831+0000","last_clean":"2024-09-17T01:59:31.822831+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:31.822831+0000","last_undegraded":"2024-09-17T01:59:31.822831+0000","last_fullsized":"2024-09-17T01:59:31.822831+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":602,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814197+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:31.814197+0000","last_peered":"2024-09-17T01:59:31.814197+0000","last_clean":"2024-09-17T01:59:31.814197+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:31.814197+0000","last_undegraded":"2024-09-17T01:59:31.814197+0000","last_fullsized":"2024-09-17T01:59:31.814197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":562,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822789+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:31.822789+0000","last_peered":"2024-09-17T01:59:31.822789+0000","last_clean":"2024-09-17T01:59:31.822789+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:31.822789+0000","last_undegraded":"2024-09-17T01:59:31.822789+0000","last_fullsized":"2024-09-17T01:59:31.822789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":100,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349769+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:36.349769+0000","last_peered":"2024-09-17T01:59:36.349769+0000","last_clean":"2024-09-17T01:59:36.349769+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:36.349769+0000","last_undegraded":"2024-09-17T01:59:36.349769+0000","last_fullsized":"2024-09-17T01:59:36.349769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":76,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350388+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:36.350388+0000","last_peered":"2024-09-17T01:59:36.350388+0000","last_clean":"2024-09-17T01:59:36.350388+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:36.350388+0000","last_undegraded":"2024-09-17T01:59:36.350388+0000","last_fullsized":"2024-09-17T01:59:36.350388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":607,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821040+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:31.821040+0000","last_peered":"2024-09-17T01:59:31.821040+0000","last_clean":"2024-09-17T01:59:31.821040+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:31.821040+0000","last_undegraded":"2024-09-17T01:59:31.821040+0000","last_fullsized":"2024-09-17T01:59:31.821040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352501+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:36.352501+0000","last_peered":"2024-09-17T01:59:36.352501+0000","last_clean":"2024-09-17T01:59:36.352501+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:36.352501+0000","last_undegraded":"2024-09-17T01:59:36.352501+0000","last_fullsized":"2024-09-17T01:59:36.352501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821560+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:31.821560+0000","last_peered":"2024-09-17T01:59:31.821560+0000","last_clean":"2024-09-17T01:59:31.821560+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:31.821560+0000","last_undegraded":"2024-09-17T01:59:31.821560+0000","last_fullsized":"2024-09-17T01:59:31.821560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":577,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.814806+0000","last_change":"2024-09-17T01:59:09.359928+0000","last_active":"2024-09-17T01:59:31.814806+0000","last_peered":"2024-09-17T01:59:31.814806+0000","last_clean":"2024-09-17T01:56:19.184693+0000","last_became_active":"2024-09-17T01:59:09.356477+0000","last_became_peered":"2024-09-17T01:59:09.356477+0000","last_unstale":"2024-09-17T01:59:31.814806+0000","last_undegraded":"2024-09-17T01:59:09.254761+0000","last_fullsized":"2024-09-17T01:59:09.252237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":160,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":227,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821355+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:31.821355+0000","last_peered":"2024-09-17T01:59:31.821355+0000","last_clean":"2024-09-17T01:59:31.821355+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:31.821355+0000","last_undegraded":"2024-09-17T01:59:31.821355+0000","last_fullsized":"2024-09-17T01:59:31.821355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.817019+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:31.817019+0000","last_peered":"2024-09-17T01:59:31.817019+0000","last_clean":"2024-09-17T01:59:31.817019+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:31.817019+0000","last_undegraded":"2024-09-17T01:59:31.817019+0000","last_fullsized":"2024-09-17T01:59:31.817019+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":997,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814653+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:31.814653+0000","last_peered":"2024-09-17T01:59:31.814653+0000","last_clean":"2024-09-17T01:59:31.814653+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:31.814653+0000","last_undegraded":"2024-09-17T01:59:31.814653+0000","last_fullsized":"2024-09-17T01:59:31.814653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":220,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823330+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:31.823330+0000","last_peered":"2024-09-17T01:59:31.823330+0000","last_clean":"2024-09-17T01:59:31.823330+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:31.823330+0000","last_undegraded":"2024-09-17T01:59:31.823330+0000","last_fullsized":"2024-09-17T01:59:31.823330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822824+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:31.822824+0000","last_peered":"2024-09-17T01:59:31.822824+0000","last_clean":"2024-09-17T01:59:31.822824+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:31.822824+0000","last_undegraded":"2024-09-17T01:59:31.822824+0000","last_fullsized":"2024-09-17T01:59:31.822824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":604,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.820212+0000","last_change":"2024-09-17T01:59:09.362397+0000","last_active":"2024-09-17T01:59:31.820212+0000","last_peered":"2024-09-17T01:59:31.820212+0000","last_clean":"2024-09-17T01:56:19.198451+0000","last_became_active":"2024-09-17T01:59:09.354005+0000","last_became_peered":"2024-09-17T01:59:09.354005+0000","last_unstale":"2024-09-17T01:59:31.820212+0000","last_undegraded":"2024-09-17T01:59:09.252827+0000","last_fullsized":"2024-09-17T01:59:09.243415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":294,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822621+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:31.822621+0000","last_peered":"2024-09-17T01:59:31.822621+0000","last_clean":"2024-09-17T01:59:31.822621+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:31.822621+0000","last_undegraded":"2024-09-17T01:59:31.822621+0000","last_fullsized":"2024-09-17T01:59:31.822621+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352912+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:36.352912+0000","last_peered":"2024-09-17T01:59:36.352912+0000","last_clean":"2024-09-17T01:59:36.352912+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:36.352912+0000","last_undegraded":"2024-09-17T01:59:36.352912+0000","last_fullsized":"2024-09-17T01:59:36.352912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1031,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814096+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:31.814096+0000","last_peered":"2024-09-17T01:59:31.814096+0000","last_clean":"2024-09-17T01:59:31.814096+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:31.814096+0000","last_undegraded":"2024-09-17T01:59:31.814096+0000","last_fullsized":"2024-09-17T01:59:31.814096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":608,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351946+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:36.351946+0000","last_peered":"2024-09-17T01:59:36.351946+0000","last_clean":"2024-09-17T01:59:36.351946+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:36.351946+0000","last_undegraded":"2024-09-17T01:59:36.351946+0000","last_fullsized":"2024-09-17T01:59:36.351946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":431,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351741+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:36.351741+0000","last_peered":"2024-09-17T01:59:36.351741+0000","last_clean":"2024-09-17T01:59:36.351741+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:36.351741+0000","last_undegraded":"2024-09-17T01:59:36.351741+0000","last_fullsized":"2024-09-17T01:59:36.351741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":656,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819524+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:31.819524+0000","last_peered":"2024-09-17T01:59:31.819524+0000","last_clean":"2024-09-17T01:59:31.819524+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:31.819524+0000","last_undegraded":"2024-09-17T01:59:31.819524+0000","last_fullsized":"2024-09-17T01:59:31.819524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816655+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:31.816655+0000","last_peered":"2024-09-17T01:59:31.816655+0000","last_clean":"2024-09-17T01:59:31.816655+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:31.816655+0000","last_undegraded":"2024-09-17T01:59:31.816655+0000","last_fullsized":"2024-09-17T01:59:31.816655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":325,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353080+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:36.353080+0000","last_peered":"2024-09-17T01:59:36.353080+0000","last_clean":"2024-09-17T01:59:36.353080+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:36.353080+0000","last_undegraded":"2024-09-17T01:59:36.353080+0000","last_fullsized":"2024-09-17T01:59:36.353080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1159,"reported_epoch":95,"state":"peering","last_fresh":"2024-09-17T01:59:31.444353+0000","last_change":"2024-09-17T01:59:31.819986+0000","last_active":"2024-09-17T01:59:31.819986+0000","last_peered":"2024-09-17T01:59:31.444353+0000","last_clean":"2024-09-17T01:56:19.127029+0000","last_became_active":"2024-09-17T01:59:09.351836+0000","last_became_peered":"2024-09-17T01:59:09.351836+0000","last_unstale":"2024-09-17T01:59:31.444353+0000","last_undegraded":"2024-09-17T01:59:31.444353+0000","last_fullsized":"2024-09-17T01:59:09.231426+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":226,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823177+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:31.823177+0000","last_peered":"2024-09-17T01:59:31.823177+0000","last_clean":"2024-09-17T01:59:31.823177+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:31.823177+0000","last_undegraded":"2024-09-17T01:59:31.823177+0000","last_fullsized":"2024-09-17T01:59:31.823177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":683,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.819990+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:31.819990+0000","last_peered":"2024-09-17T01:59:31.819990+0000","last_clean":"2024-09-17T01:59:31.819990+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:31.819990+0000","last_undegraded":"2024-09-17T01:59:31.819990+0000","last_fullsized":"2024-09-17T01:59:31.819990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":869,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816601+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:31.816601+0000","last_peered":"2024-09-17T01:59:31.816601+0000","last_clean":"2024-09-17T01:59:31.816601+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:31.816601+0000","last_undegraded":"2024-09-17T01:59:31.816601+0000","last_fullsized":"2024-09-17T01:59:31.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":793,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.820313+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:31.820313+0000","last_peered":"2024-09-17T01:59:31.820313+0000","last_clean":"2024-09-17T01:59:31.820313+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:31.820313+0000","last_undegraded":"2024-09-17T01:59:31.820313+0000","last_fullsized":"2024-09-17T01:59:31.820313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":952,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821820+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:31.821820+0000","last_peered":"2024-09-17T01:59:31.821820+0000","last_clean":"2024-09-17T01:59:31.821820+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:31.821820+0000","last_undegraded":"2024-09-17T01:59:31.821820+0000","last_fullsized":"2024-09-17T01:59:31.821820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":381,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.821997+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:31.821997+0000","last_peered":"2024-09-17T01:59:31.821997+0000","last_clean":"2024-09-17T01:59:31.821997+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:31.821997+0000","last_undegraded":"2024-09-17T01:59:31.821997+0000","last_fullsized":"2024-09-17T01:59:31.821997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":924,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815818+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:31.815818+0000","last_peered":"2024-09-17T01:59:31.815818+0000","last_clean":"2024-09-17T01:59:31.815818+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:31.815818+0000","last_undegraded":"2024-09-17T01:59:31.815818+0000","last_fullsized":"2024-09-17T01:59:31.815818+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":439,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816790+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:31.816790+0000","last_peered":"2024-09-17T01:59:31.816790+0000","last_clean":"2024-09-17T01:59:31.816790+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:31.816790+0000","last_undegraded":"2024-09-17T01:59:31.816790+0000","last_fullsized":"2024-09-17T01:59:31.816790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":579,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.815304+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:31.815304+0000","last_peered":"2024-09-17T01:59:31.815304+0000","last_clean":"2024-09-17T01:59:31.815304+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:31.815304+0000","last_undegraded":"2024-09-17T01:59:31.815304+0000","last_fullsized":"2024-09-17T01:59:31.815304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":228,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814978+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:31.814978+0000","last_peered":"2024-09-17T01:59:31.814978+0000","last_clean":"2024-09-17T01:59:31.814978+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:31.814978+0000","last_undegraded":"2024-09-17T01:59:31.814978+0000","last_fullsized":"2024-09-17T01:59:31.814978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":629,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351722+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:36.351722+0000","last_peered":"2024-09-17T01:59:36.351722+0000","last_clean":"2024-09-17T01:59:36.351722+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:36.351722+0000","last_undegraded":"2024-09-17T01:59:36.351722+0000","last_fullsized":"2024-09-17T01:59:36.351722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":294,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351760+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:36.351760+0000","last_peered":"2024-09-17T01:59:36.351760+0000","last_clean":"2024-09-17T01:59:36.351760+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:36.351760+0000","last_undegraded":"2024-09-17T01:59:36.351760+0000","last_fullsized":"2024-09-17T01:59:36.351760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":549,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350527+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:36.350527+0000","last_peered":"2024-09-17T01:59:36.350527+0000","last_clean":"2024-09-17T01:59:36.350527+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:36.350527+0000","last_undegraded":"2024-09-17T01:59:36.350527+0000","last_fullsized":"2024-09-17T01:59:36.350527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":453,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.816355+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:31.816355+0000","last_peered":"2024-09-17T01:59:31.816355+0000","last_clean":"2024-09-17T01:59:31.816355+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:31.816355+0000","last_undegraded":"2024-09-17T01:59:31.816355+0000","last_fullsized":"2024-09-17T01:59:31.816355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":674,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.814801+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:31.814801+0000","last_peered":"2024-09-17T01:59:31.814801+0000","last_clean":"2024-09-17T01:59:31.814801+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:31.814801+0000","last_undegraded":"2024-09-17T01:59:31.814801+0000","last_fullsized":"2024-09-17T01:59:31.814801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":209,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.822325+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:31.822325+0000","last_peered":"2024-09-17T01:59:31.822325+0000","last_clean":"2024-09-17T01:59:31.822325+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:31.822325+0000","last_undegraded":"2024-09-17T01:59:31.822325+0000","last_fullsized":"2024-09-17T01:59:31.822325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":675,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351286+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:36.351286+0000","last_peered":"2024-09-17T01:59:36.351286+0000","last_clean":"2024-09-17T01:59:36.351286+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:36.351286+0000","last_undegraded":"2024-09-17T01:59:36.351286+0000","last_fullsized":"2024-09-17T01:59:36.351286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":237,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-17T01:59:31.823009+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:31.823009+0000","last_peered":"2024-09-17T01:59:31.823009+0000","last_clean":"2024-09-17T01:59:31.823009+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:31.823009+0000","last_undegraded":"2024-09-17T01:59:31.823009+0000","last_fullsized":"2024-09-17T01:59:31.823009+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":883,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6412,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1527808,"data_stored":1491260,"data_compressed":181691,"data_compressed_allocated":237568,"data_compressed_original":811008,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678024,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52184,"kb_used_data":14908,"kb_used_omap":174,"kb_used_meta":37073,"kb_avail":94319656,"statfs":{"total":96636764160,"available":96583327744,"internally_reserved":0,"allocated":15265792,"data_stored":101244355,"data_compressed":8306248,"data_compressed_allocated":12034048,"data_compressed_original":99508224,"omap_allocated":179054,"internal_metadata":37962898},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95240,"kb_used_data":23852,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276600,"statfs":{"total":96636764160,"available":96539238400,"internally_reserved":0,"allocated":24424448,"data_stored":85026099,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91864,"kb_used_data":20476,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279976,"statfs":{"total":96636764160,"available":96542695424,"internally_reserved":0,"allocated":20967424,"data_stored":73183423,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1527808,"data_stored":1491260,"data_compressed":181691,"data_compressed_allocated":237568,"data_compressed_original":811008,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:40.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:40.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:40.463 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:40.480 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-09-17T01:59:40.098400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7031,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":207,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":239372,"kb_used_data":59332,"kb_used_omap":177,"kb_used_meta":179790,"kb_avail":282876148,"statfs":{"total":289910292480,"available":289665175552,"internally_reserved":0,"allocated":60755968,"data_stored":259493695,"data_compressed":19966327,"data_compressed_allocated":32468992,"data_compressed_original":233771008,"omap_allocated":182244,"internal_metadata":184104988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1230,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1510,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.275024"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":669,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818668+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:36.818668+0000","last_peered":"2024-09-17T01:59:36.818668+0000","last_clean":"2024-09-17T01:59:36.818668+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:36.818668+0000","last_undegraded":"2024-09-17T01:59:36.818668+0000","last_fullsized":"2024-09-17T01:59:36.818668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":662,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817892+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:36.817892+0000","last_peered":"2024-09-17T01:59:36.817892+0000","last_clean":"2024-09-17T01:59:36.817892+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:36.817892+0000","last_undegraded":"2024-09-17T01:59:36.817892+0000","last_fullsized":"2024-09-17T01:59:36.817892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":516,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354712+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:36.354712+0000","last_peered":"2024-09-17T01:59:36.354712+0000","last_clean":"2024-09-17T01:59:36.354712+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:36.354712+0000","last_undegraded":"2024-09-17T01:59:36.354712+0000","last_fullsized":"2024-09-17T01:59:36.354712+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":562,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352061+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:36.352061+0000","last_peered":"2024-09-17T01:59:36.352061+0000","last_clean":"2024-09-17T01:59:36.352061+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:36.352061+0000","last_undegraded":"2024-09-17T01:59:36.352061+0000","last_fullsized":"2024-09-17T01:59:36.352061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817369+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:36.817369+0000","last_peered":"2024-09-17T01:59:36.817369+0000","last_clean":"2024-09-17T01:59:36.817369+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:36.817369+0000","last_undegraded":"2024-09-17T01:59:36.817369+0000","last_fullsized":"2024-09-17T01:59:36.817369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":573,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350941+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:36.350941+0000","last_peered":"2024-09-17T01:59:36.350941+0000","last_clean":"2024-09-17T01:59:36.350941+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:36.350941+0000","last_undegraded":"2024-09-17T01:59:36.350941+0000","last_fullsized":"2024-09-17T01:59:36.350941+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":685,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350572+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:36.350572+0000","last_peered":"2024-09-17T01:59:36.350572+0000","last_clean":"2024-09-17T01:59:36.350572+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:36.350572+0000","last_undegraded":"2024-09-17T01:59:36.350572+0000","last_fullsized":"2024-09-17T01:59:36.350572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":526,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.358770+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:36.358770+0000","last_peered":"2024-09-17T01:59:36.358770+0000","last_clean":"2024-09-17T01:59:36.358770+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:36.358770+0000","last_undegraded":"2024-09-17T01:59:36.358770+0000","last_fullsized":"2024-09-17T01:59:36.358770+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":627,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821832+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:36.821832+0000","last_peered":"2024-09-17T01:59:36.821832+0000","last_clean":"2024-09-17T01:59:36.821832+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:36.821832+0000","last_undegraded":"2024-09-17T01:59:36.821832+0000","last_fullsized":"2024-09-17T01:59:36.821832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":593,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818049+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:36.818049+0000","last_peered":"2024-09-17T01:59:36.818049+0000","last_clean":"2024-09-17T01:59:36.818049+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:36.818049+0000","last_undegraded":"2024-09-17T01:59:36.818049+0000","last_fullsized":"2024-09-17T01:59:36.818049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":533,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354348+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:36.354348+0000","last_peered":"2024-09-17T01:59:36.354348+0000","last_clean":"2024-09-17T01:59:36.354348+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:36.354348+0000","last_undegraded":"2024-09-17T01:59:36.354348+0000","last_fullsized":"2024-09-17T01:59:36.354348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":876,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817619+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:36.817619+0000","last_peered":"2024-09-17T01:59:36.817619+0000","last_clean":"2024-09-17T01:59:36.817619+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:36.817619+0000","last_undegraded":"2024-09-17T01:59:36.817619+0000","last_fullsized":"2024-09-17T01:59:36.817619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":569,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817226+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:36.817226+0000","last_peered":"2024-09-17T01:59:36.817226+0000","last_clean":"2024-09-17T01:59:36.817226+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:36.817226+0000","last_undegraded":"2024-09-17T01:59:36.817226+0000","last_fullsized":"2024-09-17T01:59:36.817226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":638,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350020+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:36.350020+0000","last_peered":"2024-09-17T01:59:36.350020+0000","last_clean":"2024-09-17T01:59:36.350020+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:36.350020+0000","last_undegraded":"2024-09-17T01:59:36.350020+0000","last_fullsized":"2024-09-17T01:59:36.350020+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":587,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350449+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:36.350449+0000","last_peered":"2024-09-17T01:59:36.350449+0000","last_clean":"2024-09-17T01:59:36.350449+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:36.350449+0000","last_undegraded":"2024-09-17T01:59:36.350449+0000","last_fullsized":"2024-09-17T01:59:36.350449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":680,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818981+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:31.818981+0000","last_peered":"2024-09-17T01:59:31.818981+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:31.818981+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":590,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822811+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:36.822811+0000","last_peered":"2024-09-17T01:59:36.822811+0000","last_clean":"2024-09-17T01:59:36.822811+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:36.822811+0000","last_undegraded":"2024-09-17T01:59:36.822811+0000","last_fullsized":"2024-09-17T01:59:36.822811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":619,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818441+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:36.818441+0000","last_peered":"2024-09-17T01:59:36.818441+0000","last_clean":"2024-09-17T01:59:36.818441+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:36.818441+0000","last_undegraded":"2024-09-17T01:59:36.818441+0000","last_fullsized":"2024-09-17T01:59:36.818441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":674,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821263+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:36.821263+0000","last_peered":"2024-09-17T01:59:36.821263+0000","last_clean":"2024-09-17T01:59:36.821263+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:36.821263+0000","last_undegraded":"2024-09-17T01:59:36.821263+0000","last_fullsized":"2024-09-17T01:59:36.821263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":687,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352538+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:36.352538+0000","last_peered":"2024-09-17T01:59:36.352538+0000","last_clean":"2024-09-17T01:59:36.352538+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:36.352538+0000","last_undegraded":"2024-09-17T01:59:36.352538+0000","last_fullsized":"2024-09-17T01:59:36.352538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":553,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352128+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:36.352128+0000","last_peered":"2024-09-17T01:59:36.352128+0000","last_clean":"2024-09-17T01:59:36.352128+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:36.352128+0000","last_undegraded":"2024-09-17T01:59:36.352128+0000","last_fullsized":"2024-09-17T01:59:36.352128+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1173,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817696+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:36.817696+0000","last_peered":"2024-09-17T01:59:36.817696+0000","last_clean":"2024-09-17T01:59:36.817696+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:36.817696+0000","last_undegraded":"2024-09-17T01:59:36.817696+0000","last_fullsized":"2024-09-17T01:59:36.817696+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1073,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818662+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:36.818662+0000","last_peered":"2024-09-17T01:59:36.818662+0000","last_clean":"2024-09-17T01:59:36.818662+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:36.818662+0000","last_undegraded":"2024-09-17T01:59:36.818662+0000","last_fullsized":"2024-09-17T01:59:36.818662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816467+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:36.816467+0000","last_peered":"2024-09-17T01:59:36.816467+0000","last_clean":"2024-09-17T01:59:36.816467+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:36.816467+0000","last_undegraded":"2024-09-17T01:59:36.816467+0000","last_fullsized":"2024-09-17T01:59:36.816467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1016,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818802+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:36.818802+0000","last_peered":"2024-09-17T01:59:36.818802+0000","last_clean":"2024-09-17T01:59:36.818802+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:36.818802+0000","last_undegraded":"2024-09-17T01:59:36.818802+0000","last_fullsized":"2024-09-17T01:59:36.818802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1096,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821510+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:36.821510+0000","last_peered":"2024-09-17T01:59:36.821510+0000","last_clean":"2024-09-17T01:59:36.821510+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:36.821510+0000","last_undegraded":"2024-09-17T01:59:36.821510+0000","last_fullsized":"2024-09-17T01:59:36.821510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":559,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.368477+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:36.368477+0000","last_peered":"2024-09-17T01:59:36.368477+0000","last_clean":"2024-09-17T01:59:36.368477+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:36.368477+0000","last_undegraded":"2024-09-17T01:59:36.368477+0000","last_fullsized":"2024-09-17T01:59:36.368477+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":965,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818036+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:36.818036+0000","last_peered":"2024-09-17T01:59:36.818036+0000","last_clean":"2024-09-17T01:59:36.818036+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:36.818036+0000","last_undegraded":"2024-09-17T01:59:36.818036+0000","last_fullsized":"2024-09-17T01:59:36.818036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":614,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820265+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:36.820265+0000","last_peered":"2024-09-17T01:59:36.820265+0000","last_clean":"2024-09-17T01:59:36.820265+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:36.820265+0000","last_undegraded":"2024-09-17T01:59:36.820265+0000","last_fullsized":"2024-09-17T01:59:36.820265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1055,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818865+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:36.818865+0000","last_peered":"2024-09-17T01:59:36.818865+0000","last_clean":"2024-09-17T01:59:36.818865+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:36.818865+0000","last_undegraded":"2024-09-17T01:59:36.818865+0000","last_fullsized":"2024-09-17T01:59:36.818865+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":675,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818826+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:36.818826+0000","last_peered":"2024-09-17T01:59:36.818826+0000","last_clean":"2024-09-17T01:59:36.818826+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:36.818826+0000","last_undegraded":"2024-09-17T01:59:36.818826+0000","last_fullsized":"2024-09-17T01:59:36.818826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":683,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349797+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:36.349797+0000","last_peered":"2024-09-17T01:59:36.349797+0000","last_clean":"2024-09-17T01:59:36.349797+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:36.349797+0000","last_undegraded":"2024-09-17T01:59:36.349797+0000","last_fullsized":"2024-09-17T01:59:36.349797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":642,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817855+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:36.817855+0000","last_peered":"2024-09-17T01:59:36.817855+0000","last_clean":"2024-09-17T01:59:36.817855+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:36.817855+0000","last_undegraded":"2024-09-17T01:59:36.817855+0000","last_fullsized":"2024-09-17T01:59:36.817855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":576,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351472+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:36.351472+0000","last_peered":"2024-09-17T01:59:36.351472+0000","last_clean":"2024-09-17T01:59:36.351472+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:36.351472+0000","last_undegraded":"2024-09-17T01:59:36.351472+0000","last_fullsized":"2024-09-17T01:59:36.351472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":664,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818740+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:36.818740+0000","last_peered":"2024-09-17T01:59:36.818740+0000","last_clean":"2024-09-17T01:59:36.818740+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:36.818740+0000","last_undegraded":"2024-09-17T01:59:36.818740+0000","last_fullsized":"2024-09-17T01:59:36.818740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":239,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819407+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:36.819407+0000","last_peered":"2024-09-17T01:59:36.819407+0000","last_clean":"2024-09-17T01:59:36.819407+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:36.819407+0000","last_undegraded":"2024-09-17T01:59:36.819407+0000","last_fullsized":"2024-09-17T01:59:36.819407+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1084,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822041+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:36.822041+0000","last_peered":"2024-09-17T01:59:36.822041+0000","last_clean":"2024-09-17T01:59:36.822041+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:36.822041+0000","last_undegraded":"2024-09-17T01:59:36.822041+0000","last_fullsized":"2024-09-17T01:59:36.822041+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":264,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817037+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:36.817037+0000","last_peered":"2024-09-17T01:59:36.817037+0000","last_clean":"2024-09-17T01:59:36.817037+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:36.817037+0000","last_undegraded":"2024-09-17T01:59:36.817037+0000","last_fullsized":"2024-09-17T01:59:36.817037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":787,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:37.132245+0000","last_change":"2024-09-17T01:59:36.864741+0000","last_active":"2024-09-17T01:59:37.132245+0000","last_peered":"2024-09-17T01:59:37.132245+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:37.132245+0000","last_undegraded":"2024-09-17T01:59:37.132245+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":86,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349652+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:36.349652+0000","last_peered":"2024-09-17T01:59:36.349652+0000","last_clean":"2024-09-17T01:59:36.349652+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:36.349652+0000","last_undegraded":"2024-09-17T01:59:36.349652+0000","last_fullsized":"2024-09-17T01:59:36.349652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":256,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353263+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:36.353263+0000","last_peered":"2024-09-17T01:59:36.353263+0000","last_clean":"2024-09-17T01:59:36.353263+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:36.353263+0000","last_undegraded":"2024-09-17T01:59:36.353263+0000","last_fullsized":"2024-09-17T01:59:36.353263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":989,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816599+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:36.816599+0000","last_peered":"2024-09-17T01:59:36.816599+0000","last_clean":"2024-09-17T01:59:36.816599+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:36.816599+0000","last_undegraded":"2024-09-17T01:59:36.816599+0000","last_fullsized":"2024-09-17T01:59:36.816599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":456,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818582+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:36.818582+0000","last_peered":"2024-09-17T01:59:36.818582+0000","last_clean":"2024-09-17T01:59:36.818582+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:36.818582+0000","last_undegraded":"2024-09-17T01:59:36.818582+0000","last_fullsized":"2024-09-17T01:59:36.818582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":649,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816684+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:36.816684+0000","last_peered":"2024-09-17T01:59:36.816684+0000","last_clean":"2024-09-17T01:59:36.816684+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:36.816684+0000","last_undegraded":"2024-09-17T01:59:36.816684+0000","last_fullsized":"2024-09-17T01:59:36.816684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":683,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352856+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:36.352856+0000","last_peered":"2024-09-17T01:59:36.352856+0000","last_clean":"2024-09-17T01:59:36.352856+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:36.352856+0000","last_undegraded":"2024-09-17T01:59:36.352856+0000","last_fullsized":"2024-09-17T01:59:36.352856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":1072,"reported_epoch":101,"state":"active+undersized+remapped","last_fresh":"2024-09-17T01:59:36.859671+0000","last_change":"2024-09-17T01:59:36.860115+0000","last_active":"2024-09-17T01:59:36.859671+0000","last_peered":"2024-09-17T01:59:36.859671+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:36.859671+0000","last_undegraded":"2024-09-17T01:59:36.859671+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":76,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352165+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:36.352165+0000","last_peered":"2024-09-17T01:59:36.352165+0000","last_clean":"2024-09-17T01:59:36.352165+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:36.352165+0000","last_undegraded":"2024-09-17T01:59:36.352165+0000","last_fullsized":"2024-09-17T01:59:36.352165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1005,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819766+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:36.819766+0000","last_peered":"2024-09-17T01:59:36.819766+0000","last_clean":"2024-09-17T01:59:36.819766+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:36.819766+0000","last_undegraded":"2024-09-17T01:59:36.819766+0000","last_fullsized":"2024-09-17T01:59:36.819766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":348,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820978+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:36.820978+0000","last_peered":"2024-09-17T01:59:36.820978+0000","last_clean":"2024-09-17T01:59:36.820978+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:36.820978+0000","last_undegraded":"2024-09-17T01:59:36.820978+0000","last_fullsized":"2024-09-17T01:59:36.820978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":637,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352764+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:36.352764+0000","last_peered":"2024-09-17T01:59:36.352764+0000","last_clean":"2024-09-17T01:59:36.352764+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:36.352764+0000","last_undegraded":"2024-09-17T01:59:36.352764+0000","last_fullsized":"2024-09-17T01:59:36.352764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":233,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350244+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:36.350244+0000","last_peered":"2024-09-17T01:59:36.350244+0000","last_clean":"2024-09-17T01:59:36.350244+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:36.350244+0000","last_undegraded":"2024-09-17T01:59:36.350244+0000","last_fullsized":"2024-09-17T01:59:36.350244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":670,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354610+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:36.354610+0000","last_peered":"2024-09-17T01:59:36.354610+0000","last_clean":"2024-09-17T01:59:36.354610+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:36.354610+0000","last_undegraded":"2024-09-17T01:59:36.354610+0000","last_fullsized":"2024-09-17T01:59:36.354610+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817329+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:36.817329+0000","last_peered":"2024-09-17T01:59:36.817329+0000","last_clean":"2024-09-17T01:59:36.817329+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:36.817329+0000","last_undegraded":"2024-09-17T01:59:36.817329+0000","last_fullsized":"2024-09-17T01:59:36.817329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":572,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353296+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:36.353296+0000","last_peered":"2024-09-17T01:59:36.353296+0000","last_clean":"2024-09-17T01:59:36.353296+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:36.353296+0000","last_undegraded":"2024-09-17T01:59:36.353296+0000","last_fullsized":"2024-09-17T01:59:36.353296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":632,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816712+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:36.816712+0000","last_peered":"2024-09-17T01:59:36.816712+0000","last_clean":"2024-09-17T01:59:36.816712+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:36.816712+0000","last_undegraded":"2024-09-17T01:59:36.816712+0000","last_fullsized":"2024-09-17T01:59:36.816712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":609,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821969+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:36.821969+0000","last_peered":"2024-09-17T01:59:36.821969+0000","last_clean":"2024-09-17T01:59:36.821969+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:36.821969+0000","last_undegraded":"2024-09-17T01:59:36.821969+0000","last_fullsized":"2024-09-17T01:59:36.821969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":275,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349326+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:36.349326+0000","last_peered":"2024-09-17T01:59:36.349326+0000","last_clean":"2024-09-17T01:59:36.349326+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:36.349326+0000","last_undegraded":"2024-09-17T01:59:36.349326+0000","last_fullsized":"2024-09-17T01:59:36.349326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349991+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:36.349991+0000","last_peered":"2024-09-17T01:59:36.349991+0000","last_clean":"2024-09-17T01:59:36.349991+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:36.349991+0000","last_undegraded":"2024-09-17T01:59:36.349991+0000","last_fullsized":"2024-09-17T01:59:36.349991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":520,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351033+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:36.351033+0000","last_peered":"2024-09-17T01:59:36.351033+0000","last_clean":"2024-09-17T01:59:36.351033+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:36.351033+0000","last_undegraded":"2024-09-17T01:59:36.351033+0000","last_fullsized":"2024-09-17T01:59:36.351033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":595,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353137+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:36.353137+0000","last_peered":"2024-09-17T01:59:36.353137+0000","last_clean":"2024-09-17T01:59:36.353137+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:36.353137+0000","last_undegraded":"2024-09-17T01:59:36.353137+0000","last_fullsized":"2024-09-17T01:59:36.353137+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351115+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:36.351115+0000","last_peered":"2024-09-17T01:59:36.351115+0000","last_clean":"2024-09-17T01:59:36.351115+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:36.351115+0000","last_undegraded":"2024-09-17T01:59:36.351115+0000","last_fullsized":"2024-09-17T01:59:36.351115+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":372,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819373+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:36.819373+0000","last_peered":"2024-09-17T01:59:36.819373+0000","last_clean":"2024-09-17T01:59:36.819373+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:36.819373+0000","last_undegraded":"2024-09-17T01:59:36.819373+0000","last_fullsized":"2024-09-17T01:59:36.819373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":710,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818262+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:36.818262+0000","last_peered":"2024-09-17T01:59:36.818262+0000","last_clean":"2024-09-17T01:59:36.818262+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:36.818262+0000","last_undegraded":"2024-09-17T01:59:36.818262+0000","last_fullsized":"2024-09-17T01:59:36.818262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819751+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:36.819751+0000","last_peered":"2024-09-17T01:59:36.819751+0000","last_clean":"2024-09-17T01:59:36.819751+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:36.819751+0000","last_undegraded":"2024-09-17T01:59:36.819751+0000","last_fullsized":"2024-09-17T01:59:36.819751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":612,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816934+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:36.816934+0000","last_peered":"2024-09-17T01:59:36.816934+0000","last_clean":"2024-09-17T01:59:36.816934+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:36.816934+0000","last_undegraded":"2024-09-17T01:59:36.816934+0000","last_fullsized":"2024-09-17T01:59:36.816934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":572,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822255+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:36.822255+0000","last_peered":"2024-09-17T01:59:36.822255+0000","last_clean":"2024-09-17T01:59:36.822255+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:36.822255+0000","last_undegraded":"2024-09-17T01:59:36.822255+0000","last_fullsized":"2024-09-17T01:59:36.822255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":100,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349769+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:36.349769+0000","last_peered":"2024-09-17T01:59:36.349769+0000","last_clean":"2024-09-17T01:59:36.349769+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:36.349769+0000","last_undegraded":"2024-09-17T01:59:36.349769+0000","last_fullsized":"2024-09-17T01:59:36.349769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":76,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350388+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:36.350388+0000","last_peered":"2024-09-17T01:59:36.350388+0000","last_clean":"2024-09-17T01:59:36.350388+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:36.350388+0000","last_undegraded":"2024-09-17T01:59:36.350388+0000","last_fullsized":"2024-09-17T01:59:36.350388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":617,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820680+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:36.820680+0000","last_peered":"2024-09-17T01:59:36.820680+0000","last_clean":"2024-09-17T01:59:36.820680+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:36.820680+0000","last_undegraded":"2024-09-17T01:59:36.820680+0000","last_fullsized":"2024-09-17T01:59:36.820680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352501+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:36.352501+0000","last_peered":"2024-09-17T01:59:36.352501+0000","last_clean":"2024-09-17T01:59:36.352501+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:36.352501+0000","last_undegraded":"2024-09-17T01:59:36.352501+0000","last_fullsized":"2024-09-17T01:59:36.352501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821149+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:36.821149+0000","last_peered":"2024-09-17T01:59:36.821149+0000","last_clean":"2024-09-17T01:59:36.821149+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:36.821149+0000","last_undegraded":"2024-09-17T01:59:36.821149+0000","last_fullsized":"2024-09-17T01:59:36.821149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":914,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818026+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:36.818026+0000","last_peered":"2024-09-17T01:59:36.818026+0000","last_clean":"2024-09-17T01:59:36.818026+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:36.818026+0000","last_undegraded":"2024-09-17T01:59:36.818026+0000","last_fullsized":"2024-09-17T01:59:36.818026+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820977+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:36.820977+0000","last_peered":"2024-09-17T01:59:36.820977+0000","last_clean":"2024-09-17T01:59:36.820977+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:36.820977+0000","last_undegraded":"2024-09-17T01:59:36.820977+0000","last_fullsized":"2024-09-17T01:59:36.820977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819260+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:36.819260+0000","last_peered":"2024-09-17T01:59:36.819260+0000","last_clean":"2024-09-17T01:59:36.819260+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:36.819260+0000","last_undegraded":"2024-09-17T01:59:36.819260+0000","last_fullsized":"2024-09-17T01:59:36.819260+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1007,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817156+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:36.817156+0000","last_peered":"2024-09-17T01:59:36.817156+0000","last_clean":"2024-09-17T01:59:36.817156+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:36.817156+0000","last_undegraded":"2024-09-17T01:59:36.817156+0000","last_fullsized":"2024-09-17T01:59:36.817156+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":230,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822911+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:36.822911+0000","last_peered":"2024-09-17T01:59:36.822911+0000","last_clean":"2024-09-17T01:59:36.822911+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:36.822911+0000","last_undegraded":"2024-09-17T01:59:36.822911+0000","last_fullsized":"2024-09-17T01:59:36.822911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822168+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:36.822168+0000","last_peered":"2024-09-17T01:59:36.822168+0000","last_clean":"2024-09-17T01:59:36.822168+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:36.822168+0000","last_undegraded":"2024-09-17T01:59:36.822168+0000","last_fullsized":"2024-09-17T01:59:36.822168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":981,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.826505+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:36.826505+0000","last_peered":"2024-09-17T01:59:36.826505+0000","last_clean":"2024-09-17T01:59:36.826505+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:36.826505+0000","last_undegraded":"2024-09-17T01:59:36.826505+0000","last_fullsized":"2024-09-17T01:59:36.826505+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":304,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822164+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:36.822164+0000","last_peered":"2024-09-17T01:59:36.822164+0000","last_clean":"2024-09-17T01:59:36.822164+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:36.822164+0000","last_undegraded":"2024-09-17T01:59:36.822164+0000","last_fullsized":"2024-09-17T01:59:36.822164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352912+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:36.352912+0000","last_peered":"2024-09-17T01:59:36.352912+0000","last_clean":"2024-09-17T01:59:36.352912+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:36.352912+0000","last_undegraded":"2024-09-17T01:59:36.352912+0000","last_fullsized":"2024-09-17T01:59:36.352912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1041,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816691+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:36.816691+0000","last_peered":"2024-09-17T01:59:36.816691+0000","last_clean":"2024-09-17T01:59:36.816691+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:36.816691+0000","last_undegraded":"2024-09-17T01:59:36.816691+0000","last_fullsized":"2024-09-17T01:59:36.816691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":608,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351946+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:36.351946+0000","last_peered":"2024-09-17T01:59:36.351946+0000","last_clean":"2024-09-17T01:59:36.351946+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:36.351946+0000","last_undegraded":"2024-09-17T01:59:36.351946+0000","last_fullsized":"2024-09-17T01:59:36.351946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":431,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351741+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:36.351741+0000","last_peered":"2024-09-17T01:59:36.351741+0000","last_clean":"2024-09-17T01:59:36.351741+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:36.351741+0000","last_undegraded":"2024-09-17T01:59:36.351741+0000","last_fullsized":"2024-09-17T01:59:36.351741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819093+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:36.819093+0000","last_peered":"2024-09-17T01:59:36.819093+0000","last_clean":"2024-09-17T01:59:36.819093+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:36.819093+0000","last_undegraded":"2024-09-17T01:59:36.819093+0000","last_fullsized":"2024-09-17T01:59:36.819093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":272,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819236+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:36.819236+0000","last_peered":"2024-09-17T01:59:36.819236+0000","last_clean":"2024-09-17T01:59:36.819236+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:36.819236+0000","last_undegraded":"2024-09-17T01:59:36.819236+0000","last_fullsized":"2024-09-17T01:59:36.819236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":325,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353080+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:36.353080+0000","last_peered":"2024-09-17T01:59:36.353080+0000","last_clean":"2024-09-17T01:59:36.353080+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:36.353080+0000","last_undegraded":"2024-09-17T01:59:36.353080+0000","last_fullsized":"2024-09-17T01:59:36.353080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1175,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819027+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:36.819027+0000","last_peered":"2024-09-17T01:59:36.819027+0000","last_clean":"2024-09-17T01:59:36.819027+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:36.819027+0000","last_undegraded":"2024-09-17T01:59:36.819027+0000","last_fullsized":"2024-09-17T01:59:36.819027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822757+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:36.822757+0000","last_peered":"2024-09-17T01:59:36.822757+0000","last_clean":"2024-09-17T01:59:36.822757+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:36.822757+0000","last_undegraded":"2024-09-17T01:59:36.822757+0000","last_fullsized":"2024-09-17T01:59:36.822757+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":693,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819188+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:36.819188+0000","last_peered":"2024-09-17T01:59:36.819188+0000","last_clean":"2024-09-17T01:59:36.819188+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:36.819188+0000","last_undegraded":"2024-09-17T01:59:36.819188+0000","last_fullsized":"2024-09-17T01:59:36.819188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":879,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818957+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:36.818957+0000","last_peered":"2024-09-17T01:59:36.818957+0000","last_clean":"2024-09-17T01:59:36.818957+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:36.818957+0000","last_undegraded":"2024-09-17T01:59:36.818957+0000","last_fullsized":"2024-09-17T01:59:36.818957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":804,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820414+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:36.820414+0000","last_peered":"2024-09-17T01:59:36.820414+0000","last_clean":"2024-09-17T01:59:36.820414+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:36.820414+0000","last_undegraded":"2024-09-17T01:59:36.820414+0000","last_fullsized":"2024-09-17T01:59:36.820414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":962,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821451+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:36.821451+0000","last_peered":"2024-09-17T01:59:36.821451+0000","last_clean":"2024-09-17T01:59:36.821451+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:36.821451+0000","last_undegraded":"2024-09-17T01:59:36.821451+0000","last_fullsized":"2024-09-17T01:59:36.821451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":392,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819462+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:36.819462+0000","last_peered":"2024-09-17T01:59:36.819462+0000","last_clean":"2024-09-17T01:59:36.819462+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:36.819462+0000","last_undegraded":"2024-09-17T01:59:36.819462+0000","last_fullsized":"2024-09-17T01:59:36.819462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":934,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818543+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:36.818543+0000","last_peered":"2024-09-17T01:59:36.818543+0000","last_clean":"2024-09-17T01:59:36.818543+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:36.818543+0000","last_undegraded":"2024-09-17T01:59:36.818543+0000","last_fullsized":"2024-09-17T01:59:36.818543+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":449,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818428+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:36.818428+0000","last_peered":"2024-09-17T01:59:36.818428+0000","last_clean":"2024-09-17T01:59:36.818428+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:36.818428+0000","last_undegraded":"2024-09-17T01:59:36.818428+0000","last_fullsized":"2024-09-17T01:59:36.818428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":589,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817680+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:36.817680+0000","last_peered":"2024-09-17T01:59:36.817680+0000","last_clean":"2024-09-17T01:59:36.817680+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:36.817680+0000","last_undegraded":"2024-09-17T01:59:36.817680+0000","last_fullsized":"2024-09-17T01:59:36.817680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":238,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817461+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:36.817461+0000","last_peered":"2024-09-17T01:59:36.817461+0000","last_clean":"2024-09-17T01:59:36.817461+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:36.817461+0000","last_undegraded":"2024-09-17T01:59:36.817461+0000","last_fullsized":"2024-09-17T01:59:36.817461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":629,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351722+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:36.351722+0000","last_peered":"2024-09-17T01:59:36.351722+0000","last_clean":"2024-09-17T01:59:36.351722+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:36.351722+0000","last_undegraded":"2024-09-17T01:59:36.351722+0000","last_fullsized":"2024-09-17T01:59:36.351722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":294,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351760+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:36.351760+0000","last_peered":"2024-09-17T01:59:36.351760+0000","last_clean":"2024-09-17T01:59:36.351760+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:36.351760+0000","last_undegraded":"2024-09-17T01:59:36.351760+0000","last_fullsized":"2024-09-17T01:59:36.351760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":549,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350527+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:36.350527+0000","last_peered":"2024-09-17T01:59:36.350527+0000","last_clean":"2024-09-17T01:59:36.350527+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:36.350527+0000","last_undegraded":"2024-09-17T01:59:36.350527+0000","last_fullsized":"2024-09-17T01:59:36.350527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":463,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818864+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:36.818864+0000","last_peered":"2024-09-17T01:59:36.818864+0000","last_clean":"2024-09-17T01:59:36.818864+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:36.818864+0000","last_undegraded":"2024-09-17T01:59:36.818864+0000","last_fullsized":"2024-09-17T01:59:36.818864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":685,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817467+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:36.817467+0000","last_peered":"2024-09-17T01:59:36.817467+0000","last_clean":"2024-09-17T01:59:36.817467+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:36.817467+0000","last_undegraded":"2024-09-17T01:59:36.817467+0000","last_fullsized":"2024-09-17T01:59:36.817467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":219,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821880+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:36.821880+0000","last_peered":"2024-09-17T01:59:36.821880+0000","last_clean":"2024-09-17T01:59:36.821880+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:36.821880+0000","last_undegraded":"2024-09-17T01:59:36.821880+0000","last_fullsized":"2024-09-17T01:59:36.821880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":675,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351286+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:36.351286+0000","last_peered":"2024-09-17T01:59:36.351286+0000","last_clean":"2024-09-17T01:59:36.351286+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:36.351286+0000","last_undegraded":"2024-09-17T01:59:36.351286+0000","last_fullsized":"2024-09-17T01:59:36.351286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":247,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822343+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:36.822343+0000","last_peered":"2024-09-17T01:59:36.822343+0000","last_clean":"2024-09-17T01:59:36.822343+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:36.822343+0000","last_undegraded":"2024-09-17T01:59:36.822343+0000","last_fullsized":"2024-09-17T01:59:36.822343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7009,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1527808,"data_stored":1491260,"data_compressed":181691,"data_compressed_allocated":237568,"data_compressed_original":811008,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":125,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678024,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52184,"kb_used_data":14908,"kb_used_omap":174,"kb_used_meta":37073,"kb_avail":94319656,"statfs":{"total":96636764160,"available":96583327744,"internally_reserved":0,"allocated":15265792,"data_stored":101244355,"data_compressed":8306248,"data_compressed_allocated":12034048,"data_compressed_original":99508224,"omap_allocated":179054,"internal_metadata":37962898},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95276,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276564,"statfs":{"total":96636764160,"available":96539201536,"internally_reserved":0,"allocated":24469504,"data_stored":85043842,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91912,"kb_used_data":20528,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279928,"statfs":{"total":96636764160,"available":96542646272,"internally_reserved":0,"allocated":21020672,"data_stored":73205498,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1527808,"data_stored":1491260,"data_compressed":181691,"data_compressed_allocated":237568,"data_compressed_original":811008,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:40.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:59:40.890 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:40.890 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 187/114 objects degraded (164.035%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":319,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":103,"num_osds":3,"num_up_osds":3,"osd_up_since":1726538347,"num_in_osds":3,"osd_in_since":1726538063,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":102},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":57,"data_bytes":128027436,"bytes_used":245116928,"bytes_avail":289665175552,"bytes_total":289910292480,"degraded_objects":187,"degraded_total":114,"degraded_ratio":1.6403508771929824,"recovering_objects_per_sec":353,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1510,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T01:55:53.990553+0000","services":{}},"progress_events":{}} 2024-09-17T01:59:40.910 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-17T01:59:40.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:41.224 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:41.242 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-09-17T01:59:40.098400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7031,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":207,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":239372,"kb_used_data":59332,"kb_used_omap":177,"kb_used_meta":179790,"kb_avail":282876148,"statfs":{"total":289910292480,"available":289665175552,"internally_reserved":0,"allocated":60755968,"data_stored":259493695,"data_compressed":19966327,"data_compressed_allocated":32468992,"data_compressed_original":233771008,"omap_allocated":182244,"internal_metadata":184104988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1230,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1510,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.275024"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":669,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818668+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:36.818668+0000","last_peered":"2024-09-17T01:59:36.818668+0000","last_clean":"2024-09-17T01:59:36.818668+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:36.818668+0000","last_undegraded":"2024-09-17T01:59:36.818668+0000","last_fullsized":"2024-09-17T01:59:36.818668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":662,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817892+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:36.817892+0000","last_peered":"2024-09-17T01:59:36.817892+0000","last_clean":"2024-09-17T01:59:36.817892+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:36.817892+0000","last_undegraded":"2024-09-17T01:59:36.817892+0000","last_fullsized":"2024-09-17T01:59:36.817892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":516,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354712+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:36.354712+0000","last_peered":"2024-09-17T01:59:36.354712+0000","last_clean":"2024-09-17T01:59:36.354712+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:36.354712+0000","last_undegraded":"2024-09-17T01:59:36.354712+0000","last_fullsized":"2024-09-17T01:59:36.354712+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":562,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352061+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:36.352061+0000","last_peered":"2024-09-17T01:59:36.352061+0000","last_clean":"2024-09-17T01:59:36.352061+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:36.352061+0000","last_undegraded":"2024-09-17T01:59:36.352061+0000","last_fullsized":"2024-09-17T01:59:36.352061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817369+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:36.817369+0000","last_peered":"2024-09-17T01:59:36.817369+0000","last_clean":"2024-09-17T01:59:36.817369+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:36.817369+0000","last_undegraded":"2024-09-17T01:59:36.817369+0000","last_fullsized":"2024-09-17T01:59:36.817369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":573,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350941+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:36.350941+0000","last_peered":"2024-09-17T01:59:36.350941+0000","last_clean":"2024-09-17T01:59:36.350941+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:36.350941+0000","last_undegraded":"2024-09-17T01:59:36.350941+0000","last_fullsized":"2024-09-17T01:59:36.350941+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":685,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350572+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:36.350572+0000","last_peered":"2024-09-17T01:59:36.350572+0000","last_clean":"2024-09-17T01:59:36.350572+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:36.350572+0000","last_undegraded":"2024-09-17T01:59:36.350572+0000","last_fullsized":"2024-09-17T01:59:36.350572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":526,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.358770+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:36.358770+0000","last_peered":"2024-09-17T01:59:36.358770+0000","last_clean":"2024-09-17T01:59:36.358770+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:36.358770+0000","last_undegraded":"2024-09-17T01:59:36.358770+0000","last_fullsized":"2024-09-17T01:59:36.358770+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":627,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821832+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:36.821832+0000","last_peered":"2024-09-17T01:59:36.821832+0000","last_clean":"2024-09-17T01:59:36.821832+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:36.821832+0000","last_undegraded":"2024-09-17T01:59:36.821832+0000","last_fullsized":"2024-09-17T01:59:36.821832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":593,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818049+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:36.818049+0000","last_peered":"2024-09-17T01:59:36.818049+0000","last_clean":"2024-09-17T01:59:36.818049+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:36.818049+0000","last_undegraded":"2024-09-17T01:59:36.818049+0000","last_fullsized":"2024-09-17T01:59:36.818049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":533,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354348+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:36.354348+0000","last_peered":"2024-09-17T01:59:36.354348+0000","last_clean":"2024-09-17T01:59:36.354348+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:36.354348+0000","last_undegraded":"2024-09-17T01:59:36.354348+0000","last_fullsized":"2024-09-17T01:59:36.354348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":876,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817619+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:36.817619+0000","last_peered":"2024-09-17T01:59:36.817619+0000","last_clean":"2024-09-17T01:59:36.817619+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:36.817619+0000","last_undegraded":"2024-09-17T01:59:36.817619+0000","last_fullsized":"2024-09-17T01:59:36.817619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":569,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817226+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:36.817226+0000","last_peered":"2024-09-17T01:59:36.817226+0000","last_clean":"2024-09-17T01:59:36.817226+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:36.817226+0000","last_undegraded":"2024-09-17T01:59:36.817226+0000","last_fullsized":"2024-09-17T01:59:36.817226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":638,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350020+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:36.350020+0000","last_peered":"2024-09-17T01:59:36.350020+0000","last_clean":"2024-09-17T01:59:36.350020+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:36.350020+0000","last_undegraded":"2024-09-17T01:59:36.350020+0000","last_fullsized":"2024-09-17T01:59:36.350020+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":587,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350449+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:36.350449+0000","last_peered":"2024-09-17T01:59:36.350449+0000","last_clean":"2024-09-17T01:59:36.350449+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:36.350449+0000","last_undegraded":"2024-09-17T01:59:36.350449+0000","last_fullsized":"2024-09-17T01:59:36.350449+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":680,"reported_epoch":96,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-17T01:59:31.818981+0000","last_change":"2024-09-17T01:59:09.362423+0000","last_active":"2024-09-17T01:59:31.818981+0000","last_peered":"2024-09-17T01:59:31.818981+0000","last_clean":"2024-09-17T01:56:18.960990+0000","last_became_active":"2024-09-17T01:59:09.357395+0000","last_became_peered":"2024-09-17T01:59:09.357395+0000","last_unstale":"2024-09-17T01:59:31.818981+0000","last_undegraded":"2024-09-17T01:59:09.241030+0000","last_fullsized":"2024-09-17T01:59:09.225709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":590,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822811+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:36.822811+0000","last_peered":"2024-09-17T01:59:36.822811+0000","last_clean":"2024-09-17T01:59:36.822811+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:36.822811+0000","last_undegraded":"2024-09-17T01:59:36.822811+0000","last_fullsized":"2024-09-17T01:59:36.822811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":619,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818441+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:36.818441+0000","last_peered":"2024-09-17T01:59:36.818441+0000","last_clean":"2024-09-17T01:59:36.818441+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:36.818441+0000","last_undegraded":"2024-09-17T01:59:36.818441+0000","last_fullsized":"2024-09-17T01:59:36.818441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":674,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821263+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:36.821263+0000","last_peered":"2024-09-17T01:59:36.821263+0000","last_clean":"2024-09-17T01:59:36.821263+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:36.821263+0000","last_undegraded":"2024-09-17T01:59:36.821263+0000","last_fullsized":"2024-09-17T01:59:36.821263+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":687,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352538+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:36.352538+0000","last_peered":"2024-09-17T01:59:36.352538+0000","last_clean":"2024-09-17T01:59:36.352538+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:36.352538+0000","last_undegraded":"2024-09-17T01:59:36.352538+0000","last_fullsized":"2024-09-17T01:59:36.352538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":553,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352128+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:36.352128+0000","last_peered":"2024-09-17T01:59:36.352128+0000","last_clean":"2024-09-17T01:59:36.352128+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:36.352128+0000","last_undegraded":"2024-09-17T01:59:36.352128+0000","last_fullsized":"2024-09-17T01:59:36.352128+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1173,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817696+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:36.817696+0000","last_peered":"2024-09-17T01:59:36.817696+0000","last_clean":"2024-09-17T01:59:36.817696+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:36.817696+0000","last_undegraded":"2024-09-17T01:59:36.817696+0000","last_fullsized":"2024-09-17T01:59:36.817696+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1073,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818662+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:36.818662+0000","last_peered":"2024-09-17T01:59:36.818662+0000","last_clean":"2024-09-17T01:59:36.818662+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:36.818662+0000","last_undegraded":"2024-09-17T01:59:36.818662+0000","last_fullsized":"2024-09-17T01:59:36.818662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816467+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:36.816467+0000","last_peered":"2024-09-17T01:59:36.816467+0000","last_clean":"2024-09-17T01:59:36.816467+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:36.816467+0000","last_undegraded":"2024-09-17T01:59:36.816467+0000","last_fullsized":"2024-09-17T01:59:36.816467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1016,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818802+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:36.818802+0000","last_peered":"2024-09-17T01:59:36.818802+0000","last_clean":"2024-09-17T01:59:36.818802+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:36.818802+0000","last_undegraded":"2024-09-17T01:59:36.818802+0000","last_fullsized":"2024-09-17T01:59:36.818802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1096,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821510+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:36.821510+0000","last_peered":"2024-09-17T01:59:36.821510+0000","last_clean":"2024-09-17T01:59:36.821510+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:36.821510+0000","last_undegraded":"2024-09-17T01:59:36.821510+0000","last_fullsized":"2024-09-17T01:59:36.821510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":559,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.368477+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:36.368477+0000","last_peered":"2024-09-17T01:59:36.368477+0000","last_clean":"2024-09-17T01:59:36.368477+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:36.368477+0000","last_undegraded":"2024-09-17T01:59:36.368477+0000","last_fullsized":"2024-09-17T01:59:36.368477+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":965,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818036+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:36.818036+0000","last_peered":"2024-09-17T01:59:36.818036+0000","last_clean":"2024-09-17T01:59:36.818036+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:36.818036+0000","last_undegraded":"2024-09-17T01:59:36.818036+0000","last_fullsized":"2024-09-17T01:59:36.818036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":614,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820265+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:36.820265+0000","last_peered":"2024-09-17T01:59:36.820265+0000","last_clean":"2024-09-17T01:59:36.820265+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:36.820265+0000","last_undegraded":"2024-09-17T01:59:36.820265+0000","last_fullsized":"2024-09-17T01:59:36.820265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1055,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818865+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:36.818865+0000","last_peered":"2024-09-17T01:59:36.818865+0000","last_clean":"2024-09-17T01:59:36.818865+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:36.818865+0000","last_undegraded":"2024-09-17T01:59:36.818865+0000","last_fullsized":"2024-09-17T01:59:36.818865+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":675,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818826+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:36.818826+0000","last_peered":"2024-09-17T01:59:36.818826+0000","last_clean":"2024-09-17T01:59:36.818826+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:36.818826+0000","last_undegraded":"2024-09-17T01:59:36.818826+0000","last_fullsized":"2024-09-17T01:59:36.818826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":683,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349797+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:36.349797+0000","last_peered":"2024-09-17T01:59:36.349797+0000","last_clean":"2024-09-17T01:59:36.349797+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:36.349797+0000","last_undegraded":"2024-09-17T01:59:36.349797+0000","last_fullsized":"2024-09-17T01:59:36.349797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":642,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817855+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:36.817855+0000","last_peered":"2024-09-17T01:59:36.817855+0000","last_clean":"2024-09-17T01:59:36.817855+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:36.817855+0000","last_undegraded":"2024-09-17T01:59:36.817855+0000","last_fullsized":"2024-09-17T01:59:36.817855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":576,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351472+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:36.351472+0000","last_peered":"2024-09-17T01:59:36.351472+0000","last_clean":"2024-09-17T01:59:36.351472+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:36.351472+0000","last_undegraded":"2024-09-17T01:59:36.351472+0000","last_fullsized":"2024-09-17T01:59:36.351472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":664,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818740+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:36.818740+0000","last_peered":"2024-09-17T01:59:36.818740+0000","last_clean":"2024-09-17T01:59:36.818740+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:36.818740+0000","last_undegraded":"2024-09-17T01:59:36.818740+0000","last_fullsized":"2024-09-17T01:59:36.818740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":239,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819407+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:36.819407+0000","last_peered":"2024-09-17T01:59:36.819407+0000","last_clean":"2024-09-17T01:59:36.819407+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:36.819407+0000","last_undegraded":"2024-09-17T01:59:36.819407+0000","last_fullsized":"2024-09-17T01:59:36.819407+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1084,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822041+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:36.822041+0000","last_peered":"2024-09-17T01:59:36.822041+0000","last_clean":"2024-09-17T01:59:36.822041+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:36.822041+0000","last_undegraded":"2024-09-17T01:59:36.822041+0000","last_fullsized":"2024-09-17T01:59:36.822041+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":264,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817037+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:36.817037+0000","last_peered":"2024-09-17T01:59:36.817037+0000","last_clean":"2024-09-17T01:59:36.817037+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:36.817037+0000","last_undegraded":"2024-09-17T01:59:36.817037+0000","last_fullsized":"2024-09-17T01:59:36.817037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":787,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-17T01:59:37.132245+0000","last_change":"2024-09-17T01:59:36.864741+0000","last_active":"2024-09-17T01:59:37.132245+0000","last_peered":"2024-09-17T01:59:37.132245+0000","last_clean":"2024-09-17T01:56:19.280818+0000","last_became_active":"2024-09-17T01:59:09.325919+0000","last_became_peered":"2024-09-17T01:59:09.325919+0000","last_unstale":"2024-09-17T01:59:37.132245+0000","last_undegraded":"2024-09-17T01:59:37.132245+0000","last_fullsized":"2024-09-17T01:59:09.223193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":86,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349652+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:36.349652+0000","last_peered":"2024-09-17T01:59:36.349652+0000","last_clean":"2024-09-17T01:59:36.349652+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:36.349652+0000","last_undegraded":"2024-09-17T01:59:36.349652+0000","last_fullsized":"2024-09-17T01:59:36.349652+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":256,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353263+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:36.353263+0000","last_peered":"2024-09-17T01:59:36.353263+0000","last_clean":"2024-09-17T01:59:36.353263+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:36.353263+0000","last_undegraded":"2024-09-17T01:59:36.353263+0000","last_fullsized":"2024-09-17T01:59:36.353263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":989,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816599+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:36.816599+0000","last_peered":"2024-09-17T01:59:36.816599+0000","last_clean":"2024-09-17T01:59:36.816599+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:36.816599+0000","last_undegraded":"2024-09-17T01:59:36.816599+0000","last_fullsized":"2024-09-17T01:59:36.816599+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":456,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818582+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:36.818582+0000","last_peered":"2024-09-17T01:59:36.818582+0000","last_clean":"2024-09-17T01:59:36.818582+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:36.818582+0000","last_undegraded":"2024-09-17T01:59:36.818582+0000","last_fullsized":"2024-09-17T01:59:36.818582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":649,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816684+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:36.816684+0000","last_peered":"2024-09-17T01:59:36.816684+0000","last_clean":"2024-09-17T01:59:36.816684+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:36.816684+0000","last_undegraded":"2024-09-17T01:59:36.816684+0000","last_fullsized":"2024-09-17T01:59:36.816684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":683,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352856+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:36.352856+0000","last_peered":"2024-09-17T01:59:36.352856+0000","last_clean":"2024-09-17T01:59:36.352856+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:36.352856+0000","last_undegraded":"2024-09-17T01:59:36.352856+0000","last_fullsized":"2024-09-17T01:59:36.352856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":1072,"reported_epoch":101,"state":"active+undersized+remapped","last_fresh":"2024-09-17T01:59:36.859671+0000","last_change":"2024-09-17T01:59:36.860115+0000","last_active":"2024-09-17T01:59:36.859671+0000","last_peered":"2024-09-17T01:59:36.859671+0000","last_clean":"2024-09-17T01:56:19.068168+0000","last_became_active":"2024-09-17T01:59:09.358949+0000","last_became_peered":"2024-09-17T01:59:09.358949+0000","last_unstale":"2024-09-17T01:59:36.859671+0000","last_undegraded":"2024-09-17T01:59:36.859671+0000","last_fullsized":"2024-09-17T01:59:09.237884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":76,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352165+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:36.352165+0000","last_peered":"2024-09-17T01:59:36.352165+0000","last_clean":"2024-09-17T01:59:36.352165+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:36.352165+0000","last_undegraded":"2024-09-17T01:59:36.352165+0000","last_fullsized":"2024-09-17T01:59:36.352165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1005,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819766+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:36.819766+0000","last_peered":"2024-09-17T01:59:36.819766+0000","last_clean":"2024-09-17T01:59:36.819766+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:36.819766+0000","last_undegraded":"2024-09-17T01:59:36.819766+0000","last_fullsized":"2024-09-17T01:59:36.819766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":348,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820978+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:36.820978+0000","last_peered":"2024-09-17T01:59:36.820978+0000","last_clean":"2024-09-17T01:59:36.820978+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:36.820978+0000","last_undegraded":"2024-09-17T01:59:36.820978+0000","last_fullsized":"2024-09-17T01:59:36.820978+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":637,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352764+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:36.352764+0000","last_peered":"2024-09-17T01:59:36.352764+0000","last_clean":"2024-09-17T01:59:36.352764+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:36.352764+0000","last_undegraded":"2024-09-17T01:59:36.352764+0000","last_fullsized":"2024-09-17T01:59:36.352764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":233,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350244+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:36.350244+0000","last_peered":"2024-09-17T01:59:36.350244+0000","last_clean":"2024-09-17T01:59:36.350244+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:36.350244+0000","last_undegraded":"2024-09-17T01:59:36.350244+0000","last_fullsized":"2024-09-17T01:59:36.350244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":670,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.354610+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:36.354610+0000","last_peered":"2024-09-17T01:59:36.354610+0000","last_clean":"2024-09-17T01:59:36.354610+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:36.354610+0000","last_undegraded":"2024-09-17T01:59:36.354610+0000","last_fullsized":"2024-09-17T01:59:36.354610+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817329+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:36.817329+0000","last_peered":"2024-09-17T01:59:36.817329+0000","last_clean":"2024-09-17T01:59:36.817329+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:36.817329+0000","last_undegraded":"2024-09-17T01:59:36.817329+0000","last_fullsized":"2024-09-17T01:59:36.817329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":572,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353296+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:36.353296+0000","last_peered":"2024-09-17T01:59:36.353296+0000","last_clean":"2024-09-17T01:59:36.353296+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:36.353296+0000","last_undegraded":"2024-09-17T01:59:36.353296+0000","last_fullsized":"2024-09-17T01:59:36.353296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":632,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816712+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:36.816712+0000","last_peered":"2024-09-17T01:59:36.816712+0000","last_clean":"2024-09-17T01:59:36.816712+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:36.816712+0000","last_undegraded":"2024-09-17T01:59:36.816712+0000","last_fullsized":"2024-09-17T01:59:36.816712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":609,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821969+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:36.821969+0000","last_peered":"2024-09-17T01:59:36.821969+0000","last_clean":"2024-09-17T01:59:36.821969+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:36.821969+0000","last_undegraded":"2024-09-17T01:59:36.821969+0000","last_fullsized":"2024-09-17T01:59:36.821969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":275,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349326+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:36.349326+0000","last_peered":"2024-09-17T01:59:36.349326+0000","last_clean":"2024-09-17T01:59:36.349326+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:36.349326+0000","last_undegraded":"2024-09-17T01:59:36.349326+0000","last_fullsized":"2024-09-17T01:59:36.349326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349991+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:36.349991+0000","last_peered":"2024-09-17T01:59:36.349991+0000","last_clean":"2024-09-17T01:59:36.349991+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:36.349991+0000","last_undegraded":"2024-09-17T01:59:36.349991+0000","last_fullsized":"2024-09-17T01:59:36.349991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":520,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351033+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:36.351033+0000","last_peered":"2024-09-17T01:59:36.351033+0000","last_clean":"2024-09-17T01:59:36.351033+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:36.351033+0000","last_undegraded":"2024-09-17T01:59:36.351033+0000","last_fullsized":"2024-09-17T01:59:36.351033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":595,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353137+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:36.353137+0000","last_peered":"2024-09-17T01:59:36.353137+0000","last_clean":"2024-09-17T01:59:36.353137+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:36.353137+0000","last_undegraded":"2024-09-17T01:59:36.353137+0000","last_fullsized":"2024-09-17T01:59:36.353137+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351115+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:36.351115+0000","last_peered":"2024-09-17T01:59:36.351115+0000","last_clean":"2024-09-17T01:59:36.351115+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:36.351115+0000","last_undegraded":"2024-09-17T01:59:36.351115+0000","last_fullsized":"2024-09-17T01:59:36.351115+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":372,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819373+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:36.819373+0000","last_peered":"2024-09-17T01:59:36.819373+0000","last_clean":"2024-09-17T01:59:36.819373+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:36.819373+0000","last_undegraded":"2024-09-17T01:59:36.819373+0000","last_fullsized":"2024-09-17T01:59:36.819373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":710,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818262+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:36.818262+0000","last_peered":"2024-09-17T01:59:36.818262+0000","last_clean":"2024-09-17T01:59:36.818262+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:36.818262+0000","last_undegraded":"2024-09-17T01:59:36.818262+0000","last_fullsized":"2024-09-17T01:59:36.818262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819751+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:36.819751+0000","last_peered":"2024-09-17T01:59:36.819751+0000","last_clean":"2024-09-17T01:59:36.819751+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:36.819751+0000","last_undegraded":"2024-09-17T01:59:36.819751+0000","last_fullsized":"2024-09-17T01:59:36.819751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":612,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816934+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:36.816934+0000","last_peered":"2024-09-17T01:59:36.816934+0000","last_clean":"2024-09-17T01:59:36.816934+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:36.816934+0000","last_undegraded":"2024-09-17T01:59:36.816934+0000","last_fullsized":"2024-09-17T01:59:36.816934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":572,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822255+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:36.822255+0000","last_peered":"2024-09-17T01:59:36.822255+0000","last_clean":"2024-09-17T01:59:36.822255+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:36.822255+0000","last_undegraded":"2024-09-17T01:59:36.822255+0000","last_fullsized":"2024-09-17T01:59:36.822255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":100,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.349769+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:36.349769+0000","last_peered":"2024-09-17T01:59:36.349769+0000","last_clean":"2024-09-17T01:59:36.349769+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:36.349769+0000","last_undegraded":"2024-09-17T01:59:36.349769+0000","last_fullsized":"2024-09-17T01:59:36.349769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":76,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350388+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:36.350388+0000","last_peered":"2024-09-17T01:59:36.350388+0000","last_clean":"2024-09-17T01:59:36.350388+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:36.350388+0000","last_undegraded":"2024-09-17T01:59:36.350388+0000","last_fullsized":"2024-09-17T01:59:36.350388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":617,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820680+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:36.820680+0000","last_peered":"2024-09-17T01:59:36.820680+0000","last_clean":"2024-09-17T01:59:36.820680+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:36.820680+0000","last_undegraded":"2024-09-17T01:59:36.820680+0000","last_fullsized":"2024-09-17T01:59:36.820680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352501+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:36.352501+0000","last_peered":"2024-09-17T01:59:36.352501+0000","last_clean":"2024-09-17T01:59:36.352501+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:36.352501+0000","last_undegraded":"2024-09-17T01:59:36.352501+0000","last_fullsized":"2024-09-17T01:59:36.352501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821149+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:36.821149+0000","last_peered":"2024-09-17T01:59:36.821149+0000","last_clean":"2024-09-17T01:59:36.821149+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:36.821149+0000","last_undegraded":"2024-09-17T01:59:36.821149+0000","last_fullsized":"2024-09-17T01:59:36.821149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":914,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818026+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:36.818026+0000","last_peered":"2024-09-17T01:59:36.818026+0000","last_clean":"2024-09-17T01:59:36.818026+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:36.818026+0000","last_undegraded":"2024-09-17T01:59:36.818026+0000","last_fullsized":"2024-09-17T01:59:36.818026+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820977+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:36.820977+0000","last_peered":"2024-09-17T01:59:36.820977+0000","last_clean":"2024-09-17T01:59:36.820977+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:36.820977+0000","last_undegraded":"2024-09-17T01:59:36.820977+0000","last_fullsized":"2024-09-17T01:59:36.820977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819260+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:36.819260+0000","last_peered":"2024-09-17T01:59:36.819260+0000","last_clean":"2024-09-17T01:59:36.819260+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:36.819260+0000","last_undegraded":"2024-09-17T01:59:36.819260+0000","last_fullsized":"2024-09-17T01:59:36.819260+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1007,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817156+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:36.817156+0000","last_peered":"2024-09-17T01:59:36.817156+0000","last_clean":"2024-09-17T01:59:36.817156+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:36.817156+0000","last_undegraded":"2024-09-17T01:59:36.817156+0000","last_fullsized":"2024-09-17T01:59:36.817156+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":230,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822911+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:36.822911+0000","last_peered":"2024-09-17T01:59:36.822911+0000","last_clean":"2024-09-17T01:59:36.822911+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:36.822911+0000","last_undegraded":"2024-09-17T01:59:36.822911+0000","last_fullsized":"2024-09-17T01:59:36.822911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":192,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822168+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:36.822168+0000","last_peered":"2024-09-17T01:59:36.822168+0000","last_clean":"2024-09-17T01:59:36.822168+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:36.822168+0000","last_undegraded":"2024-09-17T01:59:36.822168+0000","last_fullsized":"2024-09-17T01:59:36.822168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":981,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.826505+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:36.826505+0000","last_peered":"2024-09-17T01:59:36.826505+0000","last_clean":"2024-09-17T01:59:36.826505+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:36.826505+0000","last_undegraded":"2024-09-17T01:59:36.826505+0000","last_fullsized":"2024-09-17T01:59:36.826505+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":304,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822164+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:36.822164+0000","last_peered":"2024-09-17T01:59:36.822164+0000","last_clean":"2024-09-17T01:59:36.822164+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:36.822164+0000","last_undegraded":"2024-09-17T01:59:36.822164+0000","last_fullsized":"2024-09-17T01:59:36.822164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.352912+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:36.352912+0000","last_peered":"2024-09-17T01:59:36.352912+0000","last_clean":"2024-09-17T01:59:36.352912+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:36.352912+0000","last_undegraded":"2024-09-17T01:59:36.352912+0000","last_fullsized":"2024-09-17T01:59:36.352912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1041,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.816691+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:36.816691+0000","last_peered":"2024-09-17T01:59:36.816691+0000","last_clean":"2024-09-17T01:59:36.816691+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:36.816691+0000","last_undegraded":"2024-09-17T01:59:36.816691+0000","last_fullsized":"2024-09-17T01:59:36.816691+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":608,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351946+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:36.351946+0000","last_peered":"2024-09-17T01:59:36.351946+0000","last_clean":"2024-09-17T01:59:36.351946+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:36.351946+0000","last_undegraded":"2024-09-17T01:59:36.351946+0000","last_fullsized":"2024-09-17T01:59:36.351946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":431,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351741+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:36.351741+0000","last_peered":"2024-09-17T01:59:36.351741+0000","last_clean":"2024-09-17T01:59:36.351741+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:36.351741+0000","last_undegraded":"2024-09-17T01:59:36.351741+0000","last_fullsized":"2024-09-17T01:59:36.351741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":666,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819093+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:36.819093+0000","last_peered":"2024-09-17T01:59:36.819093+0000","last_clean":"2024-09-17T01:59:36.819093+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:36.819093+0000","last_undegraded":"2024-09-17T01:59:36.819093+0000","last_fullsized":"2024-09-17T01:59:36.819093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":272,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819236+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:36.819236+0000","last_peered":"2024-09-17T01:59:36.819236+0000","last_clean":"2024-09-17T01:59:36.819236+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:36.819236+0000","last_undegraded":"2024-09-17T01:59:36.819236+0000","last_fullsized":"2024-09-17T01:59:36.819236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":325,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.353080+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:36.353080+0000","last_peered":"2024-09-17T01:59:36.353080+0000","last_clean":"2024-09-17T01:59:36.353080+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:36.353080+0000","last_undegraded":"2024-09-17T01:59:36.353080+0000","last_fullsized":"2024-09-17T01:59:36.353080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1175,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819027+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:36.819027+0000","last_peered":"2024-09-17T01:59:36.819027+0000","last_clean":"2024-09-17T01:59:36.819027+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:36.819027+0000","last_undegraded":"2024-09-17T01:59:36.819027+0000","last_fullsized":"2024-09-17T01:59:36.819027+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822757+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:36.822757+0000","last_peered":"2024-09-17T01:59:36.822757+0000","last_clean":"2024-09-17T01:59:36.822757+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:36.822757+0000","last_undegraded":"2024-09-17T01:59:36.822757+0000","last_fullsized":"2024-09-17T01:59:36.822757+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":693,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819188+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:36.819188+0000","last_peered":"2024-09-17T01:59:36.819188+0000","last_clean":"2024-09-17T01:59:36.819188+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:36.819188+0000","last_undegraded":"2024-09-17T01:59:36.819188+0000","last_fullsized":"2024-09-17T01:59:36.819188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":879,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818957+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:36.818957+0000","last_peered":"2024-09-17T01:59:36.818957+0000","last_clean":"2024-09-17T01:59:36.818957+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:36.818957+0000","last_undegraded":"2024-09-17T01:59:36.818957+0000","last_fullsized":"2024-09-17T01:59:36.818957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":804,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.820414+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:36.820414+0000","last_peered":"2024-09-17T01:59:36.820414+0000","last_clean":"2024-09-17T01:59:36.820414+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:36.820414+0000","last_undegraded":"2024-09-17T01:59:36.820414+0000","last_fullsized":"2024-09-17T01:59:36.820414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":962,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821451+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:36.821451+0000","last_peered":"2024-09-17T01:59:36.821451+0000","last_clean":"2024-09-17T01:59:36.821451+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:36.821451+0000","last_undegraded":"2024-09-17T01:59:36.821451+0000","last_fullsized":"2024-09-17T01:59:36.821451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":392,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.819462+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:36.819462+0000","last_peered":"2024-09-17T01:59:36.819462+0000","last_clean":"2024-09-17T01:59:36.819462+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:36.819462+0000","last_undegraded":"2024-09-17T01:59:36.819462+0000","last_fullsized":"2024-09-17T01:59:36.819462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":934,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818543+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:36.818543+0000","last_peered":"2024-09-17T01:59:36.818543+0000","last_clean":"2024-09-17T01:59:36.818543+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:36.818543+0000","last_undegraded":"2024-09-17T01:59:36.818543+0000","last_fullsized":"2024-09-17T01:59:36.818543+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":449,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818428+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:36.818428+0000","last_peered":"2024-09-17T01:59:36.818428+0000","last_clean":"2024-09-17T01:59:36.818428+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:36.818428+0000","last_undegraded":"2024-09-17T01:59:36.818428+0000","last_fullsized":"2024-09-17T01:59:36.818428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":589,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817680+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:36.817680+0000","last_peered":"2024-09-17T01:59:36.817680+0000","last_clean":"2024-09-17T01:59:36.817680+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:36.817680+0000","last_undegraded":"2024-09-17T01:59:36.817680+0000","last_fullsized":"2024-09-17T01:59:36.817680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":238,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817461+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:36.817461+0000","last_peered":"2024-09-17T01:59:36.817461+0000","last_clean":"2024-09-17T01:59:36.817461+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:36.817461+0000","last_undegraded":"2024-09-17T01:59:36.817461+0000","last_fullsized":"2024-09-17T01:59:36.817461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":629,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351722+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:36.351722+0000","last_peered":"2024-09-17T01:59:36.351722+0000","last_clean":"2024-09-17T01:59:36.351722+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:36.351722+0000","last_undegraded":"2024-09-17T01:59:36.351722+0000","last_fullsized":"2024-09-17T01:59:36.351722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":294,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351760+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:36.351760+0000","last_peered":"2024-09-17T01:59:36.351760+0000","last_clean":"2024-09-17T01:59:36.351760+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:36.351760+0000","last_undegraded":"2024-09-17T01:59:36.351760+0000","last_fullsized":"2024-09-17T01:59:36.351760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":549,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.350527+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:36.350527+0000","last_peered":"2024-09-17T01:59:36.350527+0000","last_clean":"2024-09-17T01:59:36.350527+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:36.350527+0000","last_undegraded":"2024-09-17T01:59:36.350527+0000","last_fullsized":"2024-09-17T01:59:36.350527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":463,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.818864+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:36.818864+0000","last_peered":"2024-09-17T01:59:36.818864+0000","last_clean":"2024-09-17T01:59:36.818864+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:36.818864+0000","last_undegraded":"2024-09-17T01:59:36.818864+0000","last_fullsized":"2024-09-17T01:59:36.818864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":685,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.817467+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:36.817467+0000","last_peered":"2024-09-17T01:59:36.817467+0000","last_clean":"2024-09-17T01:59:36.817467+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:36.817467+0000","last_undegraded":"2024-09-17T01:59:36.817467+0000","last_fullsized":"2024-09-17T01:59:36.817467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":219,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.821880+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:36.821880+0000","last_peered":"2024-09-17T01:59:36.821880+0000","last_clean":"2024-09-17T01:59:36.821880+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:36.821880+0000","last_undegraded":"2024-09-17T01:59:36.821880+0000","last_fullsized":"2024-09-17T01:59:36.821880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":675,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.351286+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:36.351286+0000","last_peered":"2024-09-17T01:59:36.351286+0000","last_clean":"2024-09-17T01:59:36.351286+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:36.351286+0000","last_undegraded":"2024-09-17T01:59:36.351286+0000","last_fullsized":"2024-09-17T01:59:36.351286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":247,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T01:59:36.822343+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:36.822343+0000","last_peered":"2024-09-17T01:59:36.822343+0000","last_clean":"2024-09-17T01:59:36.822343+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:36.822343+0000","last_undegraded":"2024-09-17T01:59:36.822343+0000","last_fullsized":"2024-09-17T01:59:36.822343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7009,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1527808,"data_stored":1491260,"data_compressed":181691,"data_compressed_allocated":237568,"data_compressed_original":811008,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":125,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678024,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52184,"kb_used_data":14908,"kb_used_omap":174,"kb_used_meta":37073,"kb_avail":94319656,"statfs":{"total":96636764160,"available":96583327744,"internally_reserved":0,"allocated":15265792,"data_stored":101244355,"data_compressed":8306248,"data_compressed_allocated":12034048,"data_compressed_original":99508224,"omap_allocated":179054,"internal_metadata":37962898},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95276,"kb_used_data":23896,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276564,"statfs":{"total":96636764160,"available":96539201536,"internally_reserved":0,"allocated":24469504,"data_stored":85043842,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91912,"kb_used_data":20528,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279928,"statfs":{"total":96636764160,"available":96542646272,"internally_reserved":0,"allocated":21020672,"data_stored":73205498,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1527808,"data_stored":1491260,"data_compressed":181691,"data_compressed_allocated":237568,"data_compressed_original":811008,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:44.247 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:44.570 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:44.572 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:44.587 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-17T01:59:44.099832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241300,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874220,"statfs":{"total":289910292480,"available":289663201280,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-883,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":883,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.285392"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":673,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817263+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:39.817263+0000","last_peered":"2024-09-17T01:59:39.817263+0000","last_clean":"2024-09-17T01:59:39.817263+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:39.817263+0000","last_undegraded":"2024-09-17T01:59:39.817263+0000","last_fullsized":"2024-09-17T01:59:39.817263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":666,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816042+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:39.816042+0000","last_peered":"2024-09-17T01:59:39.816042+0000","last_clean":"2024-09-17T01:59:39.816042+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:39.816042+0000","last_undegraded":"2024-09-17T01:59:39.816042+0000","last_fullsized":"2024-09-17T01:59:39.816042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":522,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373076+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:39.373076+0000","last_peered":"2024-09-17T01:59:39.373076+0000","last_clean":"2024-09-17T01:59:39.373076+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:39.373076+0000","last_undegraded":"2024-09-17T01:59:39.373076+0000","last_fullsized":"2024-09-17T01:59:39.373076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371523+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:39.371523+0000","last_peered":"2024-09-17T01:59:39.371523+0000","last_clean":"2024-09-17T01:59:39.371523+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:39.371523+0000","last_undegraded":"2024-09-17T01:59:39.371523+0000","last_fullsized":"2024-09-17T01:59:39.371523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815478+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:39.815478+0000","last_peered":"2024-09-17T01:59:39.815478+0000","last_clean":"2024-09-17T01:59:39.815478+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:39.815478+0000","last_undegraded":"2024-09-17T01:59:39.815478+0000","last_fullsized":"2024-09-17T01:59:39.815478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":579,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370865+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:39.370865+0000","last_peered":"2024-09-17T01:59:39.370865+0000","last_clean":"2024-09-17T01:59:39.370865+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:39.370865+0000","last_undegraded":"2024-09-17T01:59:39.370865+0000","last_fullsized":"2024-09-17T01:59:39.370865+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":691,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370541+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:39.370541+0000","last_peered":"2024-09-17T01:59:39.370541+0000","last_clean":"2024-09-17T01:59:39.370541+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:39.370541+0000","last_undegraded":"2024-09-17T01:59:39.370541+0000","last_fullsized":"2024-09-17T01:59:39.370541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":532,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370148+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:39.370148+0000","last_peered":"2024-09-17T01:59:39.370148+0000","last_clean":"2024-09-17T01:59:39.370148+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:39.370148+0000","last_undegraded":"2024-09-17T01:59:39.370148+0000","last_fullsized":"2024-09-17T01:59:39.370148+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":631,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847975+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:38.847975+0000","last_peered":"2024-09-17T01:59:38.847975+0000","last_clean":"2024-09-17T01:59:38.847975+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:38.847975+0000","last_undegraded":"2024-09-17T01:59:38.847975+0000","last_fullsized":"2024-09-17T01:59:38.847975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":597,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816331+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:39.816331+0000","last_peered":"2024-09-17T01:59:39.816331+0000","last_clean":"2024-09-17T01:59:39.816331+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:39.816331+0000","last_undegraded":"2024-09-17T01:59:39.816331+0000","last_fullsized":"2024-09-17T01:59:39.816331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":539,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:39.372935+0000","last_peered":"2024-09-17T01:59:39.372935+0000","last_clean":"2024-09-17T01:59:39.372935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:39.372935+0000","last_undegraded":"2024-09-17T01:59:39.372935+0000","last_fullsized":"2024-09-17T01:59:39.372935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":880,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815542+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:39.815542+0000","last_peered":"2024-09-17T01:59:39.815542+0000","last_clean":"2024-09-17T01:59:39.815542+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:39.815542+0000","last_undegraded":"2024-09-17T01:59:39.815542+0000","last_fullsized":"2024-09-17T01:59:39.815542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":573,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815154+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:39.815154+0000","last_peered":"2024-09-17T01:59:39.815154+0000","last_clean":"2024-09-17T01:59:39.815154+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:39.815154+0000","last_undegraded":"2024-09-17T01:59:39.815154+0000","last_fullsized":"2024-09-17T01:59:39.815154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369932+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:39.369932+0000","last_peered":"2024-09-17T01:59:39.369932+0000","last_clean":"2024-09-17T01:59:39.369932+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:39.369932+0000","last_undegraded":"2024-09-17T01:59:39.369932+0000","last_fullsized":"2024-09-17T01:59:39.369932+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370356+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:39.370356+0000","last_peered":"2024-09-17T01:59:39.370356+0000","last_clean":"2024-09-17T01:59:39.370356+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:39.370356+0000","last_undegraded":"2024-09-17T01:59:39.370356+0000","last_fullsized":"2024-09-17T01:59:39.370356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":641,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370488+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370488+0000","last_peered":"2024-09-17T01:59:39.370488+0000","last_clean":"2024-09-17T01:59:39.370488+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370488+0000","last_undegraded":"2024-09-17T01:59:39.370488+0000","last_fullsized":"2024-09-17T01:59:39.370488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:01.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848873+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:38.848873+0000","last_peered":"2024-09-17T01:59:38.848873+0000","last_clean":"2024-09-17T01:59:38.848873+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:38.848873+0000","last_undegraded":"2024-09-17T01:59:38.848873+0000","last_fullsized":"2024-09-17T01:59:38.848873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816722+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:39.816722+0000","last_peered":"2024-09-17T01:59:39.816722+0000","last_clean":"2024-09-17T01:59:39.816722+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:39.816722+0000","last_undegraded":"2024-09-17T01:59:39.816722+0000","last_fullsized":"2024-09-17T01:59:39.816722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":678,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846746+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:38.846746+0000","last_peered":"2024-09-17T01:59:38.846746+0000","last_clean":"2024-09-17T01:59:38.846746+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:38.846746+0000","last_undegraded":"2024-09-17T01:59:38.846746+0000","last_fullsized":"2024-09-17T01:59:38.846746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":693,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371863+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:39.371863+0000","last_peered":"2024-09-17T01:59:39.371863+0000","last_clean":"2024-09-17T01:59:39.371863+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:39.371863+0000","last_undegraded":"2024-09-17T01:59:39.371863+0000","last_fullsized":"2024-09-17T01:59:39.371863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":559,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371338+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:39.371338+0000","last_peered":"2024-09-17T01:59:39.371338+0000","last_clean":"2024-09-17T01:59:39.371338+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:39.371338+0000","last_undegraded":"2024-09-17T01:59:39.371338+0000","last_fullsized":"2024-09-17T01:59:39.371338+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814954+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:39.814954+0000","last_peered":"2024-09-17T01:59:39.814954+0000","last_clean":"2024-09-17T01:59:39.814954+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:39.814954+0000","last_undegraded":"2024-09-17T01:59:39.814954+0000","last_fullsized":"2024-09-17T01:59:39.814954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1077,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845648+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:38.845648+0000","last_peered":"2024-09-17T01:59:38.845648+0000","last_clean":"2024-09-17T01:59:38.845648+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:38.845648+0000","last_undegraded":"2024-09-17T01:59:38.845648+0000","last_fullsized":"2024-09-17T01:59:38.845648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814494+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:39.814494+0000","last_peered":"2024-09-17T01:59:39.814494+0000","last_clean":"2024-09-17T01:59:39.814494+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:39.814494+0000","last_undegraded":"2024-09-17T01:59:39.814494+0000","last_fullsized":"2024-09-17T01:59:39.814494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817370+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:39.817370+0000","last_peered":"2024-09-17T01:59:39.817370+0000","last_clean":"2024-09-17T01:59:39.817370+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:39.817370+0000","last_undegraded":"2024-09-17T01:59:39.817370+0000","last_fullsized":"2024-09-17T01:59:39.817370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847567+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:38.847567+0000","last_peered":"2024-09-17T01:59:38.847567+0000","last_clean":"2024-09-17T01:59:38.847567+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:38.847567+0000","last_undegraded":"2024-09-17T01:59:38.847567+0000","last_fullsized":"2024-09-17T01:59:38.847567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":565,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372723+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:39.372723+0000","last_peered":"2024-09-17T01:59:39.372723+0000","last_clean":"2024-09-17T01:59:39.372723+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:39.372723+0000","last_undegraded":"2024-09-17T01:59:39.372723+0000","last_fullsized":"2024-09-17T01:59:39.372723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":969,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815988+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:39.815988+0000","last_peered":"2024-09-17T01:59:39.815988+0000","last_clean":"2024-09-17T01:59:39.815988+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:39.815988+0000","last_undegraded":"2024-09-17T01:59:39.815988+0000","last_fullsized":"2024-09-17T01:59:39.815988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":618,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846785+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:38.846785+0000","last_peered":"2024-09-17T01:59:38.846785+0000","last_clean":"2024-09-17T01:59:38.846785+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:38.846785+0000","last_undegraded":"2024-09-17T01:59:38.846785+0000","last_fullsized":"2024-09-17T01:59:38.846785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1059,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815878+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:39.815878+0000","last_peered":"2024-09-17T01:59:39.815878+0000","last_clean":"2024-09-17T01:59:39.815878+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:39.815878+0000","last_undegraded":"2024-09-17T01:59:39.815878+0000","last_fullsized":"2024-09-17T01:59:39.815878+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845801+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:38.845801+0000","last_peered":"2024-09-17T01:59:38.845801+0000","last_clean":"2024-09-17T01:59:38.845801+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:38.845801+0000","last_undegraded":"2024-09-17T01:59:38.845801+0000","last_fullsized":"2024-09-17T01:59:38.845801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369786+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:39.369786+0000","last_peered":"2024-09-17T01:59:39.369786+0000","last_clean":"2024-09-17T01:59:39.369786+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:39.369786+0000","last_undegraded":"2024-09-17T01:59:39.369786+0000","last_fullsized":"2024-09-17T01:59:39.369786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815934+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:39.815934+0000","last_peered":"2024-09-17T01:59:39.815934+0000","last_clean":"2024-09-17T01:59:39.815934+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:39.815934+0000","last_undegraded":"2024-09-17T01:59:39.815934+0000","last_fullsized":"2024-09-17T01:59:39.815934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370594+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:39.370594+0000","last_peered":"2024-09-17T01:59:39.370594+0000","last_clean":"2024-09-17T01:59:39.370594+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:39.370594+0000","last_undegraded":"2024-09-17T01:59:39.370594+0000","last_fullsized":"2024-09-17T01:59:39.370594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":668,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816286+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:39.816286+0000","last_peered":"2024-09-17T01:59:39.816286+0000","last_clean":"2024-09-17T01:59:39.816286+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:39.816286+0000","last_undegraded":"2024-09-17T01:59:39.816286+0000","last_fullsized":"2024-09-17T01:59:39.816286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846369+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:38.846369+0000","last_peered":"2024-09-17T01:59:38.846369+0000","last_clean":"2024-09-17T01:59:38.846369+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:38.846369+0000","last_undegraded":"2024-09-17T01:59:38.846369+0000","last_fullsized":"2024-09-17T01:59:38.846369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1088,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847898+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:38.847898+0000","last_peered":"2024-09-17T01:59:38.847898+0000","last_clean":"2024-09-17T01:59:38.847898+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:38.847898+0000","last_undegraded":"2024-09-17T01:59:38.847898+0000","last_fullsized":"2024-09-17T01:59:38.847898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":268,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815135+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:39.815135+0000","last_peered":"2024-09-17T01:59:39.815135+0000","last_clean":"2024-09-17T01:59:39.815135+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:39.815135+0000","last_undegraded":"2024-09-17T01:59:39.815135+0000","last_fullsized":"2024-09-17T01:59:39.815135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":995,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.853966+0000","last_change":"2024-09-17T01:59:38.853966+0000","last_active":"2024-09-17T01:59:38.853966+0000","last_peered":"2024-09-17T01:59:38.853966+0000","last_clean":"2024-09-17T01:59:38.853966+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T01:59:38.853966+0000","last_undegraded":"2024-09-17T01:59:38.853966+0000","last_fullsized":"2024-09-17T01:59:38.853966+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:28.450891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":92,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369646+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:39.369646+0000","last_peered":"2024-09-17T01:59:39.369646+0000","last_clean":"2024-09-17T01:59:39.369646+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:39.369646+0000","last_undegraded":"2024-09-17T01:59:39.369646+0000","last_fullsized":"2024-09-17T01:59:39.369646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":262,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373162+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:39.373162+0000","last_peered":"2024-09-17T01:59:39.373162+0000","last_clean":"2024-09-17T01:59:39.373162+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:39.373162+0000","last_undegraded":"2024-09-17T01:59:39.373162+0000","last_fullsized":"2024-09-17T01:59:39.373162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":993,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814572+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:39.814572+0000","last_peered":"2024-09-17T01:59:39.814572+0000","last_clean":"2024-09-17T01:59:39.814572+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:39.814572+0000","last_undegraded":"2024-09-17T01:59:39.814572+0000","last_fullsized":"2024-09-17T01:59:39.814572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816828+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:39.816828+0000","last_peered":"2024-09-17T01:59:39.816828+0000","last_clean":"2024-09-17T01:59:39.816828+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:39.816828+0000","last_undegraded":"2024-09-17T01:59:39.816828+0000","last_fullsized":"2024-09-17T01:59:39.816828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814829+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:39.814829+0000","last_peered":"2024-09-17T01:59:39.814829+0000","last_clean":"2024-09-17T01:59:39.814829+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:39.814829+0000","last_undegraded":"2024-09-17T01:59:39.814829+0000","last_fullsized":"2024-09-17T01:59:39.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372340+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:39.372340+0000","last_peered":"2024-09-17T01:59:39.372340+0000","last_clean":"2024-09-17T01:59:39.372340+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:39.372340+0000","last_undegraded":"2024-09-17T01:59:39.372340+0000","last_fullsized":"2024-09-17T01:59:39.372340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.383520+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.383520+0000","last_peered":"2024-09-17T01:59:39.383520+0000","last_clean":"2024-09-17T01:59:39.383520+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.383520+0000","last_undegraded":"2024-09-17T01:59:39.383520+0000","last_fullsized":"2024-09-17T01:59:39.383520+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:16.474037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371571+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:39.371571+0000","last_peered":"2024-09-17T01:59:39.371571+0000","last_clean":"2024-09-17T01:59:39.371571+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:39.371571+0000","last_undegraded":"2024-09-17T01:59:39.371571+0000","last_fullsized":"2024-09-17T01:59:39.371571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1009,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846327+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:38.846327+0000","last_peered":"2024-09-17T01:59:38.846327+0000","last_clean":"2024-09-17T01:59:38.846327+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:38.846327+0000","last_undegraded":"2024-09-17T01:59:38.846327+0000","last_fullsized":"2024-09-17T01:59:38.846327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":352,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847328+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:38.847328+0000","last_peered":"2024-09-17T01:59:38.847328+0000","last_clean":"2024-09-17T01:59:38.847328+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:38.847328+0000","last_undegraded":"2024-09-17T01:59:38.847328+0000","last_fullsized":"2024-09-17T01:59:38.847328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372204+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:39.372204+0000","last_peered":"2024-09-17T01:59:39.372204+0000","last_clean":"2024-09-17T01:59:39.372204+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:39.372204+0000","last_undegraded":"2024-09-17T01:59:39.372204+0000","last_fullsized":"2024-09-17T01:59:39.372204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":239,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370315+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:39.370315+0000","last_peered":"2024-09-17T01:59:39.370315+0000","last_clean":"2024-09-17T01:59:39.370315+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:39.370315+0000","last_undegraded":"2024-09-17T01:59:39.370315+0000","last_fullsized":"2024-09-17T01:59:39.370315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":676,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372065+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:39.372065+0000","last_peered":"2024-09-17T01:59:39.372065+0000","last_clean":"2024-09-17T01:59:39.372065+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:39.372065+0000","last_undegraded":"2024-09-17T01:59:39.372065+0000","last_fullsized":"2024-09-17T01:59:39.372065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815508+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:39.815508+0000","last_peered":"2024-09-17T01:59:39.815508+0000","last_clean":"2024-09-17T01:59:39.815508+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:39.815508+0000","last_undegraded":"2024-09-17T01:59:39.815508+0000","last_fullsized":"2024-09-17T01:59:39.815508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":578,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372510+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:39.372510+0000","last_peered":"2024-09-17T01:59:39.372510+0000","last_clean":"2024-09-17T01:59:39.372510+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:39.372510+0000","last_undegraded":"2024-09-17T01:59:39.372510+0000","last_fullsized":"2024-09-17T01:59:39.372510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814799+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:39.814799+0000","last_peered":"2024-09-17T01:59:39.814799+0000","last_clean":"2024-09-17T01:59:39.814799+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:39.814799+0000","last_undegraded":"2024-09-17T01:59:39.814799+0000","last_fullsized":"2024-09-17T01:59:39.814799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":613,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848233+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:38.848233+0000","last_peered":"2024-09-17T01:59:38.848233+0000","last_clean":"2024-09-17T01:59:38.848233+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:38.848233+0000","last_undegraded":"2024-09-17T01:59:38.848233+0000","last_fullsized":"2024-09-17T01:59:38.848233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369489+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:39.369489+0000","last_peered":"2024-09-17T01:59:39.369489+0000","last_clean":"2024-09-17T01:59:39.369489+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:39.369489+0000","last_undegraded":"2024-09-17T01:59:39.369489+0000","last_fullsized":"2024-09-17T01:59:39.369489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370626+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:39.370626+0000","last_peered":"2024-09-17T01:59:39.370626+0000","last_clean":"2024-09-17T01:59:39.370626+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:39.370626+0000","last_undegraded":"2024-09-17T01:59:39.370626+0000","last_fullsized":"2024-09-17T01:59:39.370626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":526,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370980+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:39.370980+0000","last_peered":"2024-09-17T01:59:39.370980+0000","last_clean":"2024-09-17T01:59:39.370980+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:39.370980+0000","last_undegraded":"2024-09-17T01:59:39.370980+0000","last_fullsized":"2024-09-17T01:59:39.370980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372566+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:39.372566+0000","last_peered":"2024-09-17T01:59:39.372566+0000","last_clean":"2024-09-17T01:59:39.372566+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:39.372566+0000","last_undegraded":"2024-09-17T01:59:39.372566+0000","last_fullsized":"2024-09-17T01:59:39.372566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370139+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:39.370139+0000","last_peered":"2024-09-17T01:59:39.370139+0000","last_clean":"2024-09-17T01:59:39.370139+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:39.370139+0000","last_undegraded":"2024-09-17T01:59:39.370139+0000","last_fullsized":"2024-09-17T01:59:39.370139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":376,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846862+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:38.846862+0000","last_peered":"2024-09-17T01:59:38.846862+0000","last_clean":"2024-09-17T01:59:38.846862+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:38.846862+0000","last_undegraded":"2024-09-17T01:59:38.846862+0000","last_fullsized":"2024-09-17T01:59:38.846862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":714,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816560+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:39.816560+0000","last_peered":"2024-09-17T01:59:39.816560+0000","last_clean":"2024-09-17T01:59:39.816560+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:39.816560+0000","last_undegraded":"2024-09-17T01:59:39.816560+0000","last_fullsized":"2024-09-17T01:59:39.816560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847230+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:38.847230+0000","last_peered":"2024-09-17T01:59:38.847230+0000","last_clean":"2024-09-17T01:59:38.847230+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:38.847230+0000","last_undegraded":"2024-09-17T01:59:38.847230+0000","last_fullsized":"2024-09-17T01:59:38.847230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":616,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814991+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:39.814991+0000","last_peered":"2024-09-17T01:59:39.814991+0000","last_clean":"2024-09-17T01:59:39.814991+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:39.814991+0000","last_undegraded":"2024-09-17T01:59:39.814991+0000","last_fullsized":"2024-09-17T01:59:39.814991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":576,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848443+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:38.848443+0000","last_peered":"2024-09-17T01:59:38.848443+0000","last_clean":"2024-09-17T01:59:38.848443+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:38.848443+0000","last_undegraded":"2024-09-17T01:59:38.848443+0000","last_fullsized":"2024-09-17T01:59:38.848443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369922+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:39.369922+0000","last_peered":"2024-09-17T01:59:39.369922+0000","last_clean":"2024-09-17T01:59:39.369922+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:39.369922+0000","last_undegraded":"2024-09-17T01:59:39.369922+0000","last_fullsized":"2024-09-17T01:59:39.369922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370220+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:39.370220+0000","last_peered":"2024-09-17T01:59:39.370220+0000","last_clean":"2024-09-17T01:59:39.370220+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:39.370220+0000","last_undegraded":"2024-09-17T01:59:39.370220+0000","last_fullsized":"2024-09-17T01:59:39.370220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":621,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846849+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:38.846849+0000","last_peered":"2024-09-17T01:59:38.846849+0000","last_clean":"2024-09-17T01:59:38.846849+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:38.846849+0000","last_undegraded":"2024-09-17T01:59:38.846849+0000","last_fullsized":"2024-09-17T01:59:38.846849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":395,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371531+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:39.371531+0000","last_peered":"2024-09-17T01:59:39.371531+0000","last_clean":"2024-09-17T01:59:39.371531+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:39.371531+0000","last_undegraded":"2024-09-17T01:59:39.371531+0000","last_fullsized":"2024-09-17T01:59:39.371531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847630+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:38.847630+0000","last_peered":"2024-09-17T01:59:38.847630+0000","last_clean":"2024-09-17T01:59:38.847630+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:38.847630+0000","last_undegraded":"2024-09-17T01:59:38.847630+0000","last_fullsized":"2024-09-17T01:59:38.847630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":918,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815216+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:39.815216+0000","last_peered":"2024-09-17T01:59:39.815216+0000","last_clean":"2024-09-17T01:59:39.815216+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:39.815216+0000","last_undegraded":"2024-09-17T01:59:39.815216+0000","last_fullsized":"2024-09-17T01:59:39.815216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847300+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:38.847300+0000","last_peered":"2024-09-17T01:59:38.847300+0000","last_clean":"2024-09-17T01:59:38.847300+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:38.847300+0000","last_undegraded":"2024-09-17T01:59:38.847300+0000","last_fullsized":"2024-09-17T01:59:38.847300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816939+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:39.816939+0000","last_peered":"2024-09-17T01:59:39.816939+0000","last_clean":"2024-09-17T01:59:39.816939+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:39.816939+0000","last_undegraded":"2024-09-17T01:59:39.816939+0000","last_fullsized":"2024-09-17T01:59:39.816939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1011,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815275+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:39.815275+0000","last_peered":"2024-09-17T01:59:39.815275+0000","last_clean":"2024-09-17T01:59:39.815275+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:39.815275+0000","last_undegraded":"2024-09-17T01:59:39.815275+0000","last_fullsized":"2024-09-17T01:59:39.815275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848885+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:38.848885+0000","last_peered":"2024-09-17T01:59:38.848885+0000","last_clean":"2024-09-17T01:59:38.848885+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:38.848885+0000","last_undegraded":"2024-09-17T01:59:38.848885+0000","last_fullsized":"2024-09-17T01:59:38.848885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848216+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:38.848216+0000","last_peered":"2024-09-17T01:59:38.848216+0000","last_clean":"2024-09-17T01:59:38.848216+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:38.848216+0000","last_undegraded":"2024-09-17T01:59:38.848216+0000","last_fullsized":"2024-09-17T01:59:38.848216+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":985,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845970+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:38.845970+0000","last_peered":"2024-09-17T01:59:38.845970+0000","last_clean":"2024-09-17T01:59:38.845970+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:38.845970+0000","last_undegraded":"2024-09-17T01:59:38.845970+0000","last_fullsized":"2024-09-17T01:59:38.845970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":308,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848091+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:38.848091+0000","last_peered":"2024-09-17T01:59:38.848091+0000","last_clean":"2024-09-17T01:59:38.848091+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:38.848091+0000","last_undegraded":"2024-09-17T01:59:38.848091+0000","last_fullsized":"2024-09-17T01:59:38.848091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372405+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:39.372405+0000","last_peered":"2024-09-17T01:59:39.372405+0000","last_clean":"2024-09-17T01:59:39.372405+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:39.372405+0000","last_undegraded":"2024-09-17T01:59:39.372405+0000","last_fullsized":"2024-09-17T01:59:39.372405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1045,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814833+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:39.814833+0000","last_peered":"2024-09-17T01:59:39.814833+0000","last_clean":"2024-09-17T01:59:39.814833+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:39.814833+0000","last_undegraded":"2024-09-17T01:59:39.814833+0000","last_fullsized":"2024-09-17T01:59:39.814833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371068+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:39.371068+0000","last_peered":"2024-09-17T01:59:39.371068+0000","last_clean":"2024-09-17T01:59:39.371068+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:39.371068+0000","last_undegraded":"2024-09-17T01:59:39.371068+0000","last_fullsized":"2024-09-17T01:59:39.371068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":437,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371283+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:39.371283+0000","last_peered":"2024-09-17T01:59:39.371283+0000","last_clean":"2024-09-17T01:59:39.371283+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:39.371283+0000","last_undegraded":"2024-09-17T01:59:39.371283+0000","last_fullsized":"2024-09-17T01:59:39.371283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846003+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:38.846003+0000","last_peered":"2024-09-17T01:59:38.846003+0000","last_clean":"2024-09-17T01:59:38.846003+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:38.846003+0000","last_undegraded":"2024-09-17T01:59:38.846003+0000","last_fullsized":"2024-09-17T01:59:38.846003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":276,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816765+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:39.816765+0000","last_peered":"2024-09-17T01:59:39.816765+0000","last_clean":"2024-09-17T01:59:39.816765+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:39.816765+0000","last_undegraded":"2024-09-17T01:59:39.816765+0000","last_fullsized":"2024-09-17T01:59:39.816765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":331,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372283+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:39.372283+0000","last_peered":"2024-09-17T01:59:39.372283+0000","last_clean":"2024-09-17T01:59:39.372283+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:39.372283+0000","last_undegraded":"2024-09-17T01:59:39.372283+0000","last_fullsized":"2024-09-17T01:59:39.372283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845951+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:38.845951+0000","last_peered":"2024-09-17T01:59:38.845951+0000","last_clean":"2024-09-17T01:59:38.845951+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:38.845951+0000","last_undegraded":"2024-09-17T01:59:38.845951+0000","last_fullsized":"2024-09-17T01:59:38.845951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848690+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:38.848690+0000","last_peered":"2024-09-17T01:59:38.848690+0000","last_clean":"2024-09-17T01:59:38.848690+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:38.848690+0000","last_undegraded":"2024-09-17T01:59:38.848690+0000","last_fullsized":"2024-09-17T01:59:38.848690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":697,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845779+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:38.845779+0000","last_peered":"2024-09-17T01:59:38.845779+0000","last_clean":"2024-09-17T01:59:38.845779+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:38.845779+0000","last_undegraded":"2024-09-17T01:59:38.845779+0000","last_fullsized":"2024-09-17T01:59:38.845779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":883,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817405+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:39.817405+0000","last_peered":"2024-09-17T01:59:39.817405+0000","last_clean":"2024-09-17T01:59:39.817405+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:39.817405+0000","last_undegraded":"2024-09-17T01:59:39.817405+0000","last_fullsized":"2024-09-17T01:59:39.817405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":808,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846084+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:38.846084+0000","last_peered":"2024-09-17T01:59:38.846084+0000","last_clean":"2024-09-17T01:59:38.846084+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:38.846084+0000","last_undegraded":"2024-09-17T01:59:38.846084+0000","last_fullsized":"2024-09-17T01:59:38.846084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":966,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847264+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:38.847264+0000","last_peered":"2024-09-17T01:59:38.847264+0000","last_clean":"2024-09-17T01:59:38.847264+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:38.847264+0000","last_undegraded":"2024-09-17T01:59:38.847264+0000","last_fullsized":"2024-09-17T01:59:38.847264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":396,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846283+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:38.846283+0000","last_peered":"2024-09-17T01:59:38.846283+0000","last_clean":"2024-09-17T01:59:38.846283+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:38.846283+0000","last_undegraded":"2024-09-17T01:59:38.846283+0000","last_fullsized":"2024-09-17T01:59:38.846283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":938,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816205+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:39.816205+0000","last_peered":"2024-09-17T01:59:39.816205+0000","last_clean":"2024-09-17T01:59:39.816205+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:39.816205+0000","last_undegraded":"2024-09-17T01:59:39.816205+0000","last_fullsized":"2024-09-17T01:59:39.816205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":453,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816163+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:39.816163+0000","last_peered":"2024-09-17T01:59:39.816163+0000","last_clean":"2024-09-17T01:59:39.816163+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:39.816163+0000","last_undegraded":"2024-09-17T01:59:39.816163+0000","last_fullsized":"2024-09-17T01:59:39.816163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815645+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:39.815645+0000","last_peered":"2024-09-17T01:59:39.815645+0000","last_clean":"2024-09-17T01:59:39.815645+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:39.815645+0000","last_undegraded":"2024-09-17T01:59:39.815645+0000","last_fullsized":"2024-09-17T01:59:39.815645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":242,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815559+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:39.815559+0000","last_peered":"2024-09-17T01:59:39.815559+0000","last_clean":"2024-09-17T01:59:39.815559+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:39.815559+0000","last_undegraded":"2024-09-17T01:59:39.815559+0000","last_fullsized":"2024-09-17T01:59:39.815559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371045+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:39.371045+0000","last_peered":"2024-09-17T01:59:39.371045+0000","last_clean":"2024-09-17T01:59:39.371045+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:39.371045+0000","last_undegraded":"2024-09-17T01:59:39.371045+0000","last_fullsized":"2024-09-17T01:59:39.371045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":300,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371238+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:39.371238+0000","last_peered":"2024-09-17T01:59:39.371238+0000","last_clean":"2024-09-17T01:59:39.371238+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:39.371238+0000","last_undegraded":"2024-09-17T01:59:39.371238+0000","last_fullsized":"2024-09-17T01:59:39.371238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":555,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370671+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:39.370671+0000","last_peered":"2024-09-17T01:59:39.370671+0000","last_clean":"2024-09-17T01:59:39.370671+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:39.370671+0000","last_undegraded":"2024-09-17T01:59:39.370671+0000","last_fullsized":"2024-09-17T01:59:39.370671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":467,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816469+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:39.816469+0000","last_peered":"2024-09-17T01:59:39.816469+0000","last_clean":"2024-09-17T01:59:39.816469+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:39.816469+0000","last_undegraded":"2024-09-17T01:59:39.816469+0000","last_fullsized":"2024-09-17T01:59:39.816469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815795+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:39.815795+0000","last_peered":"2024-09-17T01:59:39.815795+0000","last_clean":"2024-09-17T01:59:39.815795+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:39.815795+0000","last_undegraded":"2024-09-17T01:59:39.815795+0000","last_fullsized":"2024-09-17T01:59:39.815795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847916+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:38.847916+0000","last_peered":"2024-09-17T01:59:38.847916+0000","last_clean":"2024-09-17T01:59:38.847916+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:38.847916+0000","last_undegraded":"2024-09-17T01:59:38.847916+0000","last_fullsized":"2024-09-17T01:59:38.847916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":681,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370445+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:39.370445+0000","last_peered":"2024-09-17T01:59:39.370445+0000","last_clean":"2024-09-17T01:59:39.370445+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:39.370445+0000","last_undegraded":"2024-09-17T01:59:39.370445+0000","last_fullsized":"2024-09-17T01:59:39.370445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":251,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848527+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:38.848527+0000","last_peered":"2024-09-17T01:59:38.848527+0000","last_clean":"2024-09-17T01:59:38.848527+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:38.848527+0000","last_undegraded":"2024-09-17T01:59:38.848527+0000","last_fullsized":"2024-09-17T01:59:38.848527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678025,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54076,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317764,"statfs":{"total":96636764160,"available":96581390336,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95300,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276540,"statfs":{"total":96636764160,"available":96539176960,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91924,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279916,"statfs":{"total":96636764160,"available":96542633984,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:44.591 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T01:59:44.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-17T01:59:44.957 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T01:59:44.972 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:59:44.973 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:45.281 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:45.283 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:45.300 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-17T01:59:44.099832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241300,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874220,"statfs":{"total":289910292480,"available":289663201280,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-883,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":883,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.285392"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":673,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817263+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:39.817263+0000","last_peered":"2024-09-17T01:59:39.817263+0000","last_clean":"2024-09-17T01:59:39.817263+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:39.817263+0000","last_undegraded":"2024-09-17T01:59:39.817263+0000","last_fullsized":"2024-09-17T01:59:39.817263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":666,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816042+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:39.816042+0000","last_peered":"2024-09-17T01:59:39.816042+0000","last_clean":"2024-09-17T01:59:39.816042+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:39.816042+0000","last_undegraded":"2024-09-17T01:59:39.816042+0000","last_fullsized":"2024-09-17T01:59:39.816042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":522,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373076+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:39.373076+0000","last_peered":"2024-09-17T01:59:39.373076+0000","last_clean":"2024-09-17T01:59:39.373076+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:39.373076+0000","last_undegraded":"2024-09-17T01:59:39.373076+0000","last_fullsized":"2024-09-17T01:59:39.373076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371523+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:39.371523+0000","last_peered":"2024-09-17T01:59:39.371523+0000","last_clean":"2024-09-17T01:59:39.371523+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:39.371523+0000","last_undegraded":"2024-09-17T01:59:39.371523+0000","last_fullsized":"2024-09-17T01:59:39.371523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815478+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:39.815478+0000","last_peered":"2024-09-17T01:59:39.815478+0000","last_clean":"2024-09-17T01:59:39.815478+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:39.815478+0000","last_undegraded":"2024-09-17T01:59:39.815478+0000","last_fullsized":"2024-09-17T01:59:39.815478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":579,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370865+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:39.370865+0000","last_peered":"2024-09-17T01:59:39.370865+0000","last_clean":"2024-09-17T01:59:39.370865+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:39.370865+0000","last_undegraded":"2024-09-17T01:59:39.370865+0000","last_fullsized":"2024-09-17T01:59:39.370865+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":691,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370541+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:39.370541+0000","last_peered":"2024-09-17T01:59:39.370541+0000","last_clean":"2024-09-17T01:59:39.370541+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:39.370541+0000","last_undegraded":"2024-09-17T01:59:39.370541+0000","last_fullsized":"2024-09-17T01:59:39.370541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":532,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370148+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:39.370148+0000","last_peered":"2024-09-17T01:59:39.370148+0000","last_clean":"2024-09-17T01:59:39.370148+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:39.370148+0000","last_undegraded":"2024-09-17T01:59:39.370148+0000","last_fullsized":"2024-09-17T01:59:39.370148+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":631,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847975+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:38.847975+0000","last_peered":"2024-09-17T01:59:38.847975+0000","last_clean":"2024-09-17T01:59:38.847975+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:38.847975+0000","last_undegraded":"2024-09-17T01:59:38.847975+0000","last_fullsized":"2024-09-17T01:59:38.847975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":597,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816331+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:39.816331+0000","last_peered":"2024-09-17T01:59:39.816331+0000","last_clean":"2024-09-17T01:59:39.816331+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:39.816331+0000","last_undegraded":"2024-09-17T01:59:39.816331+0000","last_fullsized":"2024-09-17T01:59:39.816331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":539,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:39.372935+0000","last_peered":"2024-09-17T01:59:39.372935+0000","last_clean":"2024-09-17T01:59:39.372935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:39.372935+0000","last_undegraded":"2024-09-17T01:59:39.372935+0000","last_fullsized":"2024-09-17T01:59:39.372935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":880,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815542+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:39.815542+0000","last_peered":"2024-09-17T01:59:39.815542+0000","last_clean":"2024-09-17T01:59:39.815542+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:39.815542+0000","last_undegraded":"2024-09-17T01:59:39.815542+0000","last_fullsized":"2024-09-17T01:59:39.815542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":573,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815154+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:39.815154+0000","last_peered":"2024-09-17T01:59:39.815154+0000","last_clean":"2024-09-17T01:59:39.815154+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:39.815154+0000","last_undegraded":"2024-09-17T01:59:39.815154+0000","last_fullsized":"2024-09-17T01:59:39.815154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369932+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:39.369932+0000","last_peered":"2024-09-17T01:59:39.369932+0000","last_clean":"2024-09-17T01:59:39.369932+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:39.369932+0000","last_undegraded":"2024-09-17T01:59:39.369932+0000","last_fullsized":"2024-09-17T01:59:39.369932+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370356+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:39.370356+0000","last_peered":"2024-09-17T01:59:39.370356+0000","last_clean":"2024-09-17T01:59:39.370356+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:39.370356+0000","last_undegraded":"2024-09-17T01:59:39.370356+0000","last_fullsized":"2024-09-17T01:59:39.370356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":641,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370488+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370488+0000","last_peered":"2024-09-17T01:59:39.370488+0000","last_clean":"2024-09-17T01:59:39.370488+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370488+0000","last_undegraded":"2024-09-17T01:59:39.370488+0000","last_fullsized":"2024-09-17T01:59:39.370488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:01.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848873+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:38.848873+0000","last_peered":"2024-09-17T01:59:38.848873+0000","last_clean":"2024-09-17T01:59:38.848873+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:38.848873+0000","last_undegraded":"2024-09-17T01:59:38.848873+0000","last_fullsized":"2024-09-17T01:59:38.848873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816722+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:39.816722+0000","last_peered":"2024-09-17T01:59:39.816722+0000","last_clean":"2024-09-17T01:59:39.816722+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:39.816722+0000","last_undegraded":"2024-09-17T01:59:39.816722+0000","last_fullsized":"2024-09-17T01:59:39.816722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":678,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846746+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:38.846746+0000","last_peered":"2024-09-17T01:59:38.846746+0000","last_clean":"2024-09-17T01:59:38.846746+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:38.846746+0000","last_undegraded":"2024-09-17T01:59:38.846746+0000","last_fullsized":"2024-09-17T01:59:38.846746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":693,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371863+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:39.371863+0000","last_peered":"2024-09-17T01:59:39.371863+0000","last_clean":"2024-09-17T01:59:39.371863+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:39.371863+0000","last_undegraded":"2024-09-17T01:59:39.371863+0000","last_fullsized":"2024-09-17T01:59:39.371863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":559,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371338+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:39.371338+0000","last_peered":"2024-09-17T01:59:39.371338+0000","last_clean":"2024-09-17T01:59:39.371338+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:39.371338+0000","last_undegraded":"2024-09-17T01:59:39.371338+0000","last_fullsized":"2024-09-17T01:59:39.371338+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814954+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:39.814954+0000","last_peered":"2024-09-17T01:59:39.814954+0000","last_clean":"2024-09-17T01:59:39.814954+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:39.814954+0000","last_undegraded":"2024-09-17T01:59:39.814954+0000","last_fullsized":"2024-09-17T01:59:39.814954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1077,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845648+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:38.845648+0000","last_peered":"2024-09-17T01:59:38.845648+0000","last_clean":"2024-09-17T01:59:38.845648+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:38.845648+0000","last_undegraded":"2024-09-17T01:59:38.845648+0000","last_fullsized":"2024-09-17T01:59:38.845648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814494+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:39.814494+0000","last_peered":"2024-09-17T01:59:39.814494+0000","last_clean":"2024-09-17T01:59:39.814494+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:39.814494+0000","last_undegraded":"2024-09-17T01:59:39.814494+0000","last_fullsized":"2024-09-17T01:59:39.814494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817370+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:39.817370+0000","last_peered":"2024-09-17T01:59:39.817370+0000","last_clean":"2024-09-17T01:59:39.817370+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:39.817370+0000","last_undegraded":"2024-09-17T01:59:39.817370+0000","last_fullsized":"2024-09-17T01:59:39.817370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847567+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:38.847567+0000","last_peered":"2024-09-17T01:59:38.847567+0000","last_clean":"2024-09-17T01:59:38.847567+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:38.847567+0000","last_undegraded":"2024-09-17T01:59:38.847567+0000","last_fullsized":"2024-09-17T01:59:38.847567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":565,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372723+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:39.372723+0000","last_peered":"2024-09-17T01:59:39.372723+0000","last_clean":"2024-09-17T01:59:39.372723+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:39.372723+0000","last_undegraded":"2024-09-17T01:59:39.372723+0000","last_fullsized":"2024-09-17T01:59:39.372723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":969,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815988+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:39.815988+0000","last_peered":"2024-09-17T01:59:39.815988+0000","last_clean":"2024-09-17T01:59:39.815988+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:39.815988+0000","last_undegraded":"2024-09-17T01:59:39.815988+0000","last_fullsized":"2024-09-17T01:59:39.815988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":618,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846785+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:38.846785+0000","last_peered":"2024-09-17T01:59:38.846785+0000","last_clean":"2024-09-17T01:59:38.846785+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:38.846785+0000","last_undegraded":"2024-09-17T01:59:38.846785+0000","last_fullsized":"2024-09-17T01:59:38.846785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1059,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815878+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:39.815878+0000","last_peered":"2024-09-17T01:59:39.815878+0000","last_clean":"2024-09-17T01:59:39.815878+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:39.815878+0000","last_undegraded":"2024-09-17T01:59:39.815878+0000","last_fullsized":"2024-09-17T01:59:39.815878+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845801+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:38.845801+0000","last_peered":"2024-09-17T01:59:38.845801+0000","last_clean":"2024-09-17T01:59:38.845801+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:38.845801+0000","last_undegraded":"2024-09-17T01:59:38.845801+0000","last_fullsized":"2024-09-17T01:59:38.845801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369786+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:39.369786+0000","last_peered":"2024-09-17T01:59:39.369786+0000","last_clean":"2024-09-17T01:59:39.369786+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:39.369786+0000","last_undegraded":"2024-09-17T01:59:39.369786+0000","last_fullsized":"2024-09-17T01:59:39.369786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815934+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:39.815934+0000","last_peered":"2024-09-17T01:59:39.815934+0000","last_clean":"2024-09-17T01:59:39.815934+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:39.815934+0000","last_undegraded":"2024-09-17T01:59:39.815934+0000","last_fullsized":"2024-09-17T01:59:39.815934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370594+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:39.370594+0000","last_peered":"2024-09-17T01:59:39.370594+0000","last_clean":"2024-09-17T01:59:39.370594+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:39.370594+0000","last_undegraded":"2024-09-17T01:59:39.370594+0000","last_fullsized":"2024-09-17T01:59:39.370594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":668,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816286+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:39.816286+0000","last_peered":"2024-09-17T01:59:39.816286+0000","last_clean":"2024-09-17T01:59:39.816286+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:39.816286+0000","last_undegraded":"2024-09-17T01:59:39.816286+0000","last_fullsized":"2024-09-17T01:59:39.816286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846369+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:38.846369+0000","last_peered":"2024-09-17T01:59:38.846369+0000","last_clean":"2024-09-17T01:59:38.846369+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:38.846369+0000","last_undegraded":"2024-09-17T01:59:38.846369+0000","last_fullsized":"2024-09-17T01:59:38.846369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1088,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847898+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:38.847898+0000","last_peered":"2024-09-17T01:59:38.847898+0000","last_clean":"2024-09-17T01:59:38.847898+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:38.847898+0000","last_undegraded":"2024-09-17T01:59:38.847898+0000","last_fullsized":"2024-09-17T01:59:38.847898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":268,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815135+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:39.815135+0000","last_peered":"2024-09-17T01:59:39.815135+0000","last_clean":"2024-09-17T01:59:39.815135+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:39.815135+0000","last_undegraded":"2024-09-17T01:59:39.815135+0000","last_fullsized":"2024-09-17T01:59:39.815135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":995,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.853966+0000","last_change":"2024-09-17T01:59:38.853966+0000","last_active":"2024-09-17T01:59:38.853966+0000","last_peered":"2024-09-17T01:59:38.853966+0000","last_clean":"2024-09-17T01:59:38.853966+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T01:59:38.853966+0000","last_undegraded":"2024-09-17T01:59:38.853966+0000","last_fullsized":"2024-09-17T01:59:38.853966+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:28.450891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":92,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369646+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:39.369646+0000","last_peered":"2024-09-17T01:59:39.369646+0000","last_clean":"2024-09-17T01:59:39.369646+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:39.369646+0000","last_undegraded":"2024-09-17T01:59:39.369646+0000","last_fullsized":"2024-09-17T01:59:39.369646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":262,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373162+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:39.373162+0000","last_peered":"2024-09-17T01:59:39.373162+0000","last_clean":"2024-09-17T01:59:39.373162+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:39.373162+0000","last_undegraded":"2024-09-17T01:59:39.373162+0000","last_fullsized":"2024-09-17T01:59:39.373162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":993,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814572+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:39.814572+0000","last_peered":"2024-09-17T01:59:39.814572+0000","last_clean":"2024-09-17T01:59:39.814572+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:39.814572+0000","last_undegraded":"2024-09-17T01:59:39.814572+0000","last_fullsized":"2024-09-17T01:59:39.814572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816828+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:39.816828+0000","last_peered":"2024-09-17T01:59:39.816828+0000","last_clean":"2024-09-17T01:59:39.816828+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:39.816828+0000","last_undegraded":"2024-09-17T01:59:39.816828+0000","last_fullsized":"2024-09-17T01:59:39.816828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814829+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:39.814829+0000","last_peered":"2024-09-17T01:59:39.814829+0000","last_clean":"2024-09-17T01:59:39.814829+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:39.814829+0000","last_undegraded":"2024-09-17T01:59:39.814829+0000","last_fullsized":"2024-09-17T01:59:39.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372340+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:39.372340+0000","last_peered":"2024-09-17T01:59:39.372340+0000","last_clean":"2024-09-17T01:59:39.372340+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:39.372340+0000","last_undegraded":"2024-09-17T01:59:39.372340+0000","last_fullsized":"2024-09-17T01:59:39.372340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.383520+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.383520+0000","last_peered":"2024-09-17T01:59:39.383520+0000","last_clean":"2024-09-17T01:59:39.383520+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.383520+0000","last_undegraded":"2024-09-17T01:59:39.383520+0000","last_fullsized":"2024-09-17T01:59:39.383520+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:16.474037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371571+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:39.371571+0000","last_peered":"2024-09-17T01:59:39.371571+0000","last_clean":"2024-09-17T01:59:39.371571+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:39.371571+0000","last_undegraded":"2024-09-17T01:59:39.371571+0000","last_fullsized":"2024-09-17T01:59:39.371571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1009,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846327+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:38.846327+0000","last_peered":"2024-09-17T01:59:38.846327+0000","last_clean":"2024-09-17T01:59:38.846327+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:38.846327+0000","last_undegraded":"2024-09-17T01:59:38.846327+0000","last_fullsized":"2024-09-17T01:59:38.846327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":352,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847328+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:38.847328+0000","last_peered":"2024-09-17T01:59:38.847328+0000","last_clean":"2024-09-17T01:59:38.847328+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:38.847328+0000","last_undegraded":"2024-09-17T01:59:38.847328+0000","last_fullsized":"2024-09-17T01:59:38.847328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372204+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:39.372204+0000","last_peered":"2024-09-17T01:59:39.372204+0000","last_clean":"2024-09-17T01:59:39.372204+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:39.372204+0000","last_undegraded":"2024-09-17T01:59:39.372204+0000","last_fullsized":"2024-09-17T01:59:39.372204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":239,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370315+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:39.370315+0000","last_peered":"2024-09-17T01:59:39.370315+0000","last_clean":"2024-09-17T01:59:39.370315+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:39.370315+0000","last_undegraded":"2024-09-17T01:59:39.370315+0000","last_fullsized":"2024-09-17T01:59:39.370315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":676,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372065+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:39.372065+0000","last_peered":"2024-09-17T01:59:39.372065+0000","last_clean":"2024-09-17T01:59:39.372065+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:39.372065+0000","last_undegraded":"2024-09-17T01:59:39.372065+0000","last_fullsized":"2024-09-17T01:59:39.372065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815508+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:39.815508+0000","last_peered":"2024-09-17T01:59:39.815508+0000","last_clean":"2024-09-17T01:59:39.815508+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:39.815508+0000","last_undegraded":"2024-09-17T01:59:39.815508+0000","last_fullsized":"2024-09-17T01:59:39.815508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":578,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372510+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:39.372510+0000","last_peered":"2024-09-17T01:59:39.372510+0000","last_clean":"2024-09-17T01:59:39.372510+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:39.372510+0000","last_undegraded":"2024-09-17T01:59:39.372510+0000","last_fullsized":"2024-09-17T01:59:39.372510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814799+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:39.814799+0000","last_peered":"2024-09-17T01:59:39.814799+0000","last_clean":"2024-09-17T01:59:39.814799+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:39.814799+0000","last_undegraded":"2024-09-17T01:59:39.814799+0000","last_fullsized":"2024-09-17T01:59:39.814799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":613,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848233+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:38.848233+0000","last_peered":"2024-09-17T01:59:38.848233+0000","last_clean":"2024-09-17T01:59:38.848233+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:38.848233+0000","last_undegraded":"2024-09-17T01:59:38.848233+0000","last_fullsized":"2024-09-17T01:59:38.848233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369489+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:39.369489+0000","last_peered":"2024-09-17T01:59:39.369489+0000","last_clean":"2024-09-17T01:59:39.369489+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:39.369489+0000","last_undegraded":"2024-09-17T01:59:39.369489+0000","last_fullsized":"2024-09-17T01:59:39.369489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370626+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:39.370626+0000","last_peered":"2024-09-17T01:59:39.370626+0000","last_clean":"2024-09-17T01:59:39.370626+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:39.370626+0000","last_undegraded":"2024-09-17T01:59:39.370626+0000","last_fullsized":"2024-09-17T01:59:39.370626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":526,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370980+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:39.370980+0000","last_peered":"2024-09-17T01:59:39.370980+0000","last_clean":"2024-09-17T01:59:39.370980+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:39.370980+0000","last_undegraded":"2024-09-17T01:59:39.370980+0000","last_fullsized":"2024-09-17T01:59:39.370980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372566+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:39.372566+0000","last_peered":"2024-09-17T01:59:39.372566+0000","last_clean":"2024-09-17T01:59:39.372566+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:39.372566+0000","last_undegraded":"2024-09-17T01:59:39.372566+0000","last_fullsized":"2024-09-17T01:59:39.372566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370139+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:39.370139+0000","last_peered":"2024-09-17T01:59:39.370139+0000","last_clean":"2024-09-17T01:59:39.370139+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:39.370139+0000","last_undegraded":"2024-09-17T01:59:39.370139+0000","last_fullsized":"2024-09-17T01:59:39.370139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":376,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846862+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:38.846862+0000","last_peered":"2024-09-17T01:59:38.846862+0000","last_clean":"2024-09-17T01:59:38.846862+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:38.846862+0000","last_undegraded":"2024-09-17T01:59:38.846862+0000","last_fullsized":"2024-09-17T01:59:38.846862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":714,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816560+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:39.816560+0000","last_peered":"2024-09-17T01:59:39.816560+0000","last_clean":"2024-09-17T01:59:39.816560+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:39.816560+0000","last_undegraded":"2024-09-17T01:59:39.816560+0000","last_fullsized":"2024-09-17T01:59:39.816560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847230+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:38.847230+0000","last_peered":"2024-09-17T01:59:38.847230+0000","last_clean":"2024-09-17T01:59:38.847230+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:38.847230+0000","last_undegraded":"2024-09-17T01:59:38.847230+0000","last_fullsized":"2024-09-17T01:59:38.847230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":616,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814991+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:39.814991+0000","last_peered":"2024-09-17T01:59:39.814991+0000","last_clean":"2024-09-17T01:59:39.814991+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:39.814991+0000","last_undegraded":"2024-09-17T01:59:39.814991+0000","last_fullsized":"2024-09-17T01:59:39.814991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":576,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848443+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:38.848443+0000","last_peered":"2024-09-17T01:59:38.848443+0000","last_clean":"2024-09-17T01:59:38.848443+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:38.848443+0000","last_undegraded":"2024-09-17T01:59:38.848443+0000","last_fullsized":"2024-09-17T01:59:38.848443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369922+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:39.369922+0000","last_peered":"2024-09-17T01:59:39.369922+0000","last_clean":"2024-09-17T01:59:39.369922+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:39.369922+0000","last_undegraded":"2024-09-17T01:59:39.369922+0000","last_fullsized":"2024-09-17T01:59:39.369922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370220+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:39.370220+0000","last_peered":"2024-09-17T01:59:39.370220+0000","last_clean":"2024-09-17T01:59:39.370220+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:39.370220+0000","last_undegraded":"2024-09-17T01:59:39.370220+0000","last_fullsized":"2024-09-17T01:59:39.370220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":621,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846849+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:38.846849+0000","last_peered":"2024-09-17T01:59:38.846849+0000","last_clean":"2024-09-17T01:59:38.846849+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:38.846849+0000","last_undegraded":"2024-09-17T01:59:38.846849+0000","last_fullsized":"2024-09-17T01:59:38.846849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":395,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371531+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:39.371531+0000","last_peered":"2024-09-17T01:59:39.371531+0000","last_clean":"2024-09-17T01:59:39.371531+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:39.371531+0000","last_undegraded":"2024-09-17T01:59:39.371531+0000","last_fullsized":"2024-09-17T01:59:39.371531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847630+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:38.847630+0000","last_peered":"2024-09-17T01:59:38.847630+0000","last_clean":"2024-09-17T01:59:38.847630+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:38.847630+0000","last_undegraded":"2024-09-17T01:59:38.847630+0000","last_fullsized":"2024-09-17T01:59:38.847630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":918,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815216+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:39.815216+0000","last_peered":"2024-09-17T01:59:39.815216+0000","last_clean":"2024-09-17T01:59:39.815216+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:39.815216+0000","last_undegraded":"2024-09-17T01:59:39.815216+0000","last_fullsized":"2024-09-17T01:59:39.815216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847300+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:38.847300+0000","last_peered":"2024-09-17T01:59:38.847300+0000","last_clean":"2024-09-17T01:59:38.847300+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:38.847300+0000","last_undegraded":"2024-09-17T01:59:38.847300+0000","last_fullsized":"2024-09-17T01:59:38.847300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816939+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:39.816939+0000","last_peered":"2024-09-17T01:59:39.816939+0000","last_clean":"2024-09-17T01:59:39.816939+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:39.816939+0000","last_undegraded":"2024-09-17T01:59:39.816939+0000","last_fullsized":"2024-09-17T01:59:39.816939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1011,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815275+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:39.815275+0000","last_peered":"2024-09-17T01:59:39.815275+0000","last_clean":"2024-09-17T01:59:39.815275+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:39.815275+0000","last_undegraded":"2024-09-17T01:59:39.815275+0000","last_fullsized":"2024-09-17T01:59:39.815275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848885+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:38.848885+0000","last_peered":"2024-09-17T01:59:38.848885+0000","last_clean":"2024-09-17T01:59:38.848885+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:38.848885+0000","last_undegraded":"2024-09-17T01:59:38.848885+0000","last_fullsized":"2024-09-17T01:59:38.848885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848216+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:38.848216+0000","last_peered":"2024-09-17T01:59:38.848216+0000","last_clean":"2024-09-17T01:59:38.848216+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:38.848216+0000","last_undegraded":"2024-09-17T01:59:38.848216+0000","last_fullsized":"2024-09-17T01:59:38.848216+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":985,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845970+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:38.845970+0000","last_peered":"2024-09-17T01:59:38.845970+0000","last_clean":"2024-09-17T01:59:38.845970+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:38.845970+0000","last_undegraded":"2024-09-17T01:59:38.845970+0000","last_fullsized":"2024-09-17T01:59:38.845970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":308,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848091+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:38.848091+0000","last_peered":"2024-09-17T01:59:38.848091+0000","last_clean":"2024-09-17T01:59:38.848091+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:38.848091+0000","last_undegraded":"2024-09-17T01:59:38.848091+0000","last_fullsized":"2024-09-17T01:59:38.848091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372405+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:39.372405+0000","last_peered":"2024-09-17T01:59:39.372405+0000","last_clean":"2024-09-17T01:59:39.372405+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:39.372405+0000","last_undegraded":"2024-09-17T01:59:39.372405+0000","last_fullsized":"2024-09-17T01:59:39.372405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1045,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814833+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:39.814833+0000","last_peered":"2024-09-17T01:59:39.814833+0000","last_clean":"2024-09-17T01:59:39.814833+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:39.814833+0000","last_undegraded":"2024-09-17T01:59:39.814833+0000","last_fullsized":"2024-09-17T01:59:39.814833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371068+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:39.371068+0000","last_peered":"2024-09-17T01:59:39.371068+0000","last_clean":"2024-09-17T01:59:39.371068+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:39.371068+0000","last_undegraded":"2024-09-17T01:59:39.371068+0000","last_fullsized":"2024-09-17T01:59:39.371068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":437,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371283+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:39.371283+0000","last_peered":"2024-09-17T01:59:39.371283+0000","last_clean":"2024-09-17T01:59:39.371283+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:39.371283+0000","last_undegraded":"2024-09-17T01:59:39.371283+0000","last_fullsized":"2024-09-17T01:59:39.371283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846003+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:38.846003+0000","last_peered":"2024-09-17T01:59:38.846003+0000","last_clean":"2024-09-17T01:59:38.846003+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:38.846003+0000","last_undegraded":"2024-09-17T01:59:38.846003+0000","last_fullsized":"2024-09-17T01:59:38.846003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":276,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816765+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:39.816765+0000","last_peered":"2024-09-17T01:59:39.816765+0000","last_clean":"2024-09-17T01:59:39.816765+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:39.816765+0000","last_undegraded":"2024-09-17T01:59:39.816765+0000","last_fullsized":"2024-09-17T01:59:39.816765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":331,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372283+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:39.372283+0000","last_peered":"2024-09-17T01:59:39.372283+0000","last_clean":"2024-09-17T01:59:39.372283+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:39.372283+0000","last_undegraded":"2024-09-17T01:59:39.372283+0000","last_fullsized":"2024-09-17T01:59:39.372283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845951+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:38.845951+0000","last_peered":"2024-09-17T01:59:38.845951+0000","last_clean":"2024-09-17T01:59:38.845951+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:38.845951+0000","last_undegraded":"2024-09-17T01:59:38.845951+0000","last_fullsized":"2024-09-17T01:59:38.845951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848690+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:38.848690+0000","last_peered":"2024-09-17T01:59:38.848690+0000","last_clean":"2024-09-17T01:59:38.848690+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:38.848690+0000","last_undegraded":"2024-09-17T01:59:38.848690+0000","last_fullsized":"2024-09-17T01:59:38.848690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":697,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845779+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:38.845779+0000","last_peered":"2024-09-17T01:59:38.845779+0000","last_clean":"2024-09-17T01:59:38.845779+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:38.845779+0000","last_undegraded":"2024-09-17T01:59:38.845779+0000","last_fullsized":"2024-09-17T01:59:38.845779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":883,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817405+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:39.817405+0000","last_peered":"2024-09-17T01:59:39.817405+0000","last_clean":"2024-09-17T01:59:39.817405+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:39.817405+0000","last_undegraded":"2024-09-17T01:59:39.817405+0000","last_fullsized":"2024-09-17T01:59:39.817405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":808,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846084+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:38.846084+0000","last_peered":"2024-09-17T01:59:38.846084+0000","last_clean":"2024-09-17T01:59:38.846084+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:38.846084+0000","last_undegraded":"2024-09-17T01:59:38.846084+0000","last_fullsized":"2024-09-17T01:59:38.846084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":966,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847264+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:38.847264+0000","last_peered":"2024-09-17T01:59:38.847264+0000","last_clean":"2024-09-17T01:59:38.847264+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:38.847264+0000","last_undegraded":"2024-09-17T01:59:38.847264+0000","last_fullsized":"2024-09-17T01:59:38.847264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":396,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846283+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:38.846283+0000","last_peered":"2024-09-17T01:59:38.846283+0000","last_clean":"2024-09-17T01:59:38.846283+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:38.846283+0000","last_undegraded":"2024-09-17T01:59:38.846283+0000","last_fullsized":"2024-09-17T01:59:38.846283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":938,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816205+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:39.816205+0000","last_peered":"2024-09-17T01:59:39.816205+0000","last_clean":"2024-09-17T01:59:39.816205+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:39.816205+0000","last_undegraded":"2024-09-17T01:59:39.816205+0000","last_fullsized":"2024-09-17T01:59:39.816205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":453,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816163+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:39.816163+0000","last_peered":"2024-09-17T01:59:39.816163+0000","last_clean":"2024-09-17T01:59:39.816163+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:39.816163+0000","last_undegraded":"2024-09-17T01:59:39.816163+0000","last_fullsized":"2024-09-17T01:59:39.816163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815645+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:39.815645+0000","last_peered":"2024-09-17T01:59:39.815645+0000","last_clean":"2024-09-17T01:59:39.815645+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:39.815645+0000","last_undegraded":"2024-09-17T01:59:39.815645+0000","last_fullsized":"2024-09-17T01:59:39.815645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":242,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815559+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:39.815559+0000","last_peered":"2024-09-17T01:59:39.815559+0000","last_clean":"2024-09-17T01:59:39.815559+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:39.815559+0000","last_undegraded":"2024-09-17T01:59:39.815559+0000","last_fullsized":"2024-09-17T01:59:39.815559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371045+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:39.371045+0000","last_peered":"2024-09-17T01:59:39.371045+0000","last_clean":"2024-09-17T01:59:39.371045+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:39.371045+0000","last_undegraded":"2024-09-17T01:59:39.371045+0000","last_fullsized":"2024-09-17T01:59:39.371045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":300,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371238+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:39.371238+0000","last_peered":"2024-09-17T01:59:39.371238+0000","last_clean":"2024-09-17T01:59:39.371238+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:39.371238+0000","last_undegraded":"2024-09-17T01:59:39.371238+0000","last_fullsized":"2024-09-17T01:59:39.371238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":555,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370671+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:39.370671+0000","last_peered":"2024-09-17T01:59:39.370671+0000","last_clean":"2024-09-17T01:59:39.370671+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:39.370671+0000","last_undegraded":"2024-09-17T01:59:39.370671+0000","last_fullsized":"2024-09-17T01:59:39.370671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":467,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816469+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:39.816469+0000","last_peered":"2024-09-17T01:59:39.816469+0000","last_clean":"2024-09-17T01:59:39.816469+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:39.816469+0000","last_undegraded":"2024-09-17T01:59:39.816469+0000","last_fullsized":"2024-09-17T01:59:39.816469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815795+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:39.815795+0000","last_peered":"2024-09-17T01:59:39.815795+0000","last_clean":"2024-09-17T01:59:39.815795+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:39.815795+0000","last_undegraded":"2024-09-17T01:59:39.815795+0000","last_fullsized":"2024-09-17T01:59:39.815795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847916+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:38.847916+0000","last_peered":"2024-09-17T01:59:38.847916+0000","last_clean":"2024-09-17T01:59:38.847916+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:38.847916+0000","last_undegraded":"2024-09-17T01:59:38.847916+0000","last_fullsized":"2024-09-17T01:59:38.847916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":681,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370445+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:39.370445+0000","last_peered":"2024-09-17T01:59:39.370445+0000","last_clean":"2024-09-17T01:59:39.370445+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:39.370445+0000","last_undegraded":"2024-09-17T01:59:39.370445+0000","last_fullsized":"2024-09-17T01:59:39.370445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":251,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848527+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:38.848527+0000","last_peered":"2024-09-17T01:59:38.848527+0000","last_clean":"2024-09-17T01:59:38.848527+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:38.848527+0000","last_undegraded":"2024-09-17T01:59:38.848527+0000","last_fullsized":"2024-09-17T01:59:38.848527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678025,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54076,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317764,"statfs":{"total":96636764160,"available":96581390336,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95300,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276540,"statfs":{"total":96636764160,"available":96539176960,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91924,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279916,"statfs":{"total":96636764160,"available":96542633984,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:45.362 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:45.683 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:45.685 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:45.702 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-17T01:59:44.099832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241300,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874220,"statfs":{"total":289910292480,"available":289663201280,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-883,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":883,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.285392"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":673,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817263+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:39.817263+0000","last_peered":"2024-09-17T01:59:39.817263+0000","last_clean":"2024-09-17T01:59:39.817263+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:39.817263+0000","last_undegraded":"2024-09-17T01:59:39.817263+0000","last_fullsized":"2024-09-17T01:59:39.817263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":666,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816042+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:39.816042+0000","last_peered":"2024-09-17T01:59:39.816042+0000","last_clean":"2024-09-17T01:59:39.816042+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:39.816042+0000","last_undegraded":"2024-09-17T01:59:39.816042+0000","last_fullsized":"2024-09-17T01:59:39.816042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":522,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373076+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:39.373076+0000","last_peered":"2024-09-17T01:59:39.373076+0000","last_clean":"2024-09-17T01:59:39.373076+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:39.373076+0000","last_undegraded":"2024-09-17T01:59:39.373076+0000","last_fullsized":"2024-09-17T01:59:39.373076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371523+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:39.371523+0000","last_peered":"2024-09-17T01:59:39.371523+0000","last_clean":"2024-09-17T01:59:39.371523+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:39.371523+0000","last_undegraded":"2024-09-17T01:59:39.371523+0000","last_fullsized":"2024-09-17T01:59:39.371523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815478+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:39.815478+0000","last_peered":"2024-09-17T01:59:39.815478+0000","last_clean":"2024-09-17T01:59:39.815478+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:39.815478+0000","last_undegraded":"2024-09-17T01:59:39.815478+0000","last_fullsized":"2024-09-17T01:59:39.815478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":579,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370865+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:39.370865+0000","last_peered":"2024-09-17T01:59:39.370865+0000","last_clean":"2024-09-17T01:59:39.370865+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:39.370865+0000","last_undegraded":"2024-09-17T01:59:39.370865+0000","last_fullsized":"2024-09-17T01:59:39.370865+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":691,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370541+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:39.370541+0000","last_peered":"2024-09-17T01:59:39.370541+0000","last_clean":"2024-09-17T01:59:39.370541+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:39.370541+0000","last_undegraded":"2024-09-17T01:59:39.370541+0000","last_fullsized":"2024-09-17T01:59:39.370541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":532,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370148+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:39.370148+0000","last_peered":"2024-09-17T01:59:39.370148+0000","last_clean":"2024-09-17T01:59:39.370148+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:39.370148+0000","last_undegraded":"2024-09-17T01:59:39.370148+0000","last_fullsized":"2024-09-17T01:59:39.370148+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":631,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847975+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:38.847975+0000","last_peered":"2024-09-17T01:59:38.847975+0000","last_clean":"2024-09-17T01:59:38.847975+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:38.847975+0000","last_undegraded":"2024-09-17T01:59:38.847975+0000","last_fullsized":"2024-09-17T01:59:38.847975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":597,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816331+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:39.816331+0000","last_peered":"2024-09-17T01:59:39.816331+0000","last_clean":"2024-09-17T01:59:39.816331+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:39.816331+0000","last_undegraded":"2024-09-17T01:59:39.816331+0000","last_fullsized":"2024-09-17T01:59:39.816331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":539,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:39.372935+0000","last_peered":"2024-09-17T01:59:39.372935+0000","last_clean":"2024-09-17T01:59:39.372935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:39.372935+0000","last_undegraded":"2024-09-17T01:59:39.372935+0000","last_fullsized":"2024-09-17T01:59:39.372935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":880,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815542+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:39.815542+0000","last_peered":"2024-09-17T01:59:39.815542+0000","last_clean":"2024-09-17T01:59:39.815542+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:39.815542+0000","last_undegraded":"2024-09-17T01:59:39.815542+0000","last_fullsized":"2024-09-17T01:59:39.815542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":573,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815154+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:39.815154+0000","last_peered":"2024-09-17T01:59:39.815154+0000","last_clean":"2024-09-17T01:59:39.815154+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:39.815154+0000","last_undegraded":"2024-09-17T01:59:39.815154+0000","last_fullsized":"2024-09-17T01:59:39.815154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369932+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:39.369932+0000","last_peered":"2024-09-17T01:59:39.369932+0000","last_clean":"2024-09-17T01:59:39.369932+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:39.369932+0000","last_undegraded":"2024-09-17T01:59:39.369932+0000","last_fullsized":"2024-09-17T01:59:39.369932+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370356+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:39.370356+0000","last_peered":"2024-09-17T01:59:39.370356+0000","last_clean":"2024-09-17T01:59:39.370356+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:39.370356+0000","last_undegraded":"2024-09-17T01:59:39.370356+0000","last_fullsized":"2024-09-17T01:59:39.370356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":641,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370488+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370488+0000","last_peered":"2024-09-17T01:59:39.370488+0000","last_clean":"2024-09-17T01:59:39.370488+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370488+0000","last_undegraded":"2024-09-17T01:59:39.370488+0000","last_fullsized":"2024-09-17T01:59:39.370488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:01.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848873+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:38.848873+0000","last_peered":"2024-09-17T01:59:38.848873+0000","last_clean":"2024-09-17T01:59:38.848873+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:38.848873+0000","last_undegraded":"2024-09-17T01:59:38.848873+0000","last_fullsized":"2024-09-17T01:59:38.848873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816722+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:39.816722+0000","last_peered":"2024-09-17T01:59:39.816722+0000","last_clean":"2024-09-17T01:59:39.816722+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:39.816722+0000","last_undegraded":"2024-09-17T01:59:39.816722+0000","last_fullsized":"2024-09-17T01:59:39.816722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":678,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846746+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:38.846746+0000","last_peered":"2024-09-17T01:59:38.846746+0000","last_clean":"2024-09-17T01:59:38.846746+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:38.846746+0000","last_undegraded":"2024-09-17T01:59:38.846746+0000","last_fullsized":"2024-09-17T01:59:38.846746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":693,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371863+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:39.371863+0000","last_peered":"2024-09-17T01:59:39.371863+0000","last_clean":"2024-09-17T01:59:39.371863+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:39.371863+0000","last_undegraded":"2024-09-17T01:59:39.371863+0000","last_fullsized":"2024-09-17T01:59:39.371863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":559,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371338+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:39.371338+0000","last_peered":"2024-09-17T01:59:39.371338+0000","last_clean":"2024-09-17T01:59:39.371338+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:39.371338+0000","last_undegraded":"2024-09-17T01:59:39.371338+0000","last_fullsized":"2024-09-17T01:59:39.371338+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814954+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:39.814954+0000","last_peered":"2024-09-17T01:59:39.814954+0000","last_clean":"2024-09-17T01:59:39.814954+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:39.814954+0000","last_undegraded":"2024-09-17T01:59:39.814954+0000","last_fullsized":"2024-09-17T01:59:39.814954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1077,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845648+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:38.845648+0000","last_peered":"2024-09-17T01:59:38.845648+0000","last_clean":"2024-09-17T01:59:38.845648+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:38.845648+0000","last_undegraded":"2024-09-17T01:59:38.845648+0000","last_fullsized":"2024-09-17T01:59:38.845648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814494+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:39.814494+0000","last_peered":"2024-09-17T01:59:39.814494+0000","last_clean":"2024-09-17T01:59:39.814494+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:39.814494+0000","last_undegraded":"2024-09-17T01:59:39.814494+0000","last_fullsized":"2024-09-17T01:59:39.814494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817370+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:39.817370+0000","last_peered":"2024-09-17T01:59:39.817370+0000","last_clean":"2024-09-17T01:59:39.817370+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:39.817370+0000","last_undegraded":"2024-09-17T01:59:39.817370+0000","last_fullsized":"2024-09-17T01:59:39.817370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847567+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:38.847567+0000","last_peered":"2024-09-17T01:59:38.847567+0000","last_clean":"2024-09-17T01:59:38.847567+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:38.847567+0000","last_undegraded":"2024-09-17T01:59:38.847567+0000","last_fullsized":"2024-09-17T01:59:38.847567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":565,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372723+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:39.372723+0000","last_peered":"2024-09-17T01:59:39.372723+0000","last_clean":"2024-09-17T01:59:39.372723+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:39.372723+0000","last_undegraded":"2024-09-17T01:59:39.372723+0000","last_fullsized":"2024-09-17T01:59:39.372723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":969,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815988+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:39.815988+0000","last_peered":"2024-09-17T01:59:39.815988+0000","last_clean":"2024-09-17T01:59:39.815988+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:39.815988+0000","last_undegraded":"2024-09-17T01:59:39.815988+0000","last_fullsized":"2024-09-17T01:59:39.815988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":618,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846785+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:38.846785+0000","last_peered":"2024-09-17T01:59:38.846785+0000","last_clean":"2024-09-17T01:59:38.846785+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:38.846785+0000","last_undegraded":"2024-09-17T01:59:38.846785+0000","last_fullsized":"2024-09-17T01:59:38.846785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1059,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815878+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:39.815878+0000","last_peered":"2024-09-17T01:59:39.815878+0000","last_clean":"2024-09-17T01:59:39.815878+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:39.815878+0000","last_undegraded":"2024-09-17T01:59:39.815878+0000","last_fullsized":"2024-09-17T01:59:39.815878+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845801+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:38.845801+0000","last_peered":"2024-09-17T01:59:38.845801+0000","last_clean":"2024-09-17T01:59:38.845801+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:38.845801+0000","last_undegraded":"2024-09-17T01:59:38.845801+0000","last_fullsized":"2024-09-17T01:59:38.845801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369786+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:39.369786+0000","last_peered":"2024-09-17T01:59:39.369786+0000","last_clean":"2024-09-17T01:59:39.369786+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:39.369786+0000","last_undegraded":"2024-09-17T01:59:39.369786+0000","last_fullsized":"2024-09-17T01:59:39.369786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815934+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:39.815934+0000","last_peered":"2024-09-17T01:59:39.815934+0000","last_clean":"2024-09-17T01:59:39.815934+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:39.815934+0000","last_undegraded":"2024-09-17T01:59:39.815934+0000","last_fullsized":"2024-09-17T01:59:39.815934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370594+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:39.370594+0000","last_peered":"2024-09-17T01:59:39.370594+0000","last_clean":"2024-09-17T01:59:39.370594+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:39.370594+0000","last_undegraded":"2024-09-17T01:59:39.370594+0000","last_fullsized":"2024-09-17T01:59:39.370594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":668,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816286+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:39.816286+0000","last_peered":"2024-09-17T01:59:39.816286+0000","last_clean":"2024-09-17T01:59:39.816286+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:39.816286+0000","last_undegraded":"2024-09-17T01:59:39.816286+0000","last_fullsized":"2024-09-17T01:59:39.816286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846369+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:38.846369+0000","last_peered":"2024-09-17T01:59:38.846369+0000","last_clean":"2024-09-17T01:59:38.846369+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:38.846369+0000","last_undegraded":"2024-09-17T01:59:38.846369+0000","last_fullsized":"2024-09-17T01:59:38.846369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1088,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847898+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:38.847898+0000","last_peered":"2024-09-17T01:59:38.847898+0000","last_clean":"2024-09-17T01:59:38.847898+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:38.847898+0000","last_undegraded":"2024-09-17T01:59:38.847898+0000","last_fullsized":"2024-09-17T01:59:38.847898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":268,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815135+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:39.815135+0000","last_peered":"2024-09-17T01:59:39.815135+0000","last_clean":"2024-09-17T01:59:39.815135+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:39.815135+0000","last_undegraded":"2024-09-17T01:59:39.815135+0000","last_fullsized":"2024-09-17T01:59:39.815135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":995,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.853966+0000","last_change":"2024-09-17T01:59:38.853966+0000","last_active":"2024-09-17T01:59:38.853966+0000","last_peered":"2024-09-17T01:59:38.853966+0000","last_clean":"2024-09-17T01:59:38.853966+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T01:59:38.853966+0000","last_undegraded":"2024-09-17T01:59:38.853966+0000","last_fullsized":"2024-09-17T01:59:38.853966+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:28.450891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":92,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369646+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:39.369646+0000","last_peered":"2024-09-17T01:59:39.369646+0000","last_clean":"2024-09-17T01:59:39.369646+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:39.369646+0000","last_undegraded":"2024-09-17T01:59:39.369646+0000","last_fullsized":"2024-09-17T01:59:39.369646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":262,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373162+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:39.373162+0000","last_peered":"2024-09-17T01:59:39.373162+0000","last_clean":"2024-09-17T01:59:39.373162+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:39.373162+0000","last_undegraded":"2024-09-17T01:59:39.373162+0000","last_fullsized":"2024-09-17T01:59:39.373162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":993,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814572+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:39.814572+0000","last_peered":"2024-09-17T01:59:39.814572+0000","last_clean":"2024-09-17T01:59:39.814572+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:39.814572+0000","last_undegraded":"2024-09-17T01:59:39.814572+0000","last_fullsized":"2024-09-17T01:59:39.814572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816828+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:39.816828+0000","last_peered":"2024-09-17T01:59:39.816828+0000","last_clean":"2024-09-17T01:59:39.816828+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:39.816828+0000","last_undegraded":"2024-09-17T01:59:39.816828+0000","last_fullsized":"2024-09-17T01:59:39.816828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814829+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:39.814829+0000","last_peered":"2024-09-17T01:59:39.814829+0000","last_clean":"2024-09-17T01:59:39.814829+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:39.814829+0000","last_undegraded":"2024-09-17T01:59:39.814829+0000","last_fullsized":"2024-09-17T01:59:39.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372340+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:39.372340+0000","last_peered":"2024-09-17T01:59:39.372340+0000","last_clean":"2024-09-17T01:59:39.372340+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:39.372340+0000","last_undegraded":"2024-09-17T01:59:39.372340+0000","last_fullsized":"2024-09-17T01:59:39.372340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.383520+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.383520+0000","last_peered":"2024-09-17T01:59:39.383520+0000","last_clean":"2024-09-17T01:59:39.383520+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.383520+0000","last_undegraded":"2024-09-17T01:59:39.383520+0000","last_fullsized":"2024-09-17T01:59:39.383520+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:16.474037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371571+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:39.371571+0000","last_peered":"2024-09-17T01:59:39.371571+0000","last_clean":"2024-09-17T01:59:39.371571+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:39.371571+0000","last_undegraded":"2024-09-17T01:59:39.371571+0000","last_fullsized":"2024-09-17T01:59:39.371571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1009,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846327+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:38.846327+0000","last_peered":"2024-09-17T01:59:38.846327+0000","last_clean":"2024-09-17T01:59:38.846327+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:38.846327+0000","last_undegraded":"2024-09-17T01:59:38.846327+0000","last_fullsized":"2024-09-17T01:59:38.846327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":352,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847328+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:38.847328+0000","last_peered":"2024-09-17T01:59:38.847328+0000","last_clean":"2024-09-17T01:59:38.847328+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:38.847328+0000","last_undegraded":"2024-09-17T01:59:38.847328+0000","last_fullsized":"2024-09-17T01:59:38.847328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372204+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:39.372204+0000","last_peered":"2024-09-17T01:59:39.372204+0000","last_clean":"2024-09-17T01:59:39.372204+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:39.372204+0000","last_undegraded":"2024-09-17T01:59:39.372204+0000","last_fullsized":"2024-09-17T01:59:39.372204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":239,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370315+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:39.370315+0000","last_peered":"2024-09-17T01:59:39.370315+0000","last_clean":"2024-09-17T01:59:39.370315+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:39.370315+0000","last_undegraded":"2024-09-17T01:59:39.370315+0000","last_fullsized":"2024-09-17T01:59:39.370315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":676,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372065+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:39.372065+0000","last_peered":"2024-09-17T01:59:39.372065+0000","last_clean":"2024-09-17T01:59:39.372065+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:39.372065+0000","last_undegraded":"2024-09-17T01:59:39.372065+0000","last_fullsized":"2024-09-17T01:59:39.372065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815508+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:39.815508+0000","last_peered":"2024-09-17T01:59:39.815508+0000","last_clean":"2024-09-17T01:59:39.815508+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:39.815508+0000","last_undegraded":"2024-09-17T01:59:39.815508+0000","last_fullsized":"2024-09-17T01:59:39.815508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":578,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372510+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:39.372510+0000","last_peered":"2024-09-17T01:59:39.372510+0000","last_clean":"2024-09-17T01:59:39.372510+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:39.372510+0000","last_undegraded":"2024-09-17T01:59:39.372510+0000","last_fullsized":"2024-09-17T01:59:39.372510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814799+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:39.814799+0000","last_peered":"2024-09-17T01:59:39.814799+0000","last_clean":"2024-09-17T01:59:39.814799+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:39.814799+0000","last_undegraded":"2024-09-17T01:59:39.814799+0000","last_fullsized":"2024-09-17T01:59:39.814799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":613,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848233+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:38.848233+0000","last_peered":"2024-09-17T01:59:38.848233+0000","last_clean":"2024-09-17T01:59:38.848233+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:38.848233+0000","last_undegraded":"2024-09-17T01:59:38.848233+0000","last_fullsized":"2024-09-17T01:59:38.848233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369489+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:39.369489+0000","last_peered":"2024-09-17T01:59:39.369489+0000","last_clean":"2024-09-17T01:59:39.369489+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:39.369489+0000","last_undegraded":"2024-09-17T01:59:39.369489+0000","last_fullsized":"2024-09-17T01:59:39.369489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370626+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:39.370626+0000","last_peered":"2024-09-17T01:59:39.370626+0000","last_clean":"2024-09-17T01:59:39.370626+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:39.370626+0000","last_undegraded":"2024-09-17T01:59:39.370626+0000","last_fullsized":"2024-09-17T01:59:39.370626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":526,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370980+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:39.370980+0000","last_peered":"2024-09-17T01:59:39.370980+0000","last_clean":"2024-09-17T01:59:39.370980+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:39.370980+0000","last_undegraded":"2024-09-17T01:59:39.370980+0000","last_fullsized":"2024-09-17T01:59:39.370980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372566+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:39.372566+0000","last_peered":"2024-09-17T01:59:39.372566+0000","last_clean":"2024-09-17T01:59:39.372566+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:39.372566+0000","last_undegraded":"2024-09-17T01:59:39.372566+0000","last_fullsized":"2024-09-17T01:59:39.372566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370139+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:39.370139+0000","last_peered":"2024-09-17T01:59:39.370139+0000","last_clean":"2024-09-17T01:59:39.370139+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:39.370139+0000","last_undegraded":"2024-09-17T01:59:39.370139+0000","last_fullsized":"2024-09-17T01:59:39.370139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":376,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846862+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:38.846862+0000","last_peered":"2024-09-17T01:59:38.846862+0000","last_clean":"2024-09-17T01:59:38.846862+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:38.846862+0000","last_undegraded":"2024-09-17T01:59:38.846862+0000","last_fullsized":"2024-09-17T01:59:38.846862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":714,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816560+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:39.816560+0000","last_peered":"2024-09-17T01:59:39.816560+0000","last_clean":"2024-09-17T01:59:39.816560+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:39.816560+0000","last_undegraded":"2024-09-17T01:59:39.816560+0000","last_fullsized":"2024-09-17T01:59:39.816560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847230+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:38.847230+0000","last_peered":"2024-09-17T01:59:38.847230+0000","last_clean":"2024-09-17T01:59:38.847230+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:38.847230+0000","last_undegraded":"2024-09-17T01:59:38.847230+0000","last_fullsized":"2024-09-17T01:59:38.847230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":616,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814991+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:39.814991+0000","last_peered":"2024-09-17T01:59:39.814991+0000","last_clean":"2024-09-17T01:59:39.814991+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:39.814991+0000","last_undegraded":"2024-09-17T01:59:39.814991+0000","last_fullsized":"2024-09-17T01:59:39.814991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":576,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848443+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:38.848443+0000","last_peered":"2024-09-17T01:59:38.848443+0000","last_clean":"2024-09-17T01:59:38.848443+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:38.848443+0000","last_undegraded":"2024-09-17T01:59:38.848443+0000","last_fullsized":"2024-09-17T01:59:38.848443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369922+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:39.369922+0000","last_peered":"2024-09-17T01:59:39.369922+0000","last_clean":"2024-09-17T01:59:39.369922+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:39.369922+0000","last_undegraded":"2024-09-17T01:59:39.369922+0000","last_fullsized":"2024-09-17T01:59:39.369922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370220+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:39.370220+0000","last_peered":"2024-09-17T01:59:39.370220+0000","last_clean":"2024-09-17T01:59:39.370220+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:39.370220+0000","last_undegraded":"2024-09-17T01:59:39.370220+0000","last_fullsized":"2024-09-17T01:59:39.370220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":621,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846849+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:38.846849+0000","last_peered":"2024-09-17T01:59:38.846849+0000","last_clean":"2024-09-17T01:59:38.846849+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:38.846849+0000","last_undegraded":"2024-09-17T01:59:38.846849+0000","last_fullsized":"2024-09-17T01:59:38.846849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":395,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371531+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:39.371531+0000","last_peered":"2024-09-17T01:59:39.371531+0000","last_clean":"2024-09-17T01:59:39.371531+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:39.371531+0000","last_undegraded":"2024-09-17T01:59:39.371531+0000","last_fullsized":"2024-09-17T01:59:39.371531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847630+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:38.847630+0000","last_peered":"2024-09-17T01:59:38.847630+0000","last_clean":"2024-09-17T01:59:38.847630+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:38.847630+0000","last_undegraded":"2024-09-17T01:59:38.847630+0000","last_fullsized":"2024-09-17T01:59:38.847630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":918,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815216+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:39.815216+0000","last_peered":"2024-09-17T01:59:39.815216+0000","last_clean":"2024-09-17T01:59:39.815216+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:39.815216+0000","last_undegraded":"2024-09-17T01:59:39.815216+0000","last_fullsized":"2024-09-17T01:59:39.815216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847300+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:38.847300+0000","last_peered":"2024-09-17T01:59:38.847300+0000","last_clean":"2024-09-17T01:59:38.847300+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:38.847300+0000","last_undegraded":"2024-09-17T01:59:38.847300+0000","last_fullsized":"2024-09-17T01:59:38.847300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816939+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:39.816939+0000","last_peered":"2024-09-17T01:59:39.816939+0000","last_clean":"2024-09-17T01:59:39.816939+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:39.816939+0000","last_undegraded":"2024-09-17T01:59:39.816939+0000","last_fullsized":"2024-09-17T01:59:39.816939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1011,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815275+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:39.815275+0000","last_peered":"2024-09-17T01:59:39.815275+0000","last_clean":"2024-09-17T01:59:39.815275+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:39.815275+0000","last_undegraded":"2024-09-17T01:59:39.815275+0000","last_fullsized":"2024-09-17T01:59:39.815275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848885+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:38.848885+0000","last_peered":"2024-09-17T01:59:38.848885+0000","last_clean":"2024-09-17T01:59:38.848885+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:38.848885+0000","last_undegraded":"2024-09-17T01:59:38.848885+0000","last_fullsized":"2024-09-17T01:59:38.848885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848216+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:38.848216+0000","last_peered":"2024-09-17T01:59:38.848216+0000","last_clean":"2024-09-17T01:59:38.848216+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:38.848216+0000","last_undegraded":"2024-09-17T01:59:38.848216+0000","last_fullsized":"2024-09-17T01:59:38.848216+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":985,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845970+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:38.845970+0000","last_peered":"2024-09-17T01:59:38.845970+0000","last_clean":"2024-09-17T01:59:38.845970+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:38.845970+0000","last_undegraded":"2024-09-17T01:59:38.845970+0000","last_fullsized":"2024-09-17T01:59:38.845970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":308,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848091+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:38.848091+0000","last_peered":"2024-09-17T01:59:38.848091+0000","last_clean":"2024-09-17T01:59:38.848091+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:38.848091+0000","last_undegraded":"2024-09-17T01:59:38.848091+0000","last_fullsized":"2024-09-17T01:59:38.848091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372405+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:39.372405+0000","last_peered":"2024-09-17T01:59:39.372405+0000","last_clean":"2024-09-17T01:59:39.372405+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:39.372405+0000","last_undegraded":"2024-09-17T01:59:39.372405+0000","last_fullsized":"2024-09-17T01:59:39.372405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1045,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814833+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:39.814833+0000","last_peered":"2024-09-17T01:59:39.814833+0000","last_clean":"2024-09-17T01:59:39.814833+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:39.814833+0000","last_undegraded":"2024-09-17T01:59:39.814833+0000","last_fullsized":"2024-09-17T01:59:39.814833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371068+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:39.371068+0000","last_peered":"2024-09-17T01:59:39.371068+0000","last_clean":"2024-09-17T01:59:39.371068+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:39.371068+0000","last_undegraded":"2024-09-17T01:59:39.371068+0000","last_fullsized":"2024-09-17T01:59:39.371068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":437,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371283+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:39.371283+0000","last_peered":"2024-09-17T01:59:39.371283+0000","last_clean":"2024-09-17T01:59:39.371283+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:39.371283+0000","last_undegraded":"2024-09-17T01:59:39.371283+0000","last_fullsized":"2024-09-17T01:59:39.371283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846003+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:38.846003+0000","last_peered":"2024-09-17T01:59:38.846003+0000","last_clean":"2024-09-17T01:59:38.846003+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:38.846003+0000","last_undegraded":"2024-09-17T01:59:38.846003+0000","last_fullsized":"2024-09-17T01:59:38.846003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":276,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816765+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:39.816765+0000","last_peered":"2024-09-17T01:59:39.816765+0000","last_clean":"2024-09-17T01:59:39.816765+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:39.816765+0000","last_undegraded":"2024-09-17T01:59:39.816765+0000","last_fullsized":"2024-09-17T01:59:39.816765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":331,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372283+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:39.372283+0000","last_peered":"2024-09-17T01:59:39.372283+0000","last_clean":"2024-09-17T01:59:39.372283+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:39.372283+0000","last_undegraded":"2024-09-17T01:59:39.372283+0000","last_fullsized":"2024-09-17T01:59:39.372283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845951+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:38.845951+0000","last_peered":"2024-09-17T01:59:38.845951+0000","last_clean":"2024-09-17T01:59:38.845951+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:38.845951+0000","last_undegraded":"2024-09-17T01:59:38.845951+0000","last_fullsized":"2024-09-17T01:59:38.845951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848690+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:38.848690+0000","last_peered":"2024-09-17T01:59:38.848690+0000","last_clean":"2024-09-17T01:59:38.848690+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:38.848690+0000","last_undegraded":"2024-09-17T01:59:38.848690+0000","last_fullsized":"2024-09-17T01:59:38.848690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":697,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845779+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:38.845779+0000","last_peered":"2024-09-17T01:59:38.845779+0000","last_clean":"2024-09-17T01:59:38.845779+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:38.845779+0000","last_undegraded":"2024-09-17T01:59:38.845779+0000","last_fullsized":"2024-09-17T01:59:38.845779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":883,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817405+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:39.817405+0000","last_peered":"2024-09-17T01:59:39.817405+0000","last_clean":"2024-09-17T01:59:39.817405+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:39.817405+0000","last_undegraded":"2024-09-17T01:59:39.817405+0000","last_fullsized":"2024-09-17T01:59:39.817405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":808,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846084+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:38.846084+0000","last_peered":"2024-09-17T01:59:38.846084+0000","last_clean":"2024-09-17T01:59:38.846084+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:38.846084+0000","last_undegraded":"2024-09-17T01:59:38.846084+0000","last_fullsized":"2024-09-17T01:59:38.846084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":966,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847264+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:38.847264+0000","last_peered":"2024-09-17T01:59:38.847264+0000","last_clean":"2024-09-17T01:59:38.847264+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:38.847264+0000","last_undegraded":"2024-09-17T01:59:38.847264+0000","last_fullsized":"2024-09-17T01:59:38.847264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":396,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846283+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:38.846283+0000","last_peered":"2024-09-17T01:59:38.846283+0000","last_clean":"2024-09-17T01:59:38.846283+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:38.846283+0000","last_undegraded":"2024-09-17T01:59:38.846283+0000","last_fullsized":"2024-09-17T01:59:38.846283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":938,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816205+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:39.816205+0000","last_peered":"2024-09-17T01:59:39.816205+0000","last_clean":"2024-09-17T01:59:39.816205+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:39.816205+0000","last_undegraded":"2024-09-17T01:59:39.816205+0000","last_fullsized":"2024-09-17T01:59:39.816205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":453,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816163+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:39.816163+0000","last_peered":"2024-09-17T01:59:39.816163+0000","last_clean":"2024-09-17T01:59:39.816163+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:39.816163+0000","last_undegraded":"2024-09-17T01:59:39.816163+0000","last_fullsized":"2024-09-17T01:59:39.816163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815645+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:39.815645+0000","last_peered":"2024-09-17T01:59:39.815645+0000","last_clean":"2024-09-17T01:59:39.815645+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:39.815645+0000","last_undegraded":"2024-09-17T01:59:39.815645+0000","last_fullsized":"2024-09-17T01:59:39.815645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":242,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815559+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:39.815559+0000","last_peered":"2024-09-17T01:59:39.815559+0000","last_clean":"2024-09-17T01:59:39.815559+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:39.815559+0000","last_undegraded":"2024-09-17T01:59:39.815559+0000","last_fullsized":"2024-09-17T01:59:39.815559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371045+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:39.371045+0000","last_peered":"2024-09-17T01:59:39.371045+0000","last_clean":"2024-09-17T01:59:39.371045+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:39.371045+0000","last_undegraded":"2024-09-17T01:59:39.371045+0000","last_fullsized":"2024-09-17T01:59:39.371045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":300,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371238+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:39.371238+0000","last_peered":"2024-09-17T01:59:39.371238+0000","last_clean":"2024-09-17T01:59:39.371238+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:39.371238+0000","last_undegraded":"2024-09-17T01:59:39.371238+0000","last_fullsized":"2024-09-17T01:59:39.371238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":555,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370671+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:39.370671+0000","last_peered":"2024-09-17T01:59:39.370671+0000","last_clean":"2024-09-17T01:59:39.370671+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:39.370671+0000","last_undegraded":"2024-09-17T01:59:39.370671+0000","last_fullsized":"2024-09-17T01:59:39.370671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":467,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816469+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:39.816469+0000","last_peered":"2024-09-17T01:59:39.816469+0000","last_clean":"2024-09-17T01:59:39.816469+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:39.816469+0000","last_undegraded":"2024-09-17T01:59:39.816469+0000","last_fullsized":"2024-09-17T01:59:39.816469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815795+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:39.815795+0000","last_peered":"2024-09-17T01:59:39.815795+0000","last_clean":"2024-09-17T01:59:39.815795+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:39.815795+0000","last_undegraded":"2024-09-17T01:59:39.815795+0000","last_fullsized":"2024-09-17T01:59:39.815795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847916+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:38.847916+0000","last_peered":"2024-09-17T01:59:38.847916+0000","last_clean":"2024-09-17T01:59:38.847916+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:38.847916+0000","last_undegraded":"2024-09-17T01:59:38.847916+0000","last_fullsized":"2024-09-17T01:59:38.847916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":681,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370445+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:39.370445+0000","last_peered":"2024-09-17T01:59:39.370445+0000","last_clean":"2024-09-17T01:59:39.370445+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:39.370445+0000","last_undegraded":"2024-09-17T01:59:39.370445+0000","last_fullsized":"2024-09-17T01:59:39.370445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":251,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848527+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:38.848527+0000","last_peered":"2024-09-17T01:59:38.848527+0000","last_clean":"2024-09-17T01:59:38.848527+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:38.848527+0000","last_undegraded":"2024-09-17T01:59:38.848527+0000","last_fullsized":"2024-09-17T01:59:38.848527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678025,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54076,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317764,"statfs":{"total":96636764160,"available":96581390336,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95300,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276540,"statfs":{"total":96636764160,"available":96539176960,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91924,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279916,"statfs":{"total":96636764160,"available":96542633984,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:45.706 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:59:45.706 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:46.056 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:46.058 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:46.073 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-17T01:59:44.099832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241300,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874220,"statfs":{"total":289910292480,"available":289663201280,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-883,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":883,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.285392"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":673,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817263+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:39.817263+0000","last_peered":"2024-09-17T01:59:39.817263+0000","last_clean":"2024-09-17T01:59:39.817263+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:39.817263+0000","last_undegraded":"2024-09-17T01:59:39.817263+0000","last_fullsized":"2024-09-17T01:59:39.817263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":666,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816042+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:39.816042+0000","last_peered":"2024-09-17T01:59:39.816042+0000","last_clean":"2024-09-17T01:59:39.816042+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:39.816042+0000","last_undegraded":"2024-09-17T01:59:39.816042+0000","last_fullsized":"2024-09-17T01:59:39.816042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":522,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373076+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:39.373076+0000","last_peered":"2024-09-17T01:59:39.373076+0000","last_clean":"2024-09-17T01:59:39.373076+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:39.373076+0000","last_undegraded":"2024-09-17T01:59:39.373076+0000","last_fullsized":"2024-09-17T01:59:39.373076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371523+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:39.371523+0000","last_peered":"2024-09-17T01:59:39.371523+0000","last_clean":"2024-09-17T01:59:39.371523+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:39.371523+0000","last_undegraded":"2024-09-17T01:59:39.371523+0000","last_fullsized":"2024-09-17T01:59:39.371523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815478+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:39.815478+0000","last_peered":"2024-09-17T01:59:39.815478+0000","last_clean":"2024-09-17T01:59:39.815478+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:39.815478+0000","last_undegraded":"2024-09-17T01:59:39.815478+0000","last_fullsized":"2024-09-17T01:59:39.815478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":579,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370865+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:39.370865+0000","last_peered":"2024-09-17T01:59:39.370865+0000","last_clean":"2024-09-17T01:59:39.370865+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:39.370865+0000","last_undegraded":"2024-09-17T01:59:39.370865+0000","last_fullsized":"2024-09-17T01:59:39.370865+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":691,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370541+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:39.370541+0000","last_peered":"2024-09-17T01:59:39.370541+0000","last_clean":"2024-09-17T01:59:39.370541+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:39.370541+0000","last_undegraded":"2024-09-17T01:59:39.370541+0000","last_fullsized":"2024-09-17T01:59:39.370541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":532,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370148+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:39.370148+0000","last_peered":"2024-09-17T01:59:39.370148+0000","last_clean":"2024-09-17T01:59:39.370148+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:39.370148+0000","last_undegraded":"2024-09-17T01:59:39.370148+0000","last_fullsized":"2024-09-17T01:59:39.370148+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":631,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847975+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:38.847975+0000","last_peered":"2024-09-17T01:59:38.847975+0000","last_clean":"2024-09-17T01:59:38.847975+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:38.847975+0000","last_undegraded":"2024-09-17T01:59:38.847975+0000","last_fullsized":"2024-09-17T01:59:38.847975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":597,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816331+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:39.816331+0000","last_peered":"2024-09-17T01:59:39.816331+0000","last_clean":"2024-09-17T01:59:39.816331+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:39.816331+0000","last_undegraded":"2024-09-17T01:59:39.816331+0000","last_fullsized":"2024-09-17T01:59:39.816331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":539,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:39.372935+0000","last_peered":"2024-09-17T01:59:39.372935+0000","last_clean":"2024-09-17T01:59:39.372935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:39.372935+0000","last_undegraded":"2024-09-17T01:59:39.372935+0000","last_fullsized":"2024-09-17T01:59:39.372935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":880,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815542+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:39.815542+0000","last_peered":"2024-09-17T01:59:39.815542+0000","last_clean":"2024-09-17T01:59:39.815542+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:39.815542+0000","last_undegraded":"2024-09-17T01:59:39.815542+0000","last_fullsized":"2024-09-17T01:59:39.815542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":573,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815154+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:39.815154+0000","last_peered":"2024-09-17T01:59:39.815154+0000","last_clean":"2024-09-17T01:59:39.815154+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:39.815154+0000","last_undegraded":"2024-09-17T01:59:39.815154+0000","last_fullsized":"2024-09-17T01:59:39.815154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369932+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:39.369932+0000","last_peered":"2024-09-17T01:59:39.369932+0000","last_clean":"2024-09-17T01:59:39.369932+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:39.369932+0000","last_undegraded":"2024-09-17T01:59:39.369932+0000","last_fullsized":"2024-09-17T01:59:39.369932+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370356+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:39.370356+0000","last_peered":"2024-09-17T01:59:39.370356+0000","last_clean":"2024-09-17T01:59:39.370356+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:39.370356+0000","last_undegraded":"2024-09-17T01:59:39.370356+0000","last_fullsized":"2024-09-17T01:59:39.370356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":641,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370488+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370488+0000","last_peered":"2024-09-17T01:59:39.370488+0000","last_clean":"2024-09-17T01:59:39.370488+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370488+0000","last_undegraded":"2024-09-17T01:59:39.370488+0000","last_fullsized":"2024-09-17T01:59:39.370488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:01.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848873+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:38.848873+0000","last_peered":"2024-09-17T01:59:38.848873+0000","last_clean":"2024-09-17T01:59:38.848873+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:38.848873+0000","last_undegraded":"2024-09-17T01:59:38.848873+0000","last_fullsized":"2024-09-17T01:59:38.848873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816722+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:39.816722+0000","last_peered":"2024-09-17T01:59:39.816722+0000","last_clean":"2024-09-17T01:59:39.816722+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:39.816722+0000","last_undegraded":"2024-09-17T01:59:39.816722+0000","last_fullsized":"2024-09-17T01:59:39.816722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":678,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846746+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:38.846746+0000","last_peered":"2024-09-17T01:59:38.846746+0000","last_clean":"2024-09-17T01:59:38.846746+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:38.846746+0000","last_undegraded":"2024-09-17T01:59:38.846746+0000","last_fullsized":"2024-09-17T01:59:38.846746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":693,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371863+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:39.371863+0000","last_peered":"2024-09-17T01:59:39.371863+0000","last_clean":"2024-09-17T01:59:39.371863+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:39.371863+0000","last_undegraded":"2024-09-17T01:59:39.371863+0000","last_fullsized":"2024-09-17T01:59:39.371863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":559,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371338+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:39.371338+0000","last_peered":"2024-09-17T01:59:39.371338+0000","last_clean":"2024-09-17T01:59:39.371338+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:39.371338+0000","last_undegraded":"2024-09-17T01:59:39.371338+0000","last_fullsized":"2024-09-17T01:59:39.371338+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814954+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:39.814954+0000","last_peered":"2024-09-17T01:59:39.814954+0000","last_clean":"2024-09-17T01:59:39.814954+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:39.814954+0000","last_undegraded":"2024-09-17T01:59:39.814954+0000","last_fullsized":"2024-09-17T01:59:39.814954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1077,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845648+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:38.845648+0000","last_peered":"2024-09-17T01:59:38.845648+0000","last_clean":"2024-09-17T01:59:38.845648+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:38.845648+0000","last_undegraded":"2024-09-17T01:59:38.845648+0000","last_fullsized":"2024-09-17T01:59:38.845648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814494+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:39.814494+0000","last_peered":"2024-09-17T01:59:39.814494+0000","last_clean":"2024-09-17T01:59:39.814494+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:39.814494+0000","last_undegraded":"2024-09-17T01:59:39.814494+0000","last_fullsized":"2024-09-17T01:59:39.814494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817370+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:39.817370+0000","last_peered":"2024-09-17T01:59:39.817370+0000","last_clean":"2024-09-17T01:59:39.817370+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:39.817370+0000","last_undegraded":"2024-09-17T01:59:39.817370+0000","last_fullsized":"2024-09-17T01:59:39.817370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847567+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:38.847567+0000","last_peered":"2024-09-17T01:59:38.847567+0000","last_clean":"2024-09-17T01:59:38.847567+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:38.847567+0000","last_undegraded":"2024-09-17T01:59:38.847567+0000","last_fullsized":"2024-09-17T01:59:38.847567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":565,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372723+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:39.372723+0000","last_peered":"2024-09-17T01:59:39.372723+0000","last_clean":"2024-09-17T01:59:39.372723+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:39.372723+0000","last_undegraded":"2024-09-17T01:59:39.372723+0000","last_fullsized":"2024-09-17T01:59:39.372723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":969,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815988+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:39.815988+0000","last_peered":"2024-09-17T01:59:39.815988+0000","last_clean":"2024-09-17T01:59:39.815988+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:39.815988+0000","last_undegraded":"2024-09-17T01:59:39.815988+0000","last_fullsized":"2024-09-17T01:59:39.815988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":618,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846785+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:38.846785+0000","last_peered":"2024-09-17T01:59:38.846785+0000","last_clean":"2024-09-17T01:59:38.846785+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:38.846785+0000","last_undegraded":"2024-09-17T01:59:38.846785+0000","last_fullsized":"2024-09-17T01:59:38.846785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1059,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815878+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:39.815878+0000","last_peered":"2024-09-17T01:59:39.815878+0000","last_clean":"2024-09-17T01:59:39.815878+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:39.815878+0000","last_undegraded":"2024-09-17T01:59:39.815878+0000","last_fullsized":"2024-09-17T01:59:39.815878+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845801+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:38.845801+0000","last_peered":"2024-09-17T01:59:38.845801+0000","last_clean":"2024-09-17T01:59:38.845801+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:38.845801+0000","last_undegraded":"2024-09-17T01:59:38.845801+0000","last_fullsized":"2024-09-17T01:59:38.845801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369786+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:39.369786+0000","last_peered":"2024-09-17T01:59:39.369786+0000","last_clean":"2024-09-17T01:59:39.369786+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:39.369786+0000","last_undegraded":"2024-09-17T01:59:39.369786+0000","last_fullsized":"2024-09-17T01:59:39.369786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815934+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:39.815934+0000","last_peered":"2024-09-17T01:59:39.815934+0000","last_clean":"2024-09-17T01:59:39.815934+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:39.815934+0000","last_undegraded":"2024-09-17T01:59:39.815934+0000","last_fullsized":"2024-09-17T01:59:39.815934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370594+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:39.370594+0000","last_peered":"2024-09-17T01:59:39.370594+0000","last_clean":"2024-09-17T01:59:39.370594+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:39.370594+0000","last_undegraded":"2024-09-17T01:59:39.370594+0000","last_fullsized":"2024-09-17T01:59:39.370594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":668,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816286+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:39.816286+0000","last_peered":"2024-09-17T01:59:39.816286+0000","last_clean":"2024-09-17T01:59:39.816286+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:39.816286+0000","last_undegraded":"2024-09-17T01:59:39.816286+0000","last_fullsized":"2024-09-17T01:59:39.816286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846369+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:38.846369+0000","last_peered":"2024-09-17T01:59:38.846369+0000","last_clean":"2024-09-17T01:59:38.846369+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:38.846369+0000","last_undegraded":"2024-09-17T01:59:38.846369+0000","last_fullsized":"2024-09-17T01:59:38.846369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1088,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847898+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:38.847898+0000","last_peered":"2024-09-17T01:59:38.847898+0000","last_clean":"2024-09-17T01:59:38.847898+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:38.847898+0000","last_undegraded":"2024-09-17T01:59:38.847898+0000","last_fullsized":"2024-09-17T01:59:38.847898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":268,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815135+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:39.815135+0000","last_peered":"2024-09-17T01:59:39.815135+0000","last_clean":"2024-09-17T01:59:39.815135+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:39.815135+0000","last_undegraded":"2024-09-17T01:59:39.815135+0000","last_fullsized":"2024-09-17T01:59:39.815135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":995,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.853966+0000","last_change":"2024-09-17T01:59:38.853966+0000","last_active":"2024-09-17T01:59:38.853966+0000","last_peered":"2024-09-17T01:59:38.853966+0000","last_clean":"2024-09-17T01:59:38.853966+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T01:59:38.853966+0000","last_undegraded":"2024-09-17T01:59:38.853966+0000","last_fullsized":"2024-09-17T01:59:38.853966+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:28.450891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":92,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369646+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:39.369646+0000","last_peered":"2024-09-17T01:59:39.369646+0000","last_clean":"2024-09-17T01:59:39.369646+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:39.369646+0000","last_undegraded":"2024-09-17T01:59:39.369646+0000","last_fullsized":"2024-09-17T01:59:39.369646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":262,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373162+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:39.373162+0000","last_peered":"2024-09-17T01:59:39.373162+0000","last_clean":"2024-09-17T01:59:39.373162+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:39.373162+0000","last_undegraded":"2024-09-17T01:59:39.373162+0000","last_fullsized":"2024-09-17T01:59:39.373162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":993,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814572+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:39.814572+0000","last_peered":"2024-09-17T01:59:39.814572+0000","last_clean":"2024-09-17T01:59:39.814572+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:39.814572+0000","last_undegraded":"2024-09-17T01:59:39.814572+0000","last_fullsized":"2024-09-17T01:59:39.814572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816828+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:39.816828+0000","last_peered":"2024-09-17T01:59:39.816828+0000","last_clean":"2024-09-17T01:59:39.816828+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:39.816828+0000","last_undegraded":"2024-09-17T01:59:39.816828+0000","last_fullsized":"2024-09-17T01:59:39.816828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814829+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:39.814829+0000","last_peered":"2024-09-17T01:59:39.814829+0000","last_clean":"2024-09-17T01:59:39.814829+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:39.814829+0000","last_undegraded":"2024-09-17T01:59:39.814829+0000","last_fullsized":"2024-09-17T01:59:39.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372340+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:39.372340+0000","last_peered":"2024-09-17T01:59:39.372340+0000","last_clean":"2024-09-17T01:59:39.372340+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:39.372340+0000","last_undegraded":"2024-09-17T01:59:39.372340+0000","last_fullsized":"2024-09-17T01:59:39.372340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.383520+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.383520+0000","last_peered":"2024-09-17T01:59:39.383520+0000","last_clean":"2024-09-17T01:59:39.383520+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.383520+0000","last_undegraded":"2024-09-17T01:59:39.383520+0000","last_fullsized":"2024-09-17T01:59:39.383520+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:16.474037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371571+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:39.371571+0000","last_peered":"2024-09-17T01:59:39.371571+0000","last_clean":"2024-09-17T01:59:39.371571+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:39.371571+0000","last_undegraded":"2024-09-17T01:59:39.371571+0000","last_fullsized":"2024-09-17T01:59:39.371571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1009,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846327+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:38.846327+0000","last_peered":"2024-09-17T01:59:38.846327+0000","last_clean":"2024-09-17T01:59:38.846327+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:38.846327+0000","last_undegraded":"2024-09-17T01:59:38.846327+0000","last_fullsized":"2024-09-17T01:59:38.846327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":352,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847328+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:38.847328+0000","last_peered":"2024-09-17T01:59:38.847328+0000","last_clean":"2024-09-17T01:59:38.847328+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:38.847328+0000","last_undegraded":"2024-09-17T01:59:38.847328+0000","last_fullsized":"2024-09-17T01:59:38.847328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372204+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:39.372204+0000","last_peered":"2024-09-17T01:59:39.372204+0000","last_clean":"2024-09-17T01:59:39.372204+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:39.372204+0000","last_undegraded":"2024-09-17T01:59:39.372204+0000","last_fullsized":"2024-09-17T01:59:39.372204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":239,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370315+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:39.370315+0000","last_peered":"2024-09-17T01:59:39.370315+0000","last_clean":"2024-09-17T01:59:39.370315+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:39.370315+0000","last_undegraded":"2024-09-17T01:59:39.370315+0000","last_fullsized":"2024-09-17T01:59:39.370315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":676,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372065+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:39.372065+0000","last_peered":"2024-09-17T01:59:39.372065+0000","last_clean":"2024-09-17T01:59:39.372065+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:39.372065+0000","last_undegraded":"2024-09-17T01:59:39.372065+0000","last_fullsized":"2024-09-17T01:59:39.372065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815508+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:39.815508+0000","last_peered":"2024-09-17T01:59:39.815508+0000","last_clean":"2024-09-17T01:59:39.815508+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:39.815508+0000","last_undegraded":"2024-09-17T01:59:39.815508+0000","last_fullsized":"2024-09-17T01:59:39.815508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":578,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372510+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:39.372510+0000","last_peered":"2024-09-17T01:59:39.372510+0000","last_clean":"2024-09-17T01:59:39.372510+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:39.372510+0000","last_undegraded":"2024-09-17T01:59:39.372510+0000","last_fullsized":"2024-09-17T01:59:39.372510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814799+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:39.814799+0000","last_peered":"2024-09-17T01:59:39.814799+0000","last_clean":"2024-09-17T01:59:39.814799+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:39.814799+0000","last_undegraded":"2024-09-17T01:59:39.814799+0000","last_fullsized":"2024-09-17T01:59:39.814799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":613,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848233+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:38.848233+0000","last_peered":"2024-09-17T01:59:38.848233+0000","last_clean":"2024-09-17T01:59:38.848233+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:38.848233+0000","last_undegraded":"2024-09-17T01:59:38.848233+0000","last_fullsized":"2024-09-17T01:59:38.848233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369489+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:39.369489+0000","last_peered":"2024-09-17T01:59:39.369489+0000","last_clean":"2024-09-17T01:59:39.369489+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:39.369489+0000","last_undegraded":"2024-09-17T01:59:39.369489+0000","last_fullsized":"2024-09-17T01:59:39.369489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370626+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:39.370626+0000","last_peered":"2024-09-17T01:59:39.370626+0000","last_clean":"2024-09-17T01:59:39.370626+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:39.370626+0000","last_undegraded":"2024-09-17T01:59:39.370626+0000","last_fullsized":"2024-09-17T01:59:39.370626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":526,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370980+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:39.370980+0000","last_peered":"2024-09-17T01:59:39.370980+0000","last_clean":"2024-09-17T01:59:39.370980+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:39.370980+0000","last_undegraded":"2024-09-17T01:59:39.370980+0000","last_fullsized":"2024-09-17T01:59:39.370980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372566+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:39.372566+0000","last_peered":"2024-09-17T01:59:39.372566+0000","last_clean":"2024-09-17T01:59:39.372566+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:39.372566+0000","last_undegraded":"2024-09-17T01:59:39.372566+0000","last_fullsized":"2024-09-17T01:59:39.372566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370139+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:39.370139+0000","last_peered":"2024-09-17T01:59:39.370139+0000","last_clean":"2024-09-17T01:59:39.370139+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:39.370139+0000","last_undegraded":"2024-09-17T01:59:39.370139+0000","last_fullsized":"2024-09-17T01:59:39.370139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":376,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846862+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:38.846862+0000","last_peered":"2024-09-17T01:59:38.846862+0000","last_clean":"2024-09-17T01:59:38.846862+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:38.846862+0000","last_undegraded":"2024-09-17T01:59:38.846862+0000","last_fullsized":"2024-09-17T01:59:38.846862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":714,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816560+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:39.816560+0000","last_peered":"2024-09-17T01:59:39.816560+0000","last_clean":"2024-09-17T01:59:39.816560+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:39.816560+0000","last_undegraded":"2024-09-17T01:59:39.816560+0000","last_fullsized":"2024-09-17T01:59:39.816560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847230+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:38.847230+0000","last_peered":"2024-09-17T01:59:38.847230+0000","last_clean":"2024-09-17T01:59:38.847230+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:38.847230+0000","last_undegraded":"2024-09-17T01:59:38.847230+0000","last_fullsized":"2024-09-17T01:59:38.847230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":616,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814991+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:39.814991+0000","last_peered":"2024-09-17T01:59:39.814991+0000","last_clean":"2024-09-17T01:59:39.814991+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:39.814991+0000","last_undegraded":"2024-09-17T01:59:39.814991+0000","last_fullsized":"2024-09-17T01:59:39.814991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":576,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848443+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:38.848443+0000","last_peered":"2024-09-17T01:59:38.848443+0000","last_clean":"2024-09-17T01:59:38.848443+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:38.848443+0000","last_undegraded":"2024-09-17T01:59:38.848443+0000","last_fullsized":"2024-09-17T01:59:38.848443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369922+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:39.369922+0000","last_peered":"2024-09-17T01:59:39.369922+0000","last_clean":"2024-09-17T01:59:39.369922+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:39.369922+0000","last_undegraded":"2024-09-17T01:59:39.369922+0000","last_fullsized":"2024-09-17T01:59:39.369922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370220+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:39.370220+0000","last_peered":"2024-09-17T01:59:39.370220+0000","last_clean":"2024-09-17T01:59:39.370220+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:39.370220+0000","last_undegraded":"2024-09-17T01:59:39.370220+0000","last_fullsized":"2024-09-17T01:59:39.370220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":621,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846849+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:38.846849+0000","last_peered":"2024-09-17T01:59:38.846849+0000","last_clean":"2024-09-17T01:59:38.846849+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:38.846849+0000","last_undegraded":"2024-09-17T01:59:38.846849+0000","last_fullsized":"2024-09-17T01:59:38.846849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":395,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371531+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:39.371531+0000","last_peered":"2024-09-17T01:59:39.371531+0000","last_clean":"2024-09-17T01:59:39.371531+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:39.371531+0000","last_undegraded":"2024-09-17T01:59:39.371531+0000","last_fullsized":"2024-09-17T01:59:39.371531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847630+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:38.847630+0000","last_peered":"2024-09-17T01:59:38.847630+0000","last_clean":"2024-09-17T01:59:38.847630+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:38.847630+0000","last_undegraded":"2024-09-17T01:59:38.847630+0000","last_fullsized":"2024-09-17T01:59:38.847630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":918,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815216+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:39.815216+0000","last_peered":"2024-09-17T01:59:39.815216+0000","last_clean":"2024-09-17T01:59:39.815216+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:39.815216+0000","last_undegraded":"2024-09-17T01:59:39.815216+0000","last_fullsized":"2024-09-17T01:59:39.815216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847300+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:38.847300+0000","last_peered":"2024-09-17T01:59:38.847300+0000","last_clean":"2024-09-17T01:59:38.847300+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:38.847300+0000","last_undegraded":"2024-09-17T01:59:38.847300+0000","last_fullsized":"2024-09-17T01:59:38.847300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816939+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:39.816939+0000","last_peered":"2024-09-17T01:59:39.816939+0000","last_clean":"2024-09-17T01:59:39.816939+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:39.816939+0000","last_undegraded":"2024-09-17T01:59:39.816939+0000","last_fullsized":"2024-09-17T01:59:39.816939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1011,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815275+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:39.815275+0000","last_peered":"2024-09-17T01:59:39.815275+0000","last_clean":"2024-09-17T01:59:39.815275+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:39.815275+0000","last_undegraded":"2024-09-17T01:59:39.815275+0000","last_fullsized":"2024-09-17T01:59:39.815275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848885+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:38.848885+0000","last_peered":"2024-09-17T01:59:38.848885+0000","last_clean":"2024-09-17T01:59:38.848885+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:38.848885+0000","last_undegraded":"2024-09-17T01:59:38.848885+0000","last_fullsized":"2024-09-17T01:59:38.848885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848216+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:38.848216+0000","last_peered":"2024-09-17T01:59:38.848216+0000","last_clean":"2024-09-17T01:59:38.848216+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:38.848216+0000","last_undegraded":"2024-09-17T01:59:38.848216+0000","last_fullsized":"2024-09-17T01:59:38.848216+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":985,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845970+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:38.845970+0000","last_peered":"2024-09-17T01:59:38.845970+0000","last_clean":"2024-09-17T01:59:38.845970+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:38.845970+0000","last_undegraded":"2024-09-17T01:59:38.845970+0000","last_fullsized":"2024-09-17T01:59:38.845970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":308,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848091+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:38.848091+0000","last_peered":"2024-09-17T01:59:38.848091+0000","last_clean":"2024-09-17T01:59:38.848091+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:38.848091+0000","last_undegraded":"2024-09-17T01:59:38.848091+0000","last_fullsized":"2024-09-17T01:59:38.848091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372405+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:39.372405+0000","last_peered":"2024-09-17T01:59:39.372405+0000","last_clean":"2024-09-17T01:59:39.372405+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:39.372405+0000","last_undegraded":"2024-09-17T01:59:39.372405+0000","last_fullsized":"2024-09-17T01:59:39.372405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1045,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814833+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:39.814833+0000","last_peered":"2024-09-17T01:59:39.814833+0000","last_clean":"2024-09-17T01:59:39.814833+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:39.814833+0000","last_undegraded":"2024-09-17T01:59:39.814833+0000","last_fullsized":"2024-09-17T01:59:39.814833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371068+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:39.371068+0000","last_peered":"2024-09-17T01:59:39.371068+0000","last_clean":"2024-09-17T01:59:39.371068+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:39.371068+0000","last_undegraded":"2024-09-17T01:59:39.371068+0000","last_fullsized":"2024-09-17T01:59:39.371068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":437,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371283+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:39.371283+0000","last_peered":"2024-09-17T01:59:39.371283+0000","last_clean":"2024-09-17T01:59:39.371283+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:39.371283+0000","last_undegraded":"2024-09-17T01:59:39.371283+0000","last_fullsized":"2024-09-17T01:59:39.371283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846003+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:38.846003+0000","last_peered":"2024-09-17T01:59:38.846003+0000","last_clean":"2024-09-17T01:59:38.846003+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:38.846003+0000","last_undegraded":"2024-09-17T01:59:38.846003+0000","last_fullsized":"2024-09-17T01:59:38.846003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":276,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816765+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:39.816765+0000","last_peered":"2024-09-17T01:59:39.816765+0000","last_clean":"2024-09-17T01:59:39.816765+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:39.816765+0000","last_undegraded":"2024-09-17T01:59:39.816765+0000","last_fullsized":"2024-09-17T01:59:39.816765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":331,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372283+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:39.372283+0000","last_peered":"2024-09-17T01:59:39.372283+0000","last_clean":"2024-09-17T01:59:39.372283+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:39.372283+0000","last_undegraded":"2024-09-17T01:59:39.372283+0000","last_fullsized":"2024-09-17T01:59:39.372283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845951+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:38.845951+0000","last_peered":"2024-09-17T01:59:38.845951+0000","last_clean":"2024-09-17T01:59:38.845951+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:38.845951+0000","last_undegraded":"2024-09-17T01:59:38.845951+0000","last_fullsized":"2024-09-17T01:59:38.845951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848690+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:38.848690+0000","last_peered":"2024-09-17T01:59:38.848690+0000","last_clean":"2024-09-17T01:59:38.848690+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:38.848690+0000","last_undegraded":"2024-09-17T01:59:38.848690+0000","last_fullsized":"2024-09-17T01:59:38.848690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":697,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845779+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:38.845779+0000","last_peered":"2024-09-17T01:59:38.845779+0000","last_clean":"2024-09-17T01:59:38.845779+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:38.845779+0000","last_undegraded":"2024-09-17T01:59:38.845779+0000","last_fullsized":"2024-09-17T01:59:38.845779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":883,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817405+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:39.817405+0000","last_peered":"2024-09-17T01:59:39.817405+0000","last_clean":"2024-09-17T01:59:39.817405+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:39.817405+0000","last_undegraded":"2024-09-17T01:59:39.817405+0000","last_fullsized":"2024-09-17T01:59:39.817405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":808,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846084+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:38.846084+0000","last_peered":"2024-09-17T01:59:38.846084+0000","last_clean":"2024-09-17T01:59:38.846084+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:38.846084+0000","last_undegraded":"2024-09-17T01:59:38.846084+0000","last_fullsized":"2024-09-17T01:59:38.846084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":966,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847264+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:38.847264+0000","last_peered":"2024-09-17T01:59:38.847264+0000","last_clean":"2024-09-17T01:59:38.847264+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:38.847264+0000","last_undegraded":"2024-09-17T01:59:38.847264+0000","last_fullsized":"2024-09-17T01:59:38.847264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":396,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846283+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:38.846283+0000","last_peered":"2024-09-17T01:59:38.846283+0000","last_clean":"2024-09-17T01:59:38.846283+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:38.846283+0000","last_undegraded":"2024-09-17T01:59:38.846283+0000","last_fullsized":"2024-09-17T01:59:38.846283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":938,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816205+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:39.816205+0000","last_peered":"2024-09-17T01:59:39.816205+0000","last_clean":"2024-09-17T01:59:39.816205+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:39.816205+0000","last_undegraded":"2024-09-17T01:59:39.816205+0000","last_fullsized":"2024-09-17T01:59:39.816205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":453,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816163+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:39.816163+0000","last_peered":"2024-09-17T01:59:39.816163+0000","last_clean":"2024-09-17T01:59:39.816163+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:39.816163+0000","last_undegraded":"2024-09-17T01:59:39.816163+0000","last_fullsized":"2024-09-17T01:59:39.816163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815645+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:39.815645+0000","last_peered":"2024-09-17T01:59:39.815645+0000","last_clean":"2024-09-17T01:59:39.815645+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:39.815645+0000","last_undegraded":"2024-09-17T01:59:39.815645+0000","last_fullsized":"2024-09-17T01:59:39.815645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":242,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815559+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:39.815559+0000","last_peered":"2024-09-17T01:59:39.815559+0000","last_clean":"2024-09-17T01:59:39.815559+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:39.815559+0000","last_undegraded":"2024-09-17T01:59:39.815559+0000","last_fullsized":"2024-09-17T01:59:39.815559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371045+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:39.371045+0000","last_peered":"2024-09-17T01:59:39.371045+0000","last_clean":"2024-09-17T01:59:39.371045+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:39.371045+0000","last_undegraded":"2024-09-17T01:59:39.371045+0000","last_fullsized":"2024-09-17T01:59:39.371045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":300,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371238+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:39.371238+0000","last_peered":"2024-09-17T01:59:39.371238+0000","last_clean":"2024-09-17T01:59:39.371238+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:39.371238+0000","last_undegraded":"2024-09-17T01:59:39.371238+0000","last_fullsized":"2024-09-17T01:59:39.371238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":555,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370671+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:39.370671+0000","last_peered":"2024-09-17T01:59:39.370671+0000","last_clean":"2024-09-17T01:59:39.370671+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:39.370671+0000","last_undegraded":"2024-09-17T01:59:39.370671+0000","last_fullsized":"2024-09-17T01:59:39.370671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":467,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816469+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:39.816469+0000","last_peered":"2024-09-17T01:59:39.816469+0000","last_clean":"2024-09-17T01:59:39.816469+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:39.816469+0000","last_undegraded":"2024-09-17T01:59:39.816469+0000","last_fullsized":"2024-09-17T01:59:39.816469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815795+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:39.815795+0000","last_peered":"2024-09-17T01:59:39.815795+0000","last_clean":"2024-09-17T01:59:39.815795+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:39.815795+0000","last_undegraded":"2024-09-17T01:59:39.815795+0000","last_fullsized":"2024-09-17T01:59:39.815795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847916+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:38.847916+0000","last_peered":"2024-09-17T01:59:38.847916+0000","last_clean":"2024-09-17T01:59:38.847916+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:38.847916+0000","last_undegraded":"2024-09-17T01:59:38.847916+0000","last_fullsized":"2024-09-17T01:59:38.847916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":681,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370445+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:39.370445+0000","last_peered":"2024-09-17T01:59:39.370445+0000","last_clean":"2024-09-17T01:59:39.370445+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:39.370445+0000","last_undegraded":"2024-09-17T01:59:39.370445+0000","last_fullsized":"2024-09-17T01:59:39.370445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":251,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848527+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:38.848527+0000","last_peered":"2024-09-17T01:59:38.848527+0000","last_clean":"2024-09-17T01:59:38.848527+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:38.848527+0000","last_undegraded":"2024-09-17T01:59:38.848527+0000","last_fullsized":"2024-09-17T01:59:38.848527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678025,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54076,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317764,"statfs":{"total":96636764160,"available":96581390336,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95300,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276540,"statfs":{"total":96636764160,"available":96539176960,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91924,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279916,"statfs":{"total":96636764160,"available":96542633984,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:46.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:59:46.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:46.420 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":103,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:59:38.834602+0000","last_up_change":"2024-09-17T01:59:07.188980+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":51,"up_from":71,"up_thru":102,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6801","nonce":3415443736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6803","nonce":3415443736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6807","nonce":3415443736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6805","nonce":3415443736}]},"public_addr":"172.21.15.154:6801/3415443736","cluster_addr":"172.21.15.154:6803/3415443736","heartbeat_back_addr":"172.21.15.154:6807/3415443736","heartbeat_front_addr":"172.21.15.154:6805/3415443736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":51}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:59:47.441 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T01:59:47.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:59:47.609 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:59:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:59:47.609 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:59:47.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T01:59:47.913 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T01:59:47.933 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T01:59:47.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:59:48.082 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:59:48.082 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:59:48.082 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:59:48.099 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T01:59:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T01:59:48.410 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T01:59:48.411 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:59:48.554 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T01:59:48.554 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T01:59:48.554 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T01:59:48.569 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T01:59:48.846 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T01:59:48.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:59:49.163 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T01:59:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T01:59:49.180 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-09-17T01:59:48.101025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33131,"ondisk_log_size":33131,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241300,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874220,"statfs":{"total":289910292480,"available":289663201280,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-187,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003235"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":673,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817263+0000","last_change":"2024-09-17T01:54:45.099229+0000","last_active":"2024-09-17T01:59:39.817263+0000","last_peered":"2024-09-17T01:59:39.817263+0000","last_clean":"2024-09-17T01:59:39.817263+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:39.817263+0000","last_undegraded":"2024-09-17T01:59:39.817263+0000","last_fullsized":"2024-09-17T01:59:39.817263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":666,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816042+0000","last_change":"2024-09-17T01:54:45.100814+0000","last_active":"2024-09-17T01:59:39.816042+0000","last_peered":"2024-09-17T01:59:39.816042+0000","last_clean":"2024-09-17T01:59:39.816042+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:39.816042+0000","last_undegraded":"2024-09-17T01:59:39.816042+0000","last_fullsized":"2024-09-17T01:59:39.816042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:16.653612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":522,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373076+0000","last_change":"2024-09-17T01:59:27.351257+0000","last_active":"2024-09-17T01:59:39.373076+0000","last_peered":"2024-09-17T01:59:39.373076+0000","last_clean":"2024-09-17T01:59:39.373076+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:39.373076+0000","last_undegraded":"2024-09-17T01:59:39.373076+0000","last_fullsized":"2024-09-17T01:59:39.373076+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:21.202622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371523+0000","last_change":"2024-09-17T01:59:27.349975+0000","last_active":"2024-09-17T01:59:39.371523+0000","last_peered":"2024-09-17T01:59:39.371523+0000","last_clean":"2024-09-17T01:59:39.371523+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:39.371523+0000","last_undegraded":"2024-09-17T01:59:39.371523+0000","last_fullsized":"2024-09-17T01:59:39.371523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.872856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":671,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815612+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:39.815612+0000","last_peered":"2024-09-17T01:59:39.815612+0000","last_clean":"2024-09-17T01:59:39.815612+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:39.815612+0000","last_undegraded":"2024-09-17T01:59:39.815612+0000","last_fullsized":"2024-09-17T01:59:39.815612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.601922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":579,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370865+0000","last_change":"2024-09-17T01:59:30.374760+0000","last_active":"2024-09-17T01:59:39.370865+0000","last_peered":"2024-09-17T01:59:39.370865+0000","last_clean":"2024-09-17T01:59:39.370865+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:39.370865+0000","last_undegraded":"2024-09-17T01:59:39.370865+0000","last_fullsized":"2024-09-17T01:59:39.370865+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.303767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":691,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370541+0000","last_change":"2024-09-17T01:59:17.346026+0000","last_active":"2024-09-17T01:59:39.370541+0000","last_peered":"2024-09-17T01:59:39.370541+0000","last_clean":"2024-09-17T01:59:39.370541+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T01:59:39.370541+0000","last_undegraded":"2024-09-17T01:59:39.370541+0000","last_fullsized":"2024-09-17T01:59:39.370541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.164801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":532,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370148+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:39.370148+0000","last_peered":"2024-09-17T01:59:39.370148+0000","last_clean":"2024-09-17T01:59:39.370148+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:39.370148+0000","last_undegraded":"2024-09-17T01:59:39.370148+0000","last_fullsized":"2024-09-17T01:59:39.370148+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:14.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":631,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847975+0000","last_change":"2024-09-17T01:54:45.107887+0000","last_active":"2024-09-17T01:59:38.847975+0000","last_peered":"2024-09-17T01:59:38.847975+0000","last_clean":"2024-09-17T01:59:38.847975+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:38.847975+0000","last_undegraded":"2024-09-17T01:59:38.847975+0000","last_fullsized":"2024-09-17T01:59:38.847975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":597,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816331+0000","last_change":"2024-09-17T01:54:45.098996+0000","last_active":"2024-09-17T01:59:39.816331+0000","last_peered":"2024-09-17T01:59:39.816331+0000","last_clean":"2024-09-17T01:59:39.816331+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:39.816331+0000","last_undegraded":"2024-09-17T01:59:39.816331+0000","last_fullsized":"2024-09-17T01:59:39.816331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:20.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":539,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372935+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:39.372935+0000","last_peered":"2024-09-17T01:59:39.372935+0000","last_clean":"2024-09-17T01:59:39.372935+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:39.372935+0000","last_undegraded":"2024-09-17T01:59:39.372935+0000","last_fullsized":"2024-09-17T01:59:39.372935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:46.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":880,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815542+0000","last_change":"2024-09-17T01:59:20.833632+0000","last_active":"2024-09-17T01:59:39.815542+0000","last_peered":"2024-09-17T01:59:39.815542+0000","last_clean":"2024-09-17T01:59:39.815542+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:39.815542+0000","last_undegraded":"2024-09-17T01:59:39.815542+0000","last_fullsized":"2024-09-17T01:59:39.815542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:33.359219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":573,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815154+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:39.815154+0000","last_peered":"2024-09-17T01:59:39.815154+0000","last_clean":"2024-09-17T01:59:39.815154+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:39.815154+0000","last_undegraded":"2024-09-17T01:59:39.815154+0000","last_fullsized":"2024-09-17T01:59:39.815154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.474387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369932+0000","last_change":"2024-09-17T01:59:32.347552+0000","last_active":"2024-09-17T01:59:39.369932+0000","last_peered":"2024-09-17T01:59:39.369932+0000","last_clean":"2024-09-17T01:59:39.369932+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:39.369932+0000","last_undegraded":"2024-09-17T01:59:39.369932+0000","last_fullsized":"2024-09-17T01:59:39.369932+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:36.972154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":593,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370356+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:39.370356+0000","last_peered":"2024-09-17T01:59:39.370356+0000","last_clean":"2024-09-17T01:59:39.370356+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:39.370356+0000","last_undegraded":"2024-09-17T01:59:39.370356+0000","last_fullsized":"2024-09-17T01:59:39.370356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:23.796419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":641,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370488+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370488+0000","last_peered":"2024-09-17T01:59:39.370488+0000","last_clean":"2024-09-17T01:59:39.370488+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370488+0000","last_undegraded":"2024-09-17T01:59:39.370488+0000","last_fullsized":"2024-09-17T01:59:39.370488+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:01.620359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848873+0000","last_change":"2024-09-17T01:54:45.102212+0000","last_active":"2024-09-17T01:59:38.848873+0000","last_peered":"2024-09-17T01:59:38.848873+0000","last_clean":"2024-09-17T01:59:38.848873+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T01:59:38.848873+0000","last_undegraded":"2024-09-17T01:59:38.848873+0000","last_fullsized":"2024-09-17T01:59:38.848873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:40.458203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816722+0000","last_change":"2024-09-17T01:54:45.088752+0000","last_active":"2024-09-17T01:59:39.816722+0000","last_peered":"2024-09-17T01:59:39.816722+0000","last_clean":"2024-09-17T01:59:39.816722+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T01:59:39.816722+0000","last_undegraded":"2024-09-17T01:59:39.816722+0000","last_fullsized":"2024-09-17T01:59:39.816722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":678,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846746+0000","last_change":"2024-09-17T01:56:31.411224+0000","last_active":"2024-09-17T01:59:38.846746+0000","last_peered":"2024-09-17T01:59:38.846746+0000","last_clean":"2024-09-17T01:59:38.846746+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:38.846746+0000","last_undegraded":"2024-09-17T01:59:38.846746+0000","last_fullsized":"2024-09-17T01:59:38.846746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:43.415843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":693,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371863+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:39.371863+0000","last_peered":"2024-09-17T01:59:39.371863+0000","last_clean":"2024-09-17T01:59:39.371863+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:39.371863+0000","last_undegraded":"2024-09-17T01:59:39.371863+0000","last_fullsized":"2024-09-17T01:59:39.371863+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:06.327090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":559,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371338+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:39.371338+0000","last_peered":"2024-09-17T01:59:39.371338+0000","last_clean":"2024-09-17T01:59:39.371338+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:39.371338+0000","last_undegraded":"2024-09-17T01:59:39.371338+0000","last_fullsized":"2024-09-17T01:59:39.371338+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:20.423069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814954+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:39.814954+0000","last_peered":"2024-09-17T01:59:39.814954+0000","last_clean":"2024-09-17T01:59:39.814954+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:39.814954+0000","last_undegraded":"2024-09-17T01:59:39.814954+0000","last_fullsized":"2024-09-17T01:59:39.814954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:42.840086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1077,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845648+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:38.845648+0000","last_peered":"2024-09-17T01:59:38.845648+0000","last_clean":"2024-09-17T01:59:38.845648+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:38.845648+0000","last_undegraded":"2024-09-17T01:59:38.845648+0000","last_fullsized":"2024-09-17T01:59:38.845648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.097324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814494+0000","last_change":"2024-09-17T01:54:45.096628+0000","last_active":"2024-09-17T01:59:39.814494+0000","last_peered":"2024-09-17T01:59:39.814494+0000","last_clean":"2024-09-17T01:59:39.814494+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T01:59:39.814494+0000","last_undegraded":"2024-09-17T01:59:39.814494+0000","last_fullsized":"2024-09-17T01:59:39.814494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:58.540803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817370+0000","last_change":"2024-09-17T01:59:13.831484+0000","last_active":"2024-09-17T01:59:39.817370+0000","last_peered":"2024-09-17T01:59:39.817370+0000","last_clean":"2024-09-17T01:59:39.817370+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T01:59:39.817370+0000","last_undegraded":"2024-09-17T01:59:39.817370+0000","last_fullsized":"2024-09-17T01:59:39.817370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:42.485607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847567+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:38.847567+0000","last_peered":"2024-09-17T01:59:38.847567+0000","last_clean":"2024-09-17T01:59:38.847567+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:38.847567+0000","last_undegraded":"2024-09-17T01:59:38.847567+0000","last_fullsized":"2024-09-17T01:59:38.847567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:38.959129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":565,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372723+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:39.372723+0000","last_peered":"2024-09-17T01:59:39.372723+0000","last_clean":"2024-09-17T01:59:39.372723+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:39.372723+0000","last_undegraded":"2024-09-17T01:59:39.372723+0000","last_fullsized":"2024-09-17T01:59:39.372723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:46.493325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":969,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815988+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:39.815988+0000","last_peered":"2024-09-17T01:59:39.815988+0000","last_clean":"2024-09-17T01:59:39.815988+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:39.815988+0000","last_undegraded":"2024-09-17T01:59:39.815988+0000","last_fullsized":"2024-09-17T01:59:39.815988+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:23.180488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":618,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846785+0000","last_change":"2024-09-17T01:54:45.103761+0000","last_active":"2024-09-17T01:59:38.846785+0000","last_peered":"2024-09-17T01:59:38.846785+0000","last_clean":"2024-09-17T01:59:38.846785+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:38.846785+0000","last_undegraded":"2024-09-17T01:59:38.846785+0000","last_fullsized":"2024-09-17T01:59:38.846785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:08.137716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1059,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815878+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:39.815878+0000","last_peered":"2024-09-17T01:59:39.815878+0000","last_clean":"2024-09-17T01:59:39.815878+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:39.815878+0000","last_undegraded":"2024-09-17T01:59:39.815878+0000","last_fullsized":"2024-09-17T01:59:39.815878+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:45.987754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845801+0000","last_change":"2024-09-17T01:54:45.099234+0000","last_active":"2024-09-17T01:59:38.845801+0000","last_peered":"2024-09-17T01:59:38.845801+0000","last_clean":"2024-09-17T01:59:38.845801+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T01:59:38.845801+0000","last_undegraded":"2024-09-17T01:59:38.845801+0000","last_fullsized":"2024-09-17T01:59:38.845801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:28.822570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369786+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:39.369786+0000","last_peered":"2024-09-17T01:59:39.369786+0000","last_clean":"2024-09-17T01:59:39.369786+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:39.369786+0000","last_undegraded":"2024-09-17T01:59:39.369786+0000","last_fullsized":"2024-09-17T01:59:39.369786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:01.909106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815934+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:39.815934+0000","last_peered":"2024-09-17T01:59:39.815934+0000","last_clean":"2024-09-17T01:59:39.815934+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:39.815934+0000","last_undegraded":"2024-09-17T01:59:39.815934+0000","last_fullsized":"2024-09-17T01:59:39.815934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'465","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370594+0000","last_change":"2024-09-17T01:59:11.775848+0000","last_active":"2024-09-17T01:59:39.370594+0000","last_peered":"2024-09-17T01:59:39.370594+0000","last_clean":"2024-09-17T01:59:39.370594+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T01:59:39.370594+0000","last_undegraded":"2024-09-17T01:59:39.370594+0000","last_fullsized":"2024-09-17T01:59:39.370594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.154984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":668,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816286+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:39.816286+0000","last_peered":"2024-09-17T01:59:39.816286+0000","last_clean":"2024-09-17T01:59:39.816286+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:39.816286+0000","last_undegraded":"2024-09-17T01:59:39.816286+0000","last_fullsized":"2024-09-17T01:59:39.816286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:22.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846369+0000","last_change":"2024-09-17T01:59:08.270613+0000","last_active":"2024-09-17T01:59:38.846369+0000","last_peered":"2024-09-17T01:59:38.846369+0000","last_clean":"2024-09-17T01:59:38.846369+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:38.846369+0000","last_undegraded":"2024-09-17T01:59:38.846369+0000","last_fullsized":"2024-09-17T01:59:38.846369+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:32.345783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1088,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847898+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:38.847898+0000","last_peered":"2024-09-17T01:59:38.847898+0000","last_clean":"2024-09-17T01:59:38.847898+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:38.847898+0000","last_undegraded":"2024-09-17T01:59:38.847898+0000","last_fullsized":"2024-09-17T01:59:38.847898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:10.372033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":268,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815135+0000","last_change":"2024-09-17T01:59:08.269318+0000","last_active":"2024-09-17T01:59:39.815135+0000","last_peered":"2024-09-17T01:59:39.815135+0000","last_clean":"2024-09-17T01:59:39.815135+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:39.815135+0000","last_undegraded":"2024-09-17T01:59:39.815135+0000","last_fullsized":"2024-09-17T01:59:39.815135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:09.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":995,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.853966+0000","last_change":"2024-09-17T01:59:38.853966+0000","last_active":"2024-09-17T01:59:38.853966+0000","last_peered":"2024-09-17T01:59:38.853966+0000","last_clean":"2024-09-17T01:59:38.853966+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T01:59:38.853966+0000","last_undegraded":"2024-09-17T01:59:38.853966+0000","last_fullsized":"2024-09-17T01:59:38.853966+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:28.450891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":92,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369646+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:39.369646+0000","last_peered":"2024-09-17T01:59:39.369646+0000","last_clean":"2024-09-17T01:59:39.369646+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:39.369646+0000","last_undegraded":"2024-09-17T01:59:39.369646+0000","last_fullsized":"2024-09-17T01:59:39.369646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.561539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":262,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373162+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:39.373162+0000","last_peered":"2024-09-17T01:59:39.373162+0000","last_clean":"2024-09-17T01:59:39.373162+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:39.373162+0000","last_undegraded":"2024-09-17T01:59:39.373162+0000","last_fullsized":"2024-09-17T01:59:39.373162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.848675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":993,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814572+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:39.814572+0000","last_peered":"2024-09-17T01:59:39.814572+0000","last_clean":"2024-09-17T01:59:39.814572+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:39.814572+0000","last_undegraded":"2024-09-17T01:59:39.814572+0000","last_fullsized":"2024-09-17T01:59:39.814572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:14.613516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"64'264","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816828+0000","last_change":"2024-09-17T01:59:11.252632+0000","last_active":"2024-09-17T01:59:39.816828+0000","last_peered":"2024-09-17T01:59:39.816828+0000","last_clean":"2024-09-17T01:59:39.816828+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T01:59:39.816828+0000","last_undegraded":"2024-09-17T01:59:39.816828+0000","last_fullsized":"2024-09-17T01:59:39.816828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:49.043160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814829+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:39.814829+0000","last_peered":"2024-09-17T01:59:39.814829+0000","last_clean":"2024-09-17T01:59:39.814829+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:39.814829+0000","last_undegraded":"2024-09-17T01:59:39.814829+0000","last_fullsized":"2024-09-17T01:59:39.814829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:33.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'568","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372340+0000","last_change":"2024-09-17T01:59:11.773245+0000","last_active":"2024-09-17T01:59:39.372340+0000","last_peered":"2024-09-17T01:59:39.372340+0000","last_clean":"2024-09-17T01:59:39.372340+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T01:59:39.372340+0000","last_undegraded":"2024-09-17T01:59:39.372340+0000","last_fullsized":"2024-09-17T01:59:39.372340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:41.899638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.383520+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.383520+0000","last_peered":"2024-09-17T01:59:39.383520+0000","last_clean":"2024-09-17T01:59:39.383520+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.383520+0000","last_undegraded":"2024-09-17T01:59:39.383520+0000","last_fullsized":"2024-09-17T01:59:39.383520+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:16.474037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371571+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:39.371571+0000","last_peered":"2024-09-17T01:59:39.371571+0000","last_clean":"2024-09-17T01:59:39.371571+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:39.371571+0000","last_undegraded":"2024-09-17T01:59:39.371571+0000","last_fullsized":"2024-09-17T01:59:39.371571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:52.151039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1009,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846327+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:38.846327+0000","last_peered":"2024-09-17T01:59:38.846327+0000","last_clean":"2024-09-17T01:59:38.846327+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:38.846327+0000","last_undegraded":"2024-09-17T01:59:38.846327+0000","last_fullsized":"2024-09-17T01:59:38.846327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"64'155","reported_seq":352,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847328+0000","last_change":"2024-09-17T01:59:11.254737+0000","last_active":"2024-09-17T01:59:38.847328+0000","last_peered":"2024-09-17T01:59:38.847328+0000","last_clean":"2024-09-17T01:59:38.847328+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T01:59:38.847328+0000","last_undegraded":"2024-09-17T01:59:38.847328+0000","last_fullsized":"2024-09-17T01:59:38.847328+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:11.211811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372204+0000","last_change":"2024-09-17T01:59:25.357671+0000","last_active":"2024-09-17T01:59:39.372204+0000","last_peered":"2024-09-17T01:59:39.372204+0000","last_clean":"2024-09-17T01:59:39.372204+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:39.372204+0000","last_undegraded":"2024-09-17T01:59:39.372204+0000","last_fullsized":"2024-09-17T01:59:39.372204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:05.628224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"64'131","reported_seq":239,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370315+0000","last_change":"2024-09-17T01:59:12.342025+0000","last_active":"2024-09-17T01:59:39.370315+0000","last_peered":"2024-09-17T01:59:39.370315+0000","last_clean":"2024-09-17T01:59:39.370315+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:39.370315+0000","last_undegraded":"2024-09-17T01:59:39.370315+0000","last_fullsized":"2024-09-17T01:59:39.370315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:26.220821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":676,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372065+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:39.372065+0000","last_peered":"2024-09-17T01:59:39.372065+0000","last_clean":"2024-09-17T01:59:39.372065+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:39.372065+0000","last_undegraded":"2024-09-17T01:59:39.372065+0000","last_fullsized":"2024-09-17T01:59:39.372065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:31.946850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815508+0000","last_change":"2024-09-17T01:59:08.269650+0000","last_active":"2024-09-17T01:59:39.815508+0000","last_peered":"2024-09-17T01:59:39.815508+0000","last_clean":"2024-09-17T01:59:39.815508+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:39.815508+0000","last_undegraded":"2024-09-17T01:59:39.815508+0000","last_fullsized":"2024-09-17T01:59:39.815508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:55.210268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":578,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372510+0000","last_change":"2024-09-17T01:59:17.346489+0000","last_active":"2024-09-17T01:59:39.372510+0000","last_peered":"2024-09-17T01:59:39.372510+0000","last_clean":"2024-09-17T01:59:39.372510+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T01:59:39.372510+0000","last_undegraded":"2024-09-17T01:59:39.372510+0000","last_fullsized":"2024-09-17T01:59:39.372510+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:24.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":636,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814799+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:39.814799+0000","last_peered":"2024-09-17T01:59:39.814799+0000","last_clean":"2024-09-17T01:59:39.814799+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:39.814799+0000","last_undegraded":"2024-09-17T01:59:39.814799+0000","last_fullsized":"2024-09-17T01:59:39.814799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:28.518121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":613,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848233+0000","last_change":"2024-09-17T01:54:45.107831+0000","last_active":"2024-09-17T01:59:38.848233+0000","last_peered":"2024-09-17T01:59:38.848233+0000","last_clean":"2024-09-17T01:59:38.848233+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:38.848233+0000","last_undegraded":"2024-09-17T01:59:38.848233+0000","last_fullsized":"2024-09-17T01:59:38.848233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:58.247483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":281,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369489+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:39.369489+0000","last_peered":"2024-09-17T01:59:39.369489+0000","last_clean":"2024-09-17T01:59:39.369489+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:39.369489+0000","last_undegraded":"2024-09-17T01:59:39.369489+0000","last_fullsized":"2024-09-17T01:59:39.369489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:30.911628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370626+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:39.370626+0000","last_peered":"2024-09-17T01:59:39.370626+0000","last_clean":"2024-09-17T01:59:39.370626+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:39.370626+0000","last_undegraded":"2024-09-17T01:59:39.370626+0000","last_fullsized":"2024-09-17T01:59:39.370626+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:58.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":526,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370980+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:39.370980+0000","last_peered":"2024-09-17T01:59:39.370980+0000","last_clean":"2024-09-17T01:59:39.370980+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:39.370980+0000","last_undegraded":"2024-09-17T01:59:39.370980+0000","last_fullsized":"2024-09-17T01:59:39.370980+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:59.225510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372566+0000","last_change":"2024-09-17T01:59:31.388121+0000","last_active":"2024-09-17T01:59:39.372566+0000","last_peered":"2024-09-17T01:59:39.372566+0000","last_clean":"2024-09-17T01:59:39.372566+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:39.372566+0000","last_undegraded":"2024-09-17T01:59:39.372566+0000","last_fullsized":"2024-09-17T01:59:39.372566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:04.377867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370139+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:39.370139+0000","last_peered":"2024-09-17T01:59:39.370139+0000","last_clean":"2024-09-17T01:59:39.370139+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:39.370139+0000","last_undegraded":"2024-09-17T01:59:39.370139+0000","last_fullsized":"2024-09-17T01:59:39.370139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:50.297614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"64'121","reported_seq":376,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846862+0000","last_change":"2024-09-17T01:59:11.256009+0000","last_active":"2024-09-17T01:59:38.846862+0000","last_peered":"2024-09-17T01:59:38.846862+0000","last_clean":"2024-09-17T01:59:38.846862+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T01:59:38.846862+0000","last_undegraded":"2024-09-17T01:59:38.846862+0000","last_fullsized":"2024-09-17T01:59:38.846862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:22.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":714,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816560+0000","last_change":"2024-09-17T01:54:45.097577+0000","last_active":"2024-09-17T01:59:39.816560+0000","last_peered":"2024-09-17T01:59:39.816560+0000","last_clean":"2024-09-17T01:59:39.816560+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:39.816560+0000","last_undegraded":"2024-09-17T01:59:39.816560+0000","last_fullsized":"2024-09-17T01:59:39.816560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:57.008912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847230+0000","last_change":"2024-09-17T01:54:42.044490+0000","last_active":"2024-09-17T01:59:38.847230+0000","last_peered":"2024-09-17T01:59:38.847230+0000","last_clean":"2024-09-17T01:59:38.847230+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T01:59:38.847230+0000","last_undegraded":"2024-09-17T01:59:38.847230+0000","last_fullsized":"2024-09-17T01:59:38.847230+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:45.104103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"64'418","reported_seq":616,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814991+0000","last_change":"2024-09-17T01:59:11.252687+0000","last_active":"2024-09-17T01:59:39.814991+0000","last_peered":"2024-09-17T01:59:39.814991+0000","last_clean":"2024-09-17T01:59:39.814991+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T01:59:39.814991+0000","last_undegraded":"2024-09-17T01:59:39.814991+0000","last_fullsized":"2024-09-17T01:59:39.814991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:45.342560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":576,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848443+0000","last_change":"2024-09-17T01:54:45.104653+0000","last_active":"2024-09-17T01:59:38.848443+0000","last_peered":"2024-09-17T01:59:38.848443+0000","last_clean":"2024-09-17T01:59:38.848443+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:38.848443+0000","last_undegraded":"2024-09-17T01:59:38.848443+0000","last_fullsized":"2024-09-17T01:59:38.848443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:58.013945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369922+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:39.369922+0000","last_peered":"2024-09-17T01:59:39.369922+0000","last_clean":"2024-09-17T01:59:39.369922+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:39.369922+0000","last_undegraded":"2024-09-17T01:59:39.369922+0000","last_fullsized":"2024-09-17T01:59:39.369922+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:46.091341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370220+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:39.370220+0000","last_peered":"2024-09-17T01:59:39.370220+0000","last_clean":"2024-09-17T01:59:39.370220+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:39.370220+0000","last_undegraded":"2024-09-17T01:59:39.370220+0000","last_fullsized":"2024-09-17T01:59:39.370220+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:53.503034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":621,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846849+0000","last_change":"2024-09-17T01:54:45.103707+0000","last_active":"2024-09-17T01:59:38.846849+0000","last_peered":"2024-09-17T01:59:38.846849+0000","last_clean":"2024-09-17T01:59:38.846849+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:38.846849+0000","last_undegraded":"2024-09-17T01:59:38.846849+0000","last_fullsized":"2024-09-17T01:59:38.846849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:20.629157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'285","reported_seq":395,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371531+0000","last_change":"2024-09-17T01:59:11.779056+0000","last_active":"2024-09-17T01:59:39.371531+0000","last_peered":"2024-09-17T01:59:39.371531+0000","last_clean":"2024-09-17T01:59:39.371531+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T01:59:39.371531+0000","last_undegraded":"2024-09-17T01:59:39.371531+0000","last_fullsized":"2024-09-17T01:59:39.371531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:15.583781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847630+0000","last_change":"2024-09-17T01:54:42.044517+0000","last_active":"2024-09-17T01:59:38.847630+0000","last_peered":"2024-09-17T01:59:38.847630+0000","last_clean":"2024-09-17T01:59:38.847630+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T01:59:38.847630+0000","last_undegraded":"2024-09-17T01:59:38.847630+0000","last_fullsized":"2024-09-17T01:59:38.847630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:00.181900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":918,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815216+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:39.815216+0000","last_peered":"2024-09-17T01:59:39.815216+0000","last_clean":"2024-09-17T01:59:39.815216+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:39.815216+0000","last_undegraded":"2024-09-17T01:59:39.815216+0000","last_fullsized":"2024-09-17T01:59:39.815216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:38.270616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847300+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:38.847300+0000","last_peered":"2024-09-17T01:59:38.847300+0000","last_clean":"2024-09-17T01:59:38.847300+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:38.847300+0000","last_undegraded":"2024-09-17T01:59:38.847300+0000","last_fullsized":"2024-09-17T01:59:38.847300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:22.672344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816939+0000","last_change":"2024-09-17T01:54:42.077587+0000","last_active":"2024-09-17T01:59:39.816939+0000","last_peered":"2024-09-17T01:59:39.816939+0000","last_clean":"2024-09-17T01:59:39.816939+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T01:59:39.816939+0000","last_undegraded":"2024-09-17T01:59:39.816939+0000","last_fullsized":"2024-09-17T01:59:39.816939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:27.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1011,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815275+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:39.815275+0000","last_peered":"2024-09-17T01:59:39.815275+0000","last_clean":"2024-09-17T01:59:39.815275+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:39.815275+0000","last_undegraded":"2024-09-17T01:59:39.815275+0000","last_fullsized":"2024-09-17T01:59:39.815275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.191854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848885+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:38.848885+0000","last_peered":"2024-09-17T01:59:38.848885+0000","last_clean":"2024-09-17T01:59:38.848885+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:38.848885+0000","last_undegraded":"2024-09-17T01:59:38.848885+0000","last_fullsized":"2024-09-17T01:59:38.848885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:31.565841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848216+0000","last_change":"2024-09-17T01:54:42.044930+0000","last_active":"2024-09-17T01:59:38.848216+0000","last_peered":"2024-09-17T01:59:38.848216+0000","last_clean":"2024-09-17T01:59:38.848216+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T01:59:38.848216+0000","last_undegraded":"2024-09-17T01:59:38.848216+0000","last_fullsized":"2024-09-17T01:59:38.848216+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:43.592594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":985,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845970+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:38.845970+0000","last_peered":"2024-09-17T01:59:38.845970+0000","last_clean":"2024-09-17T01:59:38.845970+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:38.845970+0000","last_undegraded":"2024-09-17T01:59:38.845970+0000","last_fullsized":"2024-09-17T01:59:38.845970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:39.936818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'113","reported_seq":308,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848091+0000","last_change":"2024-09-17T01:59:08.317366+0000","last_active":"2024-09-17T01:59:38.848091+0000","last_peered":"2024-09-17T01:59:38.848091+0000","last_clean":"2024-09-17T01:59:38.848091+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:38.848091+0000","last_undegraded":"2024-09-17T01:59:38.848091+0000","last_fullsized":"2024-09-17T01:59:38.848091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.700048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372405+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:39.372405+0000","last_peered":"2024-09-17T01:59:39.372405+0000","last_clean":"2024-09-17T01:59:39.372405+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:39.372405+0000","last_undegraded":"2024-09-17T01:59:39.372405+0000","last_fullsized":"2024-09-17T01:59:39.372405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:37.249888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1045,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814833+0000","last_change":"2024-09-17T01:59:17.820698+0000","last_active":"2024-09-17T01:59:39.814833+0000","last_peered":"2024-09-17T01:59:39.814833+0000","last_clean":"2024-09-17T01:59:39.814833+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:39.814833+0000","last_undegraded":"2024-09-17T01:59:39.814833+0000","last_fullsized":"2024-09-17T01:59:39.814833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.703849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":614,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371068+0000","last_change":"2024-09-17T01:59:12.345305+0000","last_active":"2024-09-17T01:59:39.371068+0000","last_peered":"2024-09-17T01:59:39.371068+0000","last_clean":"2024-09-17T01:59:39.371068+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:39.371068+0000","last_undegraded":"2024-09-17T01:59:39.371068+0000","last_fullsized":"2024-09-17T01:59:39.371068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:10.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":437,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371283+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:39.371283+0000","last_peered":"2024-09-17T01:59:39.371283+0000","last_clean":"2024-09-17T01:59:39.371283+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:39.371283+0000","last_undegraded":"2024-09-17T01:59:39.371283+0000","last_fullsized":"2024-09-17T01:59:39.371283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":670,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846003+0000","last_change":"2024-09-17T01:54:45.104725+0000","last_active":"2024-09-17T01:59:38.846003+0000","last_peered":"2024-09-17T01:59:38.846003+0000","last_clean":"2024-09-17T01:59:38.846003+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:38.846003+0000","last_undegraded":"2024-09-17T01:59:38.846003+0000","last_fullsized":"2024-09-17T01:59:38.846003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.908512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"64'82","reported_seq":276,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816765+0000","last_change":"2024-09-17T01:59:08.278090+0000","last_active":"2024-09-17T01:59:39.816765+0000","last_peered":"2024-09-17T01:59:39.816765+0000","last_clean":"2024-09-17T01:59:39.816765+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:39.816765+0000","last_undegraded":"2024-09-17T01:59:39.816765+0000","last_fullsized":"2024-09-17T01:59:39.816765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:19.606421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"64'221","reported_seq":331,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372283+0000","last_change":"2024-09-17T01:59:11.778882+0000","last_active":"2024-09-17T01:59:39.372283+0000","last_peered":"2024-09-17T01:59:39.372283+0000","last_clean":"2024-09-17T01:59:39.372283+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T01:59:39.372283+0000","last_undegraded":"2024-09-17T01:59:39.372283+0000","last_fullsized":"2024-09-17T01:59:39.372283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:49.654927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845951+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:38.845951+0000","last_peered":"2024-09-17T01:59:38.845951+0000","last_clean":"2024-09-17T01:59:38.845951+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:38.845951+0000","last_undegraded":"2024-09-17T01:59:38.845951+0000","last_fullsized":"2024-09-17T01:59:38.845951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:59.521748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848690+0000","last_change":"2024-09-17T01:59:08.265550+0000","last_active":"2024-09-17T01:59:38.848690+0000","last_peered":"2024-09-17T01:59:38.848690+0000","last_clean":"2024-09-17T01:59:38.848690+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:38.848690+0000","last_undegraded":"2024-09-17T01:59:38.848690+0000","last_fullsized":"2024-09-17T01:59:38.848690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:39.554325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":697,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845779+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:38.845779+0000","last_peered":"2024-09-17T01:59:38.845779+0000","last_clean":"2024-09-17T01:59:38.845779+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:38.845779+0000","last_undegraded":"2024-09-17T01:59:38.845779+0000","last_fullsized":"2024-09-17T01:59:38.845779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:37.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":883,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817405+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:39.817405+0000","last_peered":"2024-09-17T01:59:39.817405+0000","last_clean":"2024-09-17T01:59:39.817405+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:39.817405+0000","last_undegraded":"2024-09-17T01:59:39.817405+0000","last_fullsized":"2024-09-17T01:59:39.817405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:24.830503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":808,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846084+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:38.846084+0000","last_peered":"2024-09-17T01:59:38.846084+0000","last_clean":"2024-09-17T01:59:38.846084+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:38.846084+0000","last_undegraded":"2024-09-17T01:59:38.846084+0000","last_fullsized":"2024-09-17T01:59:38.846084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:51.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":966,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847264+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:38.847264+0000","last_peered":"2024-09-17T01:59:38.847264+0000","last_clean":"2024-09-17T01:59:38.847264+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:38.847264+0000","last_undegraded":"2024-09-17T01:59:38.847264+0000","last_fullsized":"2024-09-17T01:59:38.847264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:31.267683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"64'200","reported_seq":396,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846283+0000","last_change":"2024-09-17T01:59:11.253177+0000","last_active":"2024-09-17T01:59:38.846283+0000","last_peered":"2024-09-17T01:59:38.846283+0000","last_clean":"2024-09-17T01:59:38.846283+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:38.846283+0000","last_undegraded":"2024-09-17T01:59:38.846283+0000","last_fullsized":"2024-09-17T01:59:38.846283+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:04.188052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":939,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816336+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:39.816336+0000","last_peered":"2024-09-17T01:59:39.816336+0000","last_clean":"2024-09-17T01:59:39.816336+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:39.816336+0000","last_undegraded":"2024-09-17T01:59:39.816336+0000","last_fullsized":"2024-09-17T01:59:39.816336+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:09.252905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":454,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816289+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:39.816289+0000","last_peered":"2024-09-17T01:59:39.816289+0000","last_clean":"2024-09-17T01:59:39.816289+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:39.816289+0000","last_undegraded":"2024-09-17T01:59:39.816289+0000","last_fullsized":"2024-09-17T01:59:39.816289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:49.425985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815784+0000","last_change":"2024-09-17T01:54:45.087881+0000","last_active":"2024-09-17T01:59:39.815784+0000","last_peered":"2024-09-17T01:59:39.815784+0000","last_clean":"2024-09-17T01:59:39.815784+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T01:59:39.815784+0000","last_undegraded":"2024-09-17T01:59:39.815784+0000","last_fullsized":"2024-09-17T01:59:39.815784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:28.101930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"64'53","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815708+0000","last_change":"2024-09-17T01:59:08.263799+0000","last_active":"2024-09-17T01:59:39.815708+0000","last_peered":"2024-09-17T01:59:39.815708+0000","last_clean":"2024-09-17T01:59:39.815708+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:39.815708+0000","last_undegraded":"2024-09-17T01:59:39.815708+0000","last_fullsized":"2024-09-17T01:59:39.815708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:04.053999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":635,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371045+0000","last_change":"2024-09-17T01:59:19.350865+0000","last_active":"2024-09-17T01:59:39.371045+0000","last_peered":"2024-09-17T01:59:39.371045+0000","last_clean":"2024-09-17T01:59:39.371045+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T01:59:39.371045+0000","last_undegraded":"2024-09-17T01:59:39.371045+0000","last_fullsized":"2024-09-17T01:59:39.371045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:45.680253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"64'183","reported_seq":300,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371238+0000","last_change":"2024-09-17T01:59:12.342591+0000","last_active":"2024-09-17T01:59:39.371238+0000","last_peered":"2024-09-17T01:59:39.371238+0000","last_clean":"2024-09-17T01:59:39.371238+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:39.371238+0000","last_undegraded":"2024-09-17T01:59:39.371238+0000","last_fullsized":"2024-09-17T01:59:39.371238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.775927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":555,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370671+0000","last_change":"2024-09-17T01:59:28.352261+0000","last_active":"2024-09-17T01:59:39.370671+0000","last_peered":"2024-09-17T01:59:39.370671+0000","last_clean":"2024-09-17T01:59:39.370671+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:39.370671+0000","last_undegraded":"2024-09-17T01:59:39.370671+0000","last_fullsized":"2024-09-17T01:59:39.370671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:58.049036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"64'272","reported_seq":468,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816597+0000","last_change":"2024-09-17T01:59:11.252145+0000","last_active":"2024-09-17T01:59:39.816597+0000","last_peered":"2024-09-17T01:59:39.816597+0000","last_clean":"2024-09-17T01:59:39.816597+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:39.816597+0000","last_undegraded":"2024-09-17T01:59:39.816597+0000","last_fullsized":"2024-09-17T01:59:39.816597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:13.062853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":689,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815795+0000","last_change":"2024-09-17T01:54:45.097658+0000","last_active":"2024-09-17T01:59:39.815795+0000","last_peered":"2024-09-17T01:59:39.815795+0000","last_clean":"2024-09-17T01:59:39.815795+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:39.815795+0000","last_undegraded":"2024-09-17T01:59:39.815795+0000","last_fullsized":"2024-09-17T01:59:39.815795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:24:02.831812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847916+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:38.847916+0000","last_peered":"2024-09-17T01:59:38.847916+0000","last_clean":"2024-09-17T01:59:38.847916+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:38.847916+0000","last_undegraded":"2024-09-17T01:59:38.847916+0000","last_fullsized":"2024-09-17T01:59:38.847916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:25.167474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":681,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370445+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:39.370445+0000","last_peered":"2024-09-17T01:59:39.370445+0000","last_clean":"2024-09-17T01:59:39.370445+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:39.370445+0000","last_undegraded":"2024-09-17T01:59:39.370445+0000","last_fullsized":"2024-09-17T01:59:39.370445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:27:35.090399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"64'60","reported_seq":251,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848527+0000","last_change":"2024-09-17T01:59:08.264637+0000","last_active":"2024-09-17T01:59:38.848527+0000","last_peered":"2024-09-17T01:59:38.848527+0000","last_clean":"2024-09-17T01:59:38.848527+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:38.848527+0000","last_undegraded":"2024-09-17T01:59:38.848527+0000","last_fullsized":"2024-09-17T01:59:38.848527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:23.826702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6328,"ondisk_log_size":6328,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678026,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54076,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317764,"statfs":{"total":96636764160,"available":96581390336,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738435,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95300,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276540,"statfs":{"total":96636764160,"available":96539176960,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91924,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279916,"statfs":{"total":96636764160,"available":96542633984,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:59:49.187 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.188 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.189 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.190 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.191 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.192 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T01:54:32.872046+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=32, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.193 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.194 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.195 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.196 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.197 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T01:59:49.198 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T02:00:09.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:00:09.530 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T02:00:09.532 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T02:00:09.549 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-17T02:00:08.107851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33162,"ondisk_log_size":33162,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241288,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874232,"statfs":{"total":289910292480,"available":289663213568,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004159"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":682,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.728068+0000","last_change":"2024-09-17T01:59:53.728130+0000","last_active":"2024-09-17T01:59:53.728068+0000","last_peered":"2024-09-17T01:59:53.728068+0000","last_clean":"2024-09-17T01:59:53.728068+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:53.728068+0000","last_undegraded":"2024-09-17T01:59:53.728068+0000","last_fullsized":"2024-09-17T01:59:53.728068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'415","last_scrub_stamp":"2024-09-17T01:59:53.727858+0000","last_deep_scrub":"64'415","last_deep_scrub_stamp":"2024-09-17T01:59:53.727858+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.727858+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:32.607235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":675,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.724745+0000","last_change":"2024-09-17T01:59:51.724880+0000","last_active":"2024-09-17T01:59:51.724745+0000","last_peered":"2024-09-17T01:59:51.724745+0000","last_clean":"2024-09-17T01:59:51.724745+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:51.724745+0000","last_undegraded":"2024-09-17T01:59:51.724745+0000","last_fullsized":"2024-09-17T01:59:51.724745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T01:59:51.724520+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T01:59:51.724520+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.724520+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:40.155690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":531,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.070997+0000","last_change":"2024-09-17T01:59:53.071054+0000","last_active":"2024-09-17T01:59:53.070997+0000","last_peered":"2024-09-17T01:59:53.070997+0000","last_clean":"2024-09-17T01:59:53.070997+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:53.070997+0000","last_undegraded":"2024-09-17T01:59:53.070997+0000","last_fullsized":"2024-09-17T01:59:53.070997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'358","last_scrub_stamp":"2024-09-17T01:59:53.070778+0000","last_deep_scrub":"64'358","last_deep_scrub_stamp":"2024-09-17T01:59:53.070778+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.070778+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:50.803793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":577,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.116742+0000","last_change":"2024-09-17T01:59:54.116802+0000","last_active":"2024-09-17T01:59:54.116742+0000","last_peered":"2024-09-17T01:59:54.116742+0000","last_clean":"2024-09-17T01:59:54.116742+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:54.116742+0000","last_undegraded":"2024-09-17T01:59:54.116742+0000","last_fullsized":"2024-09-17T01:59:54.116742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'379","last_scrub_stamp":"2024-09-17T01:59:54.116535+0000","last_deep_scrub":"64'379","last_deep_scrub_stamp":"2024-09-17T01:59:54.116535+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.116535+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:14.329186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":672,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:47.122506+0000","last_change":"2024-09-17T01:54:45.087354+0000","last_active":"2024-09-17T01:59:47.122506+0000","last_peered":"2024-09-17T01:59:47.122506+0000","last_clean":"2024-09-17T01:59:47.122506+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T01:59:47.122506+0000","last_undegraded":"2024-09-17T01:59:47.122506+0000","last_fullsized":"2024-09-17T01:59:47.122506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":588,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.051166+0000","last_change":"2024-09-17T01:59:50.051224+0000","last_active":"2024-09-17T01:59:50.051166+0000","last_peered":"2024-09-17T01:59:50.051166+0000","last_clean":"2024-09-17T01:59:50.051166+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:50.051166+0000","last_undegraded":"2024-09-17T01:59:50.051166+0000","last_fullsized":"2024-09-17T01:59:50.051166+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'386","last_scrub_stamp":"2024-09-17T01:59:50.050973+0000","last_deep_scrub":"64'386","last_deep_scrub_stamp":"2024-09-17T01:59:50.050973+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.050973+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:27.064589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":700,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.062689+0000","last_change":"2024-09-17T02:00:01.062750+0000","last_active":"2024-09-17T02:00:01.062689+0000","last_peered":"2024-09-17T02:00:01.062689+0000","last_clean":"2024-09-17T02:00:01.062689+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T02:00:01.062689+0000","last_undegraded":"2024-09-17T02:00:01.062689+0000","last_fullsized":"2024-09-17T02:00:01.062689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'441","last_scrub_stamp":"2024-09-17T02:00:01.062492+0000","last_deep_scrub":"64'441","last_deep_scrub_stamp":"2024-09-17T02:00:01.062492+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.062492+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:16.109299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":533,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370275+0000","last_change":"2024-09-17T01:59:36.358770+0000","last_active":"2024-09-17T01:59:39.370275+0000","last_peered":"2024-09-17T01:59:39.370275+0000","last_clean":"2024-09-17T01:59:39.370275+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T01:59:39.370275+0000","last_undegraded":"2024-09-17T01:59:39.370275+0000","last_fullsized":"2024-09-17T01:59:39.370275+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":640,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:49.869683+0000","last_change":"2024-09-17T01:59:49.869749+0000","last_active":"2024-09-17T01:59:49.869683+0000","last_peered":"2024-09-17T01:59:49.869683+0000","last_clean":"2024-09-17T01:59:49.869683+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:49.869683+0000","last_undegraded":"2024-09-17T01:59:49.869683+0000","last_fullsized":"2024-09-17T01:59:49.869683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'428","last_scrub_stamp":"2024-09-17T01:59:49.869486+0000","last_deep_scrub":"64'428","last_deep_scrub_stamp":"2024-09-17T01:59:49.869486+0000","last_clean_scrub_stamp":"2024-09-17T01:59:49.869486+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:34.674672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":606,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.661778+0000","last_change":"2024-09-17T01:59:55.661844+0000","last_active":"2024-09-17T01:59:55.661778+0000","last_peered":"2024-09-17T01:59:55.661778+0000","last_clean":"2024-09-17T01:59:55.661778+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:55.661778+0000","last_undegraded":"2024-09-17T01:59:55.661778+0000","last_fullsized":"2024-09-17T01:59:55.661778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'390","last_scrub_stamp":"2024-09-17T01:59:55.661554+0000","last_deep_scrub":"64'390","last_deep_scrub_stamp":"2024-09-17T01:59:55.661554+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.661554+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:40:08.638228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":540,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373053+0000","last_change":"2024-09-17T01:59:21.358668+0000","last_active":"2024-09-17T01:59:39.373053+0000","last_peered":"2024-09-17T01:59:39.373053+0000","last_clean":"2024-09-17T01:59:39.373053+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T01:59:39.373053+0000","last_undegraded":"2024-09-17T01:59:39.373053+0000","last_fullsized":"2024-09-17T01:59:39.373053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":889,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:48.748874+0000","last_change":"2024-09-17T01:59:48.748940+0000","last_active":"2024-09-17T01:59:48.748874+0000","last_peered":"2024-09-17T01:59:48.748874+0000","last_clean":"2024-09-17T01:59:48.748874+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:48.748874+0000","last_undegraded":"2024-09-17T01:59:48.748874+0000","last_fullsized":"2024-09-17T01:59:48.748874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'358","last_scrub_stamp":"2024-09-17T01:59:48.748664+0000","last_deep_scrub":"64'358","last_deep_scrub_stamp":"2024-09-17T01:59:48.748664+0000","last_clean_scrub_stamp":"2024-09-17T01:59:48.748664+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:33.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":574,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815326+0000","last_change":"2024-09-17T01:54:45.086837+0000","last_active":"2024-09-17T01:59:39.815326+0000","last_peered":"2024-09-17T01:59:39.815326+0000","last_clean":"2024-09-17T01:59:39.815326+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T01:59:39.815326+0000","last_undegraded":"2024-09-17T01:59:39.815326+0000","last_fullsized":"2024-09-17T01:59:39.815326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.126352+0000","last_change":"2024-09-17T01:59:55.126413+0000","last_active":"2024-09-17T01:59:55.126352+0000","last_peered":"2024-09-17T01:59:55.126352+0000","last_clean":"2024-09-17T01:59:55.126352+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:55.126352+0000","last_undegraded":"2024-09-17T01:59:55.126352+0000","last_fullsized":"2024-09-17T01:59:55.126352+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'435","last_scrub_stamp":"2024-09-17T01:59:55.126138+0000","last_deep_scrub":"64'435","last_deep_scrub_stamp":"2024-09-17T01:59:55.126138+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.126138+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:29.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":594,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370503+0000","last_change":"2024-09-17T01:59:19.354060+0000","last_active":"2024-09-17T01:59:39.370503+0000","last_peered":"2024-09-17T01:59:39.370503+0000","last_clean":"2024-09-17T01:59:39.370503+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T01:59:39.370503+0000","last_undegraded":"2024-09-17T01:59:39.370503+0000","last_fullsized":"2024-09-17T01:59:39.370503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":642,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370648+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370648+0000","last_peered":"2024-09-17T01:59:39.370648+0000","last_clean":"2024-09-17T01:59:39.370648+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370648+0000","last_undegraded":"2024-09-17T01:59:39.370648+0000","last_fullsized":"2024-09-17T01:59:39.370648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":603,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.724651+0000","last_change":"2024-09-17T02:00:01.724714+0000","last_active":"2024-09-17T02:00:01.724651+0000","last_peered":"2024-09-17T02:00:01.724651+0000","last_clean":"2024-09-17T02:00:01.724651+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T02:00:01.724651+0000","last_undegraded":"2024-09-17T02:00:01.724651+0000","last_fullsized":"2024-09-17T02:00:01.724651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'389","last_scrub_stamp":"2024-09-17T02:00:01.724315+0000","last_deep_scrub":"64'389","last_deep_scrub_stamp":"2024-09-17T02:00:01.724315+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.724315+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:03.064141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":632,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.460179+0000","last_change":"2024-09-17T02:00:03.460239+0000","last_active":"2024-09-17T02:00:03.460179+0000","last_peered":"2024-09-17T02:00:03.460179+0000","last_clean":"2024-09-17T02:00:03.460179+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T02:00:03.460179+0000","last_undegraded":"2024-09-17T02:00:03.460179+0000","last_fullsized":"2024-09-17T02:00:03.460179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'399","last_scrub_stamp":"2024-09-17T02:00:03.459975+0000","last_deep_scrub":"64'399","last_deep_scrub_stamp":"2024-09-17T02:00:03.459975+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.459975+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:48.232140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":687,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:48.911467+0000","last_change":"2024-09-17T01:59:48.911621+0000","last_active":"2024-09-17T01:59:48.911467+0000","last_peered":"2024-09-17T01:59:48.911467+0000","last_clean":"2024-09-17T01:59:48.911467+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:48.911467+0000","last_undegraded":"2024-09-17T01:59:48.911467+0000","last_fullsized":"2024-09-17T01:59:48.911467+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'437","last_scrub_stamp":"2024-09-17T01:59:48.911222+0000","last_deep_scrub":"64'437","last_deep_scrub_stamp":"2024-09-17T01:59:48.911222+0000","last_clean_scrub_stamp":"2024-09-17T01:59:48.911222+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:37.342392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":694,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372011+0000","last_change":"2024-09-17T01:59:22.360200+0000","last_active":"2024-09-17T01:59:39.372011+0000","last_peered":"2024-09-17T01:59:39.372011+0000","last_clean":"2024-09-17T01:59:39.372011+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T01:59:39.372011+0000","last_undegraded":"2024-09-17T01:59:39.372011+0000","last_fullsized":"2024-09-17T01:59:39.372011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":560,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371473+0000","last_change":"2024-09-17T01:59:32.351123+0000","last_active":"2024-09-17T01:59:39.371473+0000","last_peered":"2024-09-17T01:59:39.371473+0000","last_clean":"2024-09-17T01:59:39.371473+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T01:59:39.371473+0000","last_undegraded":"2024-09-17T01:59:39.371473+0000","last_fullsized":"2024-09-17T01:59:39.371473+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815733+0000","last_change":"2024-09-17T01:59:27.833729+0000","last_active":"2024-09-17T01:59:39.815733+0000","last_peered":"2024-09-17T01:59:39.815733+0000","last_clean":"2024-09-17T01:59:39.815733+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T01:59:39.815733+0000","last_undegraded":"2024-09-17T01:59:39.815733+0000","last_fullsized":"2024-09-17T01:59:39.815733+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1078,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845800+0000","last_change":"2024-09-17T01:59:15.843887+0000","last_active":"2024-09-17T01:59:38.845800+0000","last_peered":"2024-09-17T01:59:38.845800+0000","last_clean":"2024-09-17T01:59:38.845800+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T01:59:38.845800+0000","last_undegraded":"2024-09-17T01:59:38.845800+0000","last_fullsized":"2024-09-17T01:59:38.845800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.465394+0000","last_change":"2024-09-17T02:00:01.465561+0000","last_active":"2024-09-17T02:00:01.465394+0000","last_peered":"2024-09-17T02:00:01.465394+0000","last_clean":"2024-09-17T02:00:01.465394+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T02:00:01.465394+0000","last_undegraded":"2024-09-17T02:00:01.465394+0000","last_fullsized":"2024-09-17T02:00:01.465394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'444","last_scrub_stamp":"2024-09-17T02:00:01.465159+0000","last_deep_scrub":"64'444","last_deep_scrub_stamp":"2024-09-17T02:00:01.465159+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.465159+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:13.733096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1029,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.495781+0000","last_change":"2024-09-17T02:00:04.495942+0000","last_active":"2024-09-17T02:00:04.495781+0000","last_peered":"2024-09-17T02:00:04.495781+0000","last_clean":"2024-09-17T02:00:04.495781+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T02:00:04.495781+0000","last_undegraded":"2024-09-17T02:00:04.495781+0000","last_fullsized":"2024-09-17T02:00:04.495781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'418","last_scrub_stamp":"2024-09-17T02:00:04.495540+0000","last_deep_scrub":"64'418","last_deep_scrub_stamp":"2024-09-17T02:00:04.495540+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.495540+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:04.935703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1101,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847709+0000","last_change":"2024-09-17T01:59:14.836702+0000","last_active":"2024-09-17T01:59:38.847709+0000","last_peered":"2024-09-17T01:59:38.847709+0000","last_clean":"2024-09-17T01:59:38.847709+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T01:59:38.847709+0000","last_undegraded":"2024-09-17T01:59:38.847709+0000","last_fullsized":"2024-09-17T01:59:38.847709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":566,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372787+0000","last_change":"2024-09-17T01:59:36.368477+0000","last_active":"2024-09-17T01:59:39.372787+0000","last_peered":"2024-09-17T01:59:39.372787+0000","last_clean":"2024-09-17T01:59:39.372787+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T01:59:39.372787+0000","last_undegraded":"2024-09-17T01:59:39.372787+0000","last_fullsized":"2024-09-17T01:59:39.372787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":970,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816123+0000","last_change":"2024-09-17T01:59:22.828298+0000","last_active":"2024-09-17T01:59:39.816123+0000","last_peered":"2024-09-17T01:59:39.816123+0000","last_clean":"2024-09-17T01:59:39.816123+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T01:59:39.816123+0000","last_undegraded":"2024-09-17T01:59:39.816123+0000","last_fullsized":"2024-09-17T01:59:39.816123+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":627,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.805632+0000","last_change":"2024-09-17T01:59:57.805700+0000","last_active":"2024-09-17T01:59:57.805632+0000","last_peered":"2024-09-17T01:59:57.805632+0000","last_clean":"2024-09-17T01:59:57.805632+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:57.805632+0000","last_undegraded":"2024-09-17T01:59:57.805632+0000","last_fullsized":"2024-09-17T01:59:57.805632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'398","last_scrub_stamp":"2024-09-17T01:59:57.805435+0000","last_deep_scrub":"64'398","last_deep_scrub_stamp":"2024-09-17T01:59:57.805435+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.805435+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.291696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1060,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816023+0000","last_change":"2024-09-17T01:59:25.833912+0000","last_active":"2024-09-17T01:59:39.816023+0000","last_peered":"2024-09-17T01:59:39.816023+0000","last_clean":"2024-09-17T01:59:39.816023+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T01:59:39.816023+0000","last_undegraded":"2024-09-17T01:59:39.816023+0000","last_fullsized":"2024-09-17T01:59:39.816023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":688,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.648200+0000","last_change":"2024-09-17T02:00:03.648261+0000","last_active":"2024-09-17T02:00:03.648200+0000","last_peered":"2024-09-17T02:00:03.648200+0000","last_clean":"2024-09-17T02:00:03.648200+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T02:00:03.648200+0000","last_undegraded":"2024-09-17T02:00:03.648200+0000","last_fullsized":"2024-09-17T02:00:03.648200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'446","last_scrub_stamp":"2024-09-17T02:00:03.647994+0000","last_deep_scrub":"64'446","last_deep_scrub_stamp":"2024-09-17T02:00:03.647994+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.647994+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:23.548700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":690,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369934+0000","last_change":"2024-09-17T01:59:24.355941+0000","last_active":"2024-09-17T01:59:39.369934+0000","last_peered":"2024-09-17T01:59:39.369934+0000","last_clean":"2024-09-17T01:59:39.369934+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T01:59:39.369934+0000","last_undegraded":"2024-09-17T01:59:39.369934+0000","last_fullsized":"2024-09-17T01:59:39.369934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":647,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816074+0000","last_change":"2024-09-17T01:54:45.087628+0000","last_active":"2024-09-17T01:59:39.816074+0000","last_peered":"2024-09-17T01:59:39.816074+0000","last_clean":"2024-09-17T01:59:39.816074+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T01:59:39.816074+0000","last_undegraded":"2024-09-17T01:59:39.816074+0000","last_fullsized":"2024-09-17T01:59:39.816074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"103'469","reported_seq":595,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.093777+0000","last_change":"2024-09-17T02:00:04.093852+0000","last_active":"2024-09-17T02:00:04.093777+0000","last_peered":"2024-09-17T02:00:04.093777+0000","last_clean":"2024-09-17T02:00:04.093777+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T02:00:04.093777+0000","last_undegraded":"2024-09-17T02:00:04.093777+0000","last_fullsized":"2024-09-17T02:00:04.093777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'469","last_scrub_stamp":"2024-09-17T02:00:04.093598+0000","last_deep_scrub":"103'469","last_deep_scrub_stamp":"2024-09-17T02:00:04.093598+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.093598+0000","objects_scrubbed":4,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:53.555288+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":669,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.816414+0000","last_change":"2024-09-17T01:54:45.083365+0000","last_active":"2024-09-17T01:59:39.816414+0000","last_peered":"2024-09-17T01:59:39.816414+0000","last_clean":"2024-09-17T01:59:39.816414+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T01:59:39.816414+0000","last_undegraded":"2024-09-17T01:59:39.816414+0000","last_fullsized":"2024-09-17T01:59:39.816414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":252,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.867042+0000","last_change":"2024-09-17T01:59:54.867115+0000","last_active":"2024-09-17T01:59:54.867042+0000","last_peered":"2024-09-17T01:59:54.867042+0000","last_clean":"2024-09-17T01:59:54.867042+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:54.867042+0000","last_undegraded":"2024-09-17T01:59:54.867042+0000","last_fullsized":"2024-09-17T01:59:54.867042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'53","last_scrub_stamp":"2024-09-17T01:59:54.866825+0000","last_deep_scrub":"64'53","last_deep_scrub_stamp":"2024-09-17T01:59:54.866825+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.866825+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:35.320396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1089,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848028+0000","last_change":"2024-09-17T01:59:28.839447+0000","last_active":"2024-09-17T01:59:38.848028+0000","last_peered":"2024-09-17T01:59:38.848028+0000","last_clean":"2024-09-17T01:59:38.848028+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T01:59:38.848028+0000","last_undegraded":"2024-09-17T01:59:38.848028+0000","last_fullsized":"2024-09-17T01:59:38.848028+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":277,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.696024+0000","last_change":"2024-09-17T01:59:52.696089+0000","last_active":"2024-09-17T01:59:52.696024+0000","last_peered":"2024-09-17T01:59:52.696024+0000","last_clean":"2024-09-17T01:59:52.696024+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:52.696024+0000","last_undegraded":"2024-09-17T01:59:52.696024+0000","last_fullsized":"2024-09-17T01:59:52.696024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'79","last_scrub_stamp":"2024-09-17T01:59:52.695828+0000","last_deep_scrub":"64'79","last_deep_scrub_stamp":"2024-09-17T01:59:52.695828+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.695828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:49.909883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":996,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.854802+0000","last_change":"2024-09-17T01:59:38.853966+0000","last_active":"2024-09-17T01:59:38.854802+0000","last_peered":"2024-09-17T01:59:38.854802+0000","last_clean":"2024-09-17T01:59:38.854802+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T01:59:38.854802+0000","last_undegraded":"2024-09-17T01:59:38.854802+0000","last_fullsized":"2024-09-17T01:59:38.854802+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"64'70","reported_seq":93,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369731+0000","last_change":"2024-09-17T01:59:08.788413+0000","last_active":"2024-09-17T01:59:39.369731+0000","last_peered":"2024-09-17T01:59:39.369731+0000","last_clean":"2024-09-17T01:59:39.369731+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T01:59:39.369731+0000","last_undegraded":"2024-09-17T01:59:39.369731+0000","last_fullsized":"2024-09-17T01:59:39.369731+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"64'141","reported_seq":263,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.373290+0000","last_change":"2024-09-17T01:59:11.772785+0000","last_active":"2024-09-17T01:59:39.373290+0000","last_peered":"2024-09-17T01:59:39.373290+0000","last_clean":"2024-09-17T01:59:39.373290+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T01:59:39.373290+0000","last_undegraded":"2024-09-17T01:59:39.373290+0000","last_fullsized":"2024-09-17T01:59:39.373290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":994,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814763+0000","last_change":"2024-09-17T01:59:24.831610+0000","last_active":"2024-09-17T01:59:39.814763+0000","last_peered":"2024-09-17T01:59:39.814763+0000","last_clean":"2024-09-17T01:59:39.814763+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T01:59:39.814763+0000","last_undegraded":"2024-09-17T01:59:39.814763+0000","last_fullsized":"2024-09-17T01:59:39.814763+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"103'266","reported_seq":471,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.510640+0000","last_change":"2024-09-17T02:00:00.510709+0000","last_active":"2024-09-17T02:00:00.510640+0000","last_peered":"2024-09-17T02:00:00.510640+0000","last_clean":"2024-09-17T02:00:00.510640+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T02:00:00.510640+0000","last_undegraded":"2024-09-17T02:00:00.510640+0000","last_fullsized":"2024-09-17T02:00:00.510640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'266","last_scrub_stamp":"2024-09-17T02:00:00.510440+0000","last_deep_scrub":"103'266","last_deep_scrub_stamp":"2024-09-17T02:00:00.510440+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.510440+0000","objects_scrubbed":2,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:58.677924+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":654,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.814985+0000","last_change":"2024-09-17T01:54:45.082812+0000","last_active":"2024-09-17T01:59:39.814985+0000","last_peered":"2024-09-17T01:59:39.814985+0000","last_clean":"2024-09-17T01:59:39.814985+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T01:59:39.814985+0000","last_undegraded":"2024-09-17T01:59:39.814985+0000","last_fullsized":"2024-09-17T01:59:39.814985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"103'570","reported_seq":700,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.114976+0000","last_change":"2024-09-17T02:00:06.115047+0000","last_active":"2024-09-17T02:00:06.114976+0000","last_peered":"2024-09-17T02:00:06.114976+0000","last_clean":"2024-09-17T02:00:06.114976+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T02:00:06.114976+0000","last_undegraded":"2024-09-17T02:00:06.114976+0000","last_fullsized":"2024-09-17T02:00:06.114976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'570","last_scrub_stamp":"2024-09-17T02:00:06.114781+0000","last_deep_scrub":"103'570","last_deep_scrub_stamp":"2024-09-17T02:00:06.114781+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.114781+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:03.355630+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.386910+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.386910+0000","last_peered":"2024-09-17T01:59:39.386910+0000","last_clean":"2024-09-17T01:59:39.386910+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.386910+0000","last_undegraded":"2024-09-17T01:59:39.386910+0000","last_fullsized":"2024-09-17T01:59:39.386910+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371713+0000","last_change":"2024-09-17T01:59:08.782666+0000","last_active":"2024-09-17T01:59:39.371713+0000","last_peered":"2024-09-17T01:59:39.371713+0000","last_clean":"2024-09-17T01:59:39.371713+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T01:59:39.371713+0000","last_undegraded":"2024-09-17T01:59:39.371713+0000","last_fullsized":"2024-09-17T01:59:39.371713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1010,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847143+0000","last_change":"2024-09-17T01:59:19.827253+0000","last_active":"2024-09-17T01:59:38.847143+0000","last_peered":"2024-09-17T01:59:38.847143+0000","last_clean":"2024-09-17T01:59:38.847143+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T01:59:38.847143+0000","last_undegraded":"2024-09-17T01:59:38.847143+0000","last_fullsized":"2024-09-17T01:59:38.847143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"103'158","reported_seq":364,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.746292+0000","last_change":"2024-09-17T02:00:00.746447+0000","last_active":"2024-09-17T02:00:00.746292+0000","last_peered":"2024-09-17T02:00:00.746292+0000","last_clean":"2024-09-17T02:00:00.746292+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T02:00:00.746292+0000","last_undegraded":"2024-09-17T02:00:00.746292+0000","last_fullsized":"2024-09-17T02:00:00.746292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'158","last_scrub_stamp":"2024-09-17T02:00:00.746045+0000","last_deep_scrub":"103'158","last_deep_scrub_stamp":"2024-09-17T02:00:00.746045+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.746045+0000","objects_scrubbed":3,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:45.518209+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":652,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.119385+0000","last_change":"2024-09-17T01:59:56.119443+0000","last_active":"2024-09-17T01:59:56.119385+0000","last_peered":"2024-09-17T01:59:56.119385+0000","last_clean":"2024-09-17T01:59:56.119385+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:56.119385+0000","last_undegraded":"2024-09-17T01:59:56.119385+0000","last_fullsized":"2024-09-17T01:59:56.119385+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'466","last_scrub_stamp":"2024-09-17T01:59:56.119169+0000","last_deep_scrub":"64'466","last_deep_scrub_stamp":"2024-09-17T01:59:56.119169+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.119169+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:10.631435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"103'132","reported_seq":249,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.149814+0000","last_change":"2024-09-17T01:59:58.149880+0000","last_active":"2024-09-17T01:59:58.149814+0000","last_peered":"2024-09-17T01:59:58.149814+0000","last_clean":"2024-09-17T01:59:58.149814+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:58.149814+0000","last_undegraded":"2024-09-17T01:59:58.149814+0000","last_fullsized":"2024-09-17T01:59:58.149814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'132","last_scrub_stamp":"2024-09-17T01:59:58.149596+0000","last_deep_scrub":"103'132","last_deep_scrub_stamp":"2024-09-17T01:59:58.149596+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.149596+0000","objects_scrubbed":1,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:28.659970+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":677,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372203+0000","last_change":"2024-09-17T01:59:34.364359+0000","last_active":"2024-09-17T01:59:39.372203+0000","last_peered":"2024-09-17T01:59:39.372203+0000","last_clean":"2024-09-17T01:59:39.372203+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T01:59:39.372203+0000","last_undegraded":"2024-09-17T01:59:39.372203+0000","last_fullsized":"2024-09-17T01:59:39.372203+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.687592+0000","last_change":"2024-09-17T01:59:54.687658+0000","last_active":"2024-09-17T01:59:54.687592+0000","last_peered":"2024-09-17T01:59:54.687592+0000","last_clean":"2024-09-17T01:59:54.687592+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:54.687592+0000","last_undegraded":"2024-09-17T01:59:54.687592+0000","last_fullsized":"2024-09-17T01:59:54.687592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'52","last_scrub_stamp":"2024-09-17T01:59:54.687392+0000","last_deep_scrub":"64'52","last_deep_scrub_stamp":"2024-09-17T01:59:54.687392+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.687392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:54.574533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":587,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.088899+0000","last_change":"2024-09-17T02:00:03.088958+0000","last_active":"2024-09-17T02:00:03.088899+0000","last_peered":"2024-09-17T02:00:03.088899+0000","last_clean":"2024-09-17T02:00:03.088899+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T02:00:03.088899+0000","last_undegraded":"2024-09-17T02:00:03.088899+0000","last_fullsized":"2024-09-17T02:00:03.088899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'371","last_scrub_stamp":"2024-09-17T02:00:03.088703+0000","last_deep_scrub":"64'371","last_deep_scrub_stamp":"2024-09-17T02:00:03.088703+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.088703+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:46.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"64'454","reported_seq":637,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815137+0000","last_change":"2024-09-17T01:54:44.220667+0000","last_active":"2024-09-17T01:59:39.815137+0000","last_peered":"2024-09-17T01:59:39.815137+0000","last_clean":"2024-09-17T01:59:39.815137+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T01:59:39.815137+0000","last_undegraded":"2024-09-17T01:59:39.815137+0000","last_fullsized":"2024-09-17T01:59:39.815137+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":622,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.835352+0000","last_change":"2024-09-17T01:59:51.835469+0000","last_active":"2024-09-17T01:59:51.835352+0000","last_peered":"2024-09-17T01:59:51.835352+0000","last_clean":"2024-09-17T01:59:51.835352+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:51.835352+0000","last_undegraded":"2024-09-17T01:59:51.835352+0000","last_fullsized":"2024-09-17T01:59:51.835352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'388","last_scrub_stamp":"2024-09-17T01:59:51.835109+0000","last_deep_scrub":"64'388","last_deep_scrub_stamp":"2024-09-17T01:59:51.835109+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.835109+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:17.600426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":282,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.369628+0000","last_change":"2024-09-17T01:59:08.784522+0000","last_active":"2024-09-17T01:59:39.369628+0000","last_peered":"2024-09-17T01:59:39.369628+0000","last_clean":"2024-09-17T01:59:39.369628+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T01:59:39.369628+0000","last_undegraded":"2024-09-17T01:59:39.369628+0000","last_fullsized":"2024-09-17T01:59:39.369628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:32.872046+0000","last_clean_scrub_stamp":"2024-09-17T01:54:32.872046+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370800+0000","last_change":"2024-09-17T01:59:08.787346+0000","last_active":"2024-09-17T01:59:39.370800+0000","last_peered":"2024-09-17T01:59:39.370800+0000","last_clean":"2024-09-17T01:59:39.370800+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T01:59:39.370800+0000","last_undegraded":"2024-09-17T01:59:39.370800+0000","last_fullsized":"2024-09-17T01:59:39.370800+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"64'414","reported_seq":527,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371116+0000","last_change":"2024-09-17T01:59:11.772906+0000","last_active":"2024-09-17T01:59:39.371116+0000","last_peered":"2024-09-17T01:59:39.371116+0000","last_clean":"2024-09-17T01:59:39.371116+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T01:59:39.371116+0000","last_undegraded":"2024-09-17T01:59:39.371116+0000","last_fullsized":"2024-09-17T01:59:39.371116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":610,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.079995+0000","last_change":"2024-09-17T01:59:51.080056+0000","last_active":"2024-09-17T01:59:51.079995+0000","last_peered":"2024-09-17T01:59:51.079995+0000","last_clean":"2024-09-17T01:59:51.079995+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:51.079995+0000","last_undegraded":"2024-09-17T01:59:51.079995+0000","last_fullsized":"2024-09-17T01:59:51.079995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'417","last_scrub_stamp":"2024-09-17T01:59:51.079804+0000","last_deep_scrub":"64'417","last_deep_scrub_stamp":"2024-09-17T01:59:51.079804+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.079804+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:30.364625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370254+0000","last_change":"2024-09-17T01:59:08.790706+0000","last_active":"2024-09-17T01:59:39.370254+0000","last_peered":"2024-09-17T01:59:39.370254+0000","last_clean":"2024-09-17T01:59:39.370254+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T01:59:39.370254+0000","last_undegraded":"2024-09-17T01:59:39.370254+0000","last_fullsized":"2024-09-17T01:59:39.370254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"103'122","reported_seq":386,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.700062+0000","last_change":"2024-09-17T02:00:02.700124+0000","last_active":"2024-09-17T02:00:02.700062+0000","last_peered":"2024-09-17T02:00:02.700062+0000","last_clean":"2024-09-17T02:00:02.700062+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T02:00:02.700062+0000","last_undegraded":"2024-09-17T02:00:02.700062+0000","last_fullsized":"2024-09-17T02:00:02.700062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'122","last_scrub_stamp":"2024-09-17T02:00:02.699876+0000","last_deep_scrub":"103'122","last_deep_scrub_stamp":"2024-09-17T02:00:02.699876+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.699876+0000","objects_scrubbed":1,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:52.853921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":723,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.510088+0000","last_change":"2024-09-17T01:59:59.510153+0000","last_active":"2024-09-17T01:59:59.510088+0000","last_peered":"2024-09-17T01:59:59.510088+0000","last_clean":"2024-09-17T01:59:59.510088+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:59.510088+0000","last_undegraded":"2024-09-17T01:59:59.510088+0000","last_fullsized":"2024-09-17T01:59:59.510088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'475","last_scrub_stamp":"2024-09-17T01:59:59.509881+0000","last_deep_scrub":"64'475","last_deep_scrub_stamp":"2024-09-17T01:59:59.509881+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.509881+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:35.658484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.623647+0000","last_change":"2024-09-17T02:00:06.623755+0000","last_active":"2024-09-17T02:00:06.623647+0000","last_peered":"2024-09-17T02:00:06.623647+0000","last_clean":"2024-09-17T02:00:06.623647+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T02:00:06.623647+0000","last_undegraded":"2024-09-17T02:00:06.623647+0000","last_fullsized":"2024-09-17T02:00:06.623647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:06.623405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:06.623405+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.623405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:22.514703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"103'420","reported_seq":627,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.505363+0000","last_change":"2024-09-17T02:00:02.505511+0000","last_active":"2024-09-17T02:00:02.505363+0000","last_peered":"2024-09-17T02:00:02.505363+0000","last_clean":"2024-09-17T02:00:02.505363+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T02:00:02.505363+0000","last_undegraded":"2024-09-17T02:00:02.505363+0000","last_fullsized":"2024-09-17T02:00:02.505363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'420","last_scrub_stamp":"2024-09-17T02:00:02.505125+0000","last_deep_scrub":"103'420","last_deep_scrub_stamp":"2024-09-17T02:00:02.505125+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.505125+0000","objects_scrubbed":2,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:35.693046+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.860404+0000","last_change":"2024-09-17T01:59:55.860465+0000","last_active":"2024-09-17T01:59:55.860404+0000","last_peered":"2024-09-17T01:59:55.860404+0000","last_clean":"2024-09-17T01:59:55.860404+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:55.860404+0000","last_undegraded":"2024-09-17T01:59:55.860404+0000","last_fullsized":"2024-09-17T01:59:55.860404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'362","last_scrub_stamp":"2024-09-17T01:59:55.860209+0000","last_deep_scrub":"64'362","last_deep_scrub_stamp":"2024-09-17T01:59:55.860209+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.860209+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:09.703402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":107,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370073+0000","last_change":"2024-09-17T01:59:08.792658+0000","last_active":"2024-09-17T01:59:39.370073+0000","last_peered":"2024-09-17T01:59:39.370073+0000","last_clean":"2024-09-17T01:59:39.370073+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T01:59:39.370073+0000","last_undegraded":"2024-09-17T01:59:39.370073+0000","last_fullsized":"2024-09-17T01:59:39.370073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370434+0000","last_change":"2024-09-17T01:59:08.788247+0000","last_active":"2024-09-17T01:59:39.370434+0000","last_peered":"2024-09-17T01:59:39.370434+0000","last_clean":"2024-09-17T01:59:39.370434+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T01:59:39.370434+0000","last_undegraded":"2024-09-17T01:59:39.370434+0000","last_fullsized":"2024-09-17T01:59:39.370434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":630,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.749517+0000","last_change":"2024-09-17T01:59:59.749607+0000","last_active":"2024-09-17T01:59:59.749517+0000","last_peered":"2024-09-17T01:59:59.749517+0000","last_clean":"2024-09-17T01:59:59.749517+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:59.749517+0000","last_undegraded":"2024-09-17T01:59:59.749517+0000","last_fullsized":"2024-09-17T01:59:59.749517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'376","last_scrub_stamp":"2024-09-17T01:59:59.749279+0000","last_deep_scrub":"64'376","last_deep_scrub_stamp":"2024-09-17T01:59:59.749279+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.749279+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:56.283997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"103'286","reported_seq":405,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.132342+0000","last_change":"2024-09-17T02:00:00.132410+0000","last_active":"2024-09-17T02:00:00.132342+0000","last_peered":"2024-09-17T02:00:00.132342+0000","last_clean":"2024-09-17T02:00:00.132342+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T02:00:00.132342+0000","last_undegraded":"2024-09-17T02:00:00.132342+0000","last_fullsized":"2024-09-17T02:00:00.132342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'286","last_scrub_stamp":"2024-09-17T02:00:00.132144+0000","last_deep_scrub":"103'286","last_deep_scrub_stamp":"2024-09-17T02:00:00.132144+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.132144+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:57.742702+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.629000+0000","last_change":"2024-09-17T02:00:05.629129+0000","last_active":"2024-09-17T02:00:05.629000+0000","last_peered":"2024-09-17T02:00:05.629000+0000","last_clean":"2024-09-17T02:00:05.629000+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T02:00:05.629000+0000","last_undegraded":"2024-09-17T02:00:05.629000+0000","last_fullsized":"2024-09-17T02:00:05.629000+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:05.628775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:05.628775+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.628775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:27.681767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":919,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815348+0000","last_change":"2024-09-17T01:59:34.831292+0000","last_active":"2024-09-17T01:59:39.815348+0000","last_peered":"2024-09-17T01:59:39.815348+0000","last_clean":"2024-09-17T01:59:39.815348+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T01:59:39.815348+0000","last_undegraded":"2024-09-17T01:59:39.815348+0000","last_fullsized":"2024-09-17T01:59:39.815348+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":242,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847445+0000","last_change":"2024-09-17T01:54:44.230930+0000","last_active":"2024-09-17T01:59:38.847445+0000","last_peered":"2024-09-17T01:59:38.847445+0000","last_clean":"2024-09-17T01:59:38.847445+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T01:59:38.847445+0000","last_undegraded":"2024-09-17T01:59:38.847445+0000","last_fullsized":"2024-09-17T01:59:38.847445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.566222+0000","last_change":"2024-09-17T02:00:06.566275+0000","last_active":"2024-09-17T02:00:06.566222+0000","last_peered":"2024-09-17T02:00:06.566222+0000","last_clean":"2024-09-17T02:00:06.566222+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T02:00:06.566222+0000","last_undegraded":"2024-09-17T02:00:06.566222+0000","last_fullsized":"2024-09-17T02:00:06.566222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:06.566032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:06.566032+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.566032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:26.466738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1012,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.815411+0000","last_change":"2024-09-17T01:59:21.834309+0000","last_active":"2024-09-17T01:59:39.815411+0000","last_peered":"2024-09-17T01:59:39.815411+0000","last_clean":"2024-09-17T01:59:39.815411+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T01:59:39.815411+0000","last_undegraded":"2024-09-17T01:59:39.815411+0000","last_fullsized":"2024-09-17T01:59:39.815411+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"64'51","reported_seq":235,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.849026+0000","last_change":"2024-09-17T01:54:44.232548+0000","last_active":"2024-09-17T01:59:38.849026+0000","last_peered":"2024-09-17T01:59:38.849026+0000","last_clean":"2024-09-17T01:59:38.849026+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T01:59:38.849026+0000","last_undegraded":"2024-09-17T01:59:38.849026+0000","last_fullsized":"2024-09-17T01:59:38.849026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.617157+0000","last_change":"2024-09-17T02:00:04.617260+0000","last_active":"2024-09-17T02:00:04.617157+0000","last_peered":"2024-09-17T02:00:04.617157+0000","last_clean":"2024-09-17T02:00:04.617157+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T02:00:04.617157+0000","last_undegraded":"2024-09-17T02:00:04.617157+0000","last_fullsized":"2024-09-17T02:00:04.617157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:04.616911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:04.616911+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.616911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:58.497913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":986,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846564+0000","last_change":"2024-09-17T01:59:36.826505+0000","last_active":"2024-09-17T01:59:38.846564+0000","last_peered":"2024-09-17T01:59:38.846564+0000","last_clean":"2024-09-17T01:59:38.846564+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T01:59:38.846564+0000","last_undegraded":"2024-09-17T01:59:38.846564+0000","last_fullsized":"2024-09-17T01:59:38.846564+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"103'114","reported_seq":318,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.855676+0000","last_change":"2024-09-17T01:59:56.855747+0000","last_active":"2024-09-17T01:59:56.855676+0000","last_peered":"2024-09-17T01:59:56.855676+0000","last_clean":"2024-09-17T01:59:56.855676+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:56.855676+0000","last_undegraded":"2024-09-17T01:59:56.855676+0000","last_fullsized":"2024-09-17T01:59:56.855676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'114","last_scrub_stamp":"2024-09-17T01:59:56.855478+0000","last_deep_scrub":"103'114","last_deep_scrub_stamp":"2024-09-17T01:59:56.855478+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.855478+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.886614+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.372553+0000","last_change":"2024-09-17T01:59:08.771516+0000","last_active":"2024-09-17T01:59:39.372553+0000","last_peered":"2024-09-17T01:59:39.372553+0000","last_clean":"2024-09-17T01:59:39.372553+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T01:59:39.372553+0000","last_undegraded":"2024-09-17T01:59:39.372553+0000","last_fullsized":"2024-09-17T01:59:39.372553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:38.990197+0000","last_clean_scrub_stamp":"2024-09-17T01:54:38.990197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1054,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:49.750649+0000","last_change":"2024-09-17T01:59:49.750834+0000","last_active":"2024-09-17T01:59:49.750649+0000","last_peered":"2024-09-17T01:59:49.750649+0000","last_clean":"2024-09-17T01:59:49.750649+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:49.750649+0000","last_undegraded":"2024-09-17T01:59:49.750649+0000","last_fullsized":"2024-09-17T01:59:49.750649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'420","last_scrub_stamp":"2024-09-17T01:59:49.750417+0000","last_deep_scrub":"64'420","last_deep_scrub_stamp":"2024-09-17T01:59:49.750417+0000","last_clean_scrub_stamp":"2024-09-17T01:59:49.750417+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:01.334641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.132518+0000","last_change":"2024-09-17T01:59:59.132577+0000","last_active":"2024-09-17T01:59:59.132518+0000","last_peered":"2024-09-17T01:59:59.132518+0000","last_clean":"2024-09-17T01:59:59.132518+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:59.132518+0000","last_undegraded":"2024-09-17T01:59:59.132518+0000","last_fullsized":"2024-09-17T01:59:59.132518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'397","last_scrub_stamp":"2024-09-17T01:59:59.132325+0000","last_deep_scrub":"64'397","last_deep_scrub_stamp":"2024-09-17T01:59:59.132325+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.132325+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:54.195395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"65'249","reported_seq":438,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.371418+0000","last_change":"2024-09-17T01:59:11.772388+0000","last_active":"2024-09-17T01:59:39.371418+0000","last_peered":"2024-09-17T01:59:39.371418+0000","last_clean":"2024-09-17T01:59:39.371418+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T01:59:39.371418+0000","last_undegraded":"2024-09-17T01:59:39.371418+0000","last_fullsized":"2024-09-17T01:59:39.371418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.837198+0000","last_change":"2024-09-17T01:59:53.837259+0000","last_active":"2024-09-17T01:59:53.837198+0000","last_peered":"2024-09-17T01:59:53.837198+0000","last_clean":"2024-09-17T01:59:53.837198+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:53.837198+0000","last_undegraded":"2024-09-17T01:59:53.837198+0000","last_fullsized":"2024-09-17T01:59:53.837198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'422","last_scrub_stamp":"2024-09-17T01:59:53.836992+0000","last_deep_scrub":"64'422","last_deep_scrub_stamp":"2024-09-17T01:59:53.836992+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.836992+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.243093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"103'84","reported_seq":287,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.649475+0000","last_change":"2024-09-17T01:59:56.649623+0000","last_active":"2024-09-17T01:59:56.649475+0000","last_peered":"2024-09-17T01:59:56.649475+0000","last_clean":"2024-09-17T01:59:56.649475+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:56.649475+0000","last_undegraded":"2024-09-17T01:59:56.649475+0000","last_fullsized":"2024-09-17T01:59:56.649475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'84","last_scrub_stamp":"2024-09-17T01:59:56.649242+0000","last_deep_scrub":"103'84","last_deep_scrub_stamp":"2024-09-17T01:59:56.649242+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.649242+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:17.189578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"103'222","reported_seq":341,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.115856+0000","last_change":"2024-09-17T02:00:02.115920+0000","last_active":"2024-09-17T02:00:02.115856+0000","last_peered":"2024-09-17T02:00:02.115856+0000","last_clean":"2024-09-17T02:00:02.115856+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T02:00:02.115856+0000","last_undegraded":"2024-09-17T02:00:02.115856+0000","last_fullsized":"2024-09-17T02:00:02.115856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'222","last_scrub_stamp":"2024-09-17T02:00:02.115662+0000","last_deep_scrub":"103'222","last_deep_scrub_stamp":"2024-09-17T02:00:02.115662+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.115662+0000","objects_scrubbed":1,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:49.938816+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846086+0000","last_change":"2024-09-17T01:59:32.825038+0000","last_active":"2024-09-17T01:59:38.846086+0000","last_peered":"2024-09-17T01:59:38.846086+0000","last_clean":"2024-09-17T01:59:38.846086+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T01:59:38.846086+0000","last_undegraded":"2024-09-17T01:59:38.846086+0000","last_fullsized":"2024-09-17T01:59:38.846086+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.851026+0000","last_change":"2024-09-17T01:59:52.851087+0000","last_active":"2024-09-17T01:59:52.851026+0000","last_peered":"2024-09-17T01:59:52.851026+0000","last_clean":"2024-09-17T01:59:52.851026+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:52.851026+0000","last_undegraded":"2024-09-17T01:59:52.851026+0000","last_fullsized":"2024-09-17T01:59:52.851026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'51","last_scrub_stamp":"2024-09-17T01:59:52.850833+0000","last_deep_scrub":"64'51","last_deep_scrub_stamp":"2024-09-17T01:59:52.850833+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.850833+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:39.821567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":698,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.845929+0000","last_change":"2024-09-17T01:54:45.097878+0000","last_active":"2024-09-17T01:59:38.845929+0000","last_peered":"2024-09-17T01:59:38.845929+0000","last_clean":"2024-09-17T01:59:38.845929+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T01:59:38.845929+0000","last_undegraded":"2024-09-17T01:59:38.845929+0000","last_fullsized":"2024-09-17T01:59:38.845929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":884,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.817467+0000","last_change":"2024-09-17T01:59:15.840605+0000","last_active":"2024-09-17T01:59:39.817467+0000","last_peered":"2024-09-17T01:59:39.817467+0000","last_clean":"2024-09-17T01:59:39.817467+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T01:59:39.817467+0000","last_undegraded":"2024-09-17T01:59:39.817467+0000","last_fullsized":"2024-09-17T01:59:39.817467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"64'625","reported_seq":809,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.846797+0000","last_change":"2024-09-17T01:54:44.232572+0000","last_active":"2024-09-17T01:59:38.846797+0000","last_peered":"2024-09-17T01:59:38.846797+0000","last_clean":"2024-09-17T01:59:38.846797+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T01:59:38.846797+0000","last_undegraded":"2024-09-17T01:59:38.846797+0000","last_fullsized":"2024-09-17T01:59:38.846797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":967,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.847453+0000","last_change":"2024-09-17T01:59:12.817817+0000","last_active":"2024-09-17T01:59:38.847453+0000","last_peered":"2024-09-17T01:59:38.847453+0000","last_clean":"2024-09-17T01:59:38.847453+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T01:59:38.847453+0000","last_undegraded":"2024-09-17T01:59:38.847453+0000","last_fullsized":"2024-09-17T01:59:38.847453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'201","reported_seq":406,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.812835+0000","last_change":"2024-09-17T01:59:58.812901+0000","last_active":"2024-09-17T01:59:58.812835+0000","last_peered":"2024-09-17T01:59:58.812835+0000","last_clean":"2024-09-17T01:59:58.812835+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:58.812835+0000","last_undegraded":"2024-09-17T01:59:58.812835+0000","last_fullsized":"2024-09-17T01:59:58.812835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'201","last_scrub_stamp":"2024-09-17T01:59:58.812664+0000","last_deep_scrub":"103'201","last_deep_scrub_stamp":"2024-09-17T01:59:58.812664+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.812664+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:52.732876+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":940,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:47.122582+0000","last_change":"2024-09-17T01:59:29.846306+0000","last_active":"2024-09-17T01:59:47.122582+0000","last_peered":"2024-09-17T01:59:47.122582+0000","last_clean":"2024-09-17T01:59:47.122582+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T01:59:47.122582+0000","last_undegraded":"2024-09-17T01:59:47.122582+0000","last_fullsized":"2024-09-17T01:59:47.122582+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"64'272","reported_seq":455,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:47.122462+0000","last_change":"2024-09-17T01:54:44.221682+0000","last_active":"2024-09-17T01:59:47.122462+0000","last_peered":"2024-09-17T01:59:47.122462+0000","last_clean":"2024-09-17T01:59:47.122462+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T01:59:47.122462+0000","last_undegraded":"2024-09-17T01:59:47.122462+0000","last_fullsized":"2024-09-17T01:59:47.122462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":603,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.543590+0000","last_change":"2024-09-17T02:00:05.543661+0000","last_active":"2024-09-17T02:00:05.543590+0000","last_peered":"2024-09-17T02:00:05.543590+0000","last_clean":"2024-09-17T02:00:05.543590+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T02:00:05.543590+0000","last_undegraded":"2024-09-17T02:00:05.543590+0000","last_fullsized":"2024-09-17T02:00:05.543590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T02:00:05.543386+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T02:00:05.543386+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.543386+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.638925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"103'54","reported_seq":253,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.738098+0000","last_change":"2024-09-17T01:59:50.738161+0000","last_active":"2024-09-17T01:59:50.738098+0000","last_peered":"2024-09-17T01:59:50.738098+0000","last_clean":"2024-09-17T01:59:50.738098+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:50.738098+0000","last_undegraded":"2024-09-17T01:59:50.738098+0000","last_fullsized":"2024-09-17T01:59:50.738098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'54","last_scrub_stamp":"2024-09-17T01:59:50.737902+0000","last_deep_scrub":"103'54","last_deep_scrub_stamp":"2024-09-17T01:59:50.737902+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.737902+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:25.079013+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.055987+0000","last_change":"2024-09-17T02:00:05.056048+0000","last_active":"2024-09-17T02:00:05.055987+0000","last_peered":"2024-09-17T02:00:05.055987+0000","last_clean":"2024-09-17T02:00:05.055987+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T02:00:05.055987+0000","last_undegraded":"2024-09-17T02:00:05.055987+0000","last_fullsized":"2024-09-17T02:00:05.055987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'398","last_scrub_stamp":"2024-09-17T02:00:05.055791+0000","last_deep_scrub":"64'398","last_deep_scrub_stamp":"2024-09-17T02:00:05.055791+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.055791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:33.802302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"103'185","reported_seq":311,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.182313+0000","last_change":"2024-09-17T01:59:57.182397+0000","last_active":"2024-09-17T01:59:57.182313+0000","last_peered":"2024-09-17T01:59:57.182313+0000","last_clean":"2024-09-17T01:59:57.182313+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:57.182313+0000","last_undegraded":"2024-09-17T01:59:57.182313+0000","last_fullsized":"2024-09-17T01:59:57.182313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'185","last_scrub_stamp":"2024-09-17T01:59:57.182098+0000","last_deep_scrub":"103'185","last_deep_scrub_stamp":"2024-09-17T01:59:57.182098+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.182098+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:45.383530+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":564,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.097878+0000","last_change":"2024-09-17T01:59:52.097935+0000","last_active":"2024-09-17T01:59:52.097878+0000","last_peered":"2024-09-17T01:59:52.097878+0000","last_clean":"2024-09-17T01:59:52.097878+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:52.097878+0000","last_undegraded":"2024-09-17T01:59:52.097878+0000","last_fullsized":"2024-09-17T01:59:52.097878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T01:59:52.097665+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T01:59:52.097665+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.097665+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:18.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"103'276","reported_seq":481,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.605830+0000","last_change":"2024-09-17T01:59:58.605988+0000","last_active":"2024-09-17T01:59:58.605830+0000","last_peered":"2024-09-17T01:59:58.605830+0000","last_clean":"2024-09-17T01:59:58.605830+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:58.605830+0000","last_undegraded":"2024-09-17T01:59:58.605830+0000","last_fullsized":"2024-09-17T01:59:58.605830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'276","last_scrub_stamp":"2024-09-17T01:59:58.605552+0000","last_deep_scrub":"103'276","last_deep_scrub_stamp":"2024-09-17T01:59:58.605552+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.605552+0000","objects_scrubbed":4,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:12.448745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":698,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.601559+0000","last_change":"2024-09-17T01:59:57.601625+0000","last_active":"2024-09-17T01:59:57.601559+0000","last_peered":"2024-09-17T01:59:57.601559+0000","last_clean":"2024-09-17T01:59:57.601559+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:57.601559+0000","last_undegraded":"2024-09-17T01:59:57.601559+0000","last_fullsized":"2024-09-17T01:59:57.601559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T01:59:57.601357+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T01:59:57.601357+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.601357+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:46.375755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"64'40","reported_seq":224,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:38.848007+0000","last_change":"2024-09-17T01:54:44.232605+0000","last_active":"2024-09-17T01:59:38.848007+0000","last_peered":"2024-09-17T01:59:38.848007+0000","last_clean":"2024-09-17T01:59:38.848007+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T01:59:38.848007+0000","last_undegraded":"2024-09-17T01:59:38.848007+0000","last_fullsized":"2024-09-17T01:59:38.848007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:43.180288+0000","last_clean_scrub_stamp":"2024-09-17T01:54:43.180288+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":682,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370624+0000","last_change":"2024-09-17T01:59:35.354815+0000","last_active":"2024-09-17T01:59:39.370624+0000","last_peered":"2024-09-17T01:59:39.370624+0000","last_clean":"2024-09-17T01:59:39.370624+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T01:59:39.370624+0000","last_undegraded":"2024-09-17T01:59:39.370624+0000","last_fullsized":"2024-09-17T01:59:39.370624+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"103'63","reported_seq":263,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.845638+0000","last_change":"2024-09-17T01:59:50.845705+0000","last_active":"2024-09-17T01:59:50.845638+0000","last_peered":"2024-09-17T01:59:50.845638+0000","last_clean":"2024-09-17T01:59:50.845638+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:50.845638+0000","last_undegraded":"2024-09-17T01:59:50.845638+0000","last_fullsized":"2024-09-17T01:59:50.845638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'63","last_scrub_stamp":"2024-09-17T01:59:50.845456+0000","last_deep_scrub":"103'63","last_deep_scrub_stamp":"2024-09-17T01:59:50.845456+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.845456+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:24.825752+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6359,"ondisk_log_size":6359,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678030,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54072,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317768,"statfs":{"total":96636764160,"available":96581394432,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738439,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95296,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276544,"statfs":{"total":96636764160,"available":96539181056,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91920,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279920,"statfs":{"total":96636764160,"available":96542638080,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:00:09.554 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.554 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.555 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.556 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.557 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T01:54:32.872046+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=32, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.558 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T01:54:38.990197+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.559 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-17T01:54:43.180288+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=43, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.560 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:09.561 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T02:00:29.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:00:29.881 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T02:00:29.883 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T02:00:29.899 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-17T02:00:28.114907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33188,"ondisk_log_size":33188,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241288,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874232,"statfs":{"total":289910292480,"available":289663213568,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004055"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":682,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.728068+0000","last_change":"2024-09-17T01:59:53.728130+0000","last_active":"2024-09-17T01:59:53.728068+0000","last_peered":"2024-09-17T01:59:53.728068+0000","last_clean":"2024-09-17T01:59:53.728068+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:53.728068+0000","last_undegraded":"2024-09-17T01:59:53.728068+0000","last_fullsized":"2024-09-17T01:59:53.728068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'415","last_scrub_stamp":"2024-09-17T01:59:53.727858+0000","last_deep_scrub":"64'415","last_deep_scrub_stamp":"2024-09-17T01:59:53.727858+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.727858+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:32.607235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":675,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.724745+0000","last_change":"2024-09-17T01:59:51.724880+0000","last_active":"2024-09-17T01:59:51.724745+0000","last_peered":"2024-09-17T01:59:51.724745+0000","last_clean":"2024-09-17T01:59:51.724745+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:51.724745+0000","last_undegraded":"2024-09-17T01:59:51.724745+0000","last_fullsized":"2024-09-17T01:59:51.724745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T01:59:51.724520+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T01:59:51.724520+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.724520+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:40.155690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":531,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.070997+0000","last_change":"2024-09-17T01:59:53.071054+0000","last_active":"2024-09-17T01:59:53.070997+0000","last_peered":"2024-09-17T01:59:53.070997+0000","last_clean":"2024-09-17T01:59:53.070997+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:53.070997+0000","last_undegraded":"2024-09-17T01:59:53.070997+0000","last_fullsized":"2024-09-17T01:59:53.070997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'358","last_scrub_stamp":"2024-09-17T01:59:53.070778+0000","last_deep_scrub":"64'358","last_deep_scrub_stamp":"2024-09-17T01:59:53.070778+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.070778+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:50.803793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":577,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.116742+0000","last_change":"2024-09-17T01:59:54.116802+0000","last_active":"2024-09-17T01:59:54.116742+0000","last_peered":"2024-09-17T01:59:54.116742+0000","last_clean":"2024-09-17T01:59:54.116742+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:54.116742+0000","last_undegraded":"2024-09-17T01:59:54.116742+0000","last_fullsized":"2024-09-17T01:59:54.116742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'379","last_scrub_stamp":"2024-09-17T01:59:54.116535+0000","last_deep_scrub":"64'379","last_deep_scrub_stamp":"2024-09-17T01:59:54.116535+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.116535+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:14.329186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":680,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:12.549978+0000","last_change":"2024-09-17T02:00:12.550040+0000","last_active":"2024-09-17T02:00:12.549978+0000","last_peered":"2024-09-17T02:00:12.549978+0000","last_clean":"2024-09-17T02:00:12.549978+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T02:00:12.549978+0000","last_undegraded":"2024-09-17T02:00:12.549978+0000","last_fullsized":"2024-09-17T02:00:12.549978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'440","last_scrub_stamp":"2024-09-17T02:00:12.549776+0000","last_deep_scrub":"64'440","last_deep_scrub_stamp":"2024-09-17T02:00:12.549776+0000","last_clean_scrub_stamp":"2024-09-17T02:00:12.549776+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:31.058644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":588,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.051166+0000","last_change":"2024-09-17T01:59:50.051224+0000","last_active":"2024-09-17T01:59:50.051166+0000","last_peered":"2024-09-17T01:59:50.051166+0000","last_clean":"2024-09-17T01:59:50.051166+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:50.051166+0000","last_undegraded":"2024-09-17T01:59:50.051166+0000","last_fullsized":"2024-09-17T01:59:50.051166+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'386","last_scrub_stamp":"2024-09-17T01:59:50.050973+0000","last_deep_scrub":"64'386","last_deep_scrub_stamp":"2024-09-17T01:59:50.050973+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.050973+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:27.064589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":700,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.062689+0000","last_change":"2024-09-17T02:00:01.062750+0000","last_active":"2024-09-17T02:00:01.062689+0000","last_peered":"2024-09-17T02:00:01.062689+0000","last_clean":"2024-09-17T02:00:01.062689+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T02:00:01.062689+0000","last_undegraded":"2024-09-17T02:00:01.062689+0000","last_fullsized":"2024-09-17T02:00:01.062689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'441","last_scrub_stamp":"2024-09-17T02:00:01.062492+0000","last_deep_scrub":"64'441","last_deep_scrub_stamp":"2024-09-17T02:00:01.062492+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.062492+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:16.109299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":541,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:25.269484+0000","last_change":"2024-09-17T02:00:25.269546+0000","last_active":"2024-09-17T02:00:25.269484+0000","last_peered":"2024-09-17T02:00:25.269484+0000","last_clean":"2024-09-17T02:00:25.269484+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T02:00:25.269484+0000","last_undegraded":"2024-09-17T02:00:25.269484+0000","last_fullsized":"2024-09-17T02:00:25.269484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'376","last_scrub_stamp":"2024-09-17T02:00:25.269290+0000","last_deep_scrub":"64'376","last_deep_scrub_stamp":"2024-09-17T02:00:25.269290+0000","last_clean_scrub_stamp":"2024-09-17T02:00:25.269290+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:49.771937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":640,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:49.869683+0000","last_change":"2024-09-17T01:59:49.869749+0000","last_active":"2024-09-17T01:59:49.869683+0000","last_peered":"2024-09-17T01:59:49.869683+0000","last_clean":"2024-09-17T01:59:49.869683+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:49.869683+0000","last_undegraded":"2024-09-17T01:59:49.869683+0000","last_fullsized":"2024-09-17T01:59:49.869683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'428","last_scrub_stamp":"2024-09-17T01:59:49.869486+0000","last_deep_scrub":"64'428","last_deep_scrub_stamp":"2024-09-17T01:59:49.869486+0000","last_clean_scrub_stamp":"2024-09-17T01:59:49.869486+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:34.674672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":606,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.661778+0000","last_change":"2024-09-17T01:59:55.661844+0000","last_active":"2024-09-17T01:59:55.661778+0000","last_peered":"2024-09-17T01:59:55.661778+0000","last_clean":"2024-09-17T01:59:55.661778+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:55.661778+0000","last_undegraded":"2024-09-17T01:59:55.661778+0000","last_fullsized":"2024-09-17T01:59:55.661778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'390","last_scrub_stamp":"2024-09-17T01:59:55.661554+0000","last_deep_scrub":"64'390","last_deep_scrub_stamp":"2024-09-17T01:59:55.661554+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.661554+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:40:08.638228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":548,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:09.157937+0000","last_change":"2024-09-17T02:00:09.158101+0000","last_active":"2024-09-17T02:00:09.157937+0000","last_peered":"2024-09-17T02:00:09.157937+0000","last_clean":"2024-09-17T02:00:09.157937+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T02:00:09.157937+0000","last_undegraded":"2024-09-17T02:00:09.157937+0000","last_fullsized":"2024-09-17T02:00:09.157937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'361","last_scrub_stamp":"2024-09-17T02:00:09.157698+0000","last_deep_scrub":"64'361","last_deep_scrub_stamp":"2024-09-17T02:00:09.157698+0000","last_clean_scrub_stamp":"2024-09-17T02:00:09.157698+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:32.923395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":889,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:48.748874+0000","last_change":"2024-09-17T01:59:48.748940+0000","last_active":"2024-09-17T01:59:48.748874+0000","last_peered":"2024-09-17T01:59:48.748874+0000","last_clean":"2024-09-17T01:59:48.748874+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:48.748874+0000","last_undegraded":"2024-09-17T01:59:48.748874+0000","last_fullsized":"2024-09-17T01:59:48.748874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'358","last_scrub_stamp":"2024-09-17T01:59:48.748664+0000","last_deep_scrub":"64'358","last_deep_scrub_stamp":"2024-09-17T01:59:48.748664+0000","last_clean_scrub_stamp":"2024-09-17T01:59:48.748664+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:33.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:11.566724+0000","last_change":"2024-09-17T02:00:11.566784+0000","last_active":"2024-09-17T02:00:11.566724+0000","last_peered":"2024-09-17T02:00:11.566724+0000","last_clean":"2024-09-17T02:00:11.566724+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T02:00:11.566724+0000","last_undegraded":"2024-09-17T02:00:11.566724+0000","last_fullsized":"2024-09-17T02:00:11.566724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'392","last_scrub_stamp":"2024-09-17T02:00:11.566522+0000","last_deep_scrub":"64'392","last_deep_scrub_stamp":"2024-09-17T02:00:11.566522+0000","last_clean_scrub_stamp":"2024-09-17T02:00:11.566522+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:34.613422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.126352+0000","last_change":"2024-09-17T01:59:55.126413+0000","last_active":"2024-09-17T01:59:55.126352+0000","last_peered":"2024-09-17T01:59:55.126352+0000","last_clean":"2024-09-17T01:59:55.126352+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:55.126352+0000","last_undegraded":"2024-09-17T01:59:55.126352+0000","last_fullsized":"2024-09-17T01:59:55.126352+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'435","last_scrub_stamp":"2024-09-17T01:59:55.126138+0000","last_deep_scrub":"64'435","last_deep_scrub_stamp":"2024-09-17T01:59:55.126138+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.126138+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:29.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":602,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:07.096806+0000","last_change":"2024-09-17T02:00:07.096866+0000","last_active":"2024-09-17T02:00:07.096806+0000","last_peered":"2024-09-17T02:00:07.096806+0000","last_clean":"2024-09-17T02:00:07.096806+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T02:00:07.096806+0000","last_undegraded":"2024-09-17T02:00:07.096806+0000","last_fullsized":"2024-09-17T02:00:07.096806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'394","last_scrub_stamp":"2024-09-17T02:00:07.096606+0000","last_deep_scrub":"64'394","last_deep_scrub_stamp":"2024-09-17T02:00:07.096606+0000","last_clean_scrub_stamp":"2024-09-17T02:00:07.096606+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:40.968311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":642,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.370648+0000","last_change":"2024-09-17T01:59:38.368114+0000","last_active":"2024-09-17T01:59:39.370648+0000","last_peered":"2024-09-17T01:59:39.370648+0000","last_clean":"2024-09-17T01:59:39.370648+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T01:59:39.370648+0000","last_undegraded":"2024-09-17T01:59:39.370648+0000","last_fullsized":"2024-09-17T01:59:39.370648+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":603,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.724651+0000","last_change":"2024-09-17T02:00:01.724714+0000","last_active":"2024-09-17T02:00:01.724651+0000","last_peered":"2024-09-17T02:00:01.724651+0000","last_clean":"2024-09-17T02:00:01.724651+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T02:00:01.724651+0000","last_undegraded":"2024-09-17T02:00:01.724651+0000","last_fullsized":"2024-09-17T02:00:01.724651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'389","last_scrub_stamp":"2024-09-17T02:00:01.724315+0000","last_deep_scrub":"64'389","last_deep_scrub_stamp":"2024-09-17T02:00:01.724315+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.724315+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:03.064141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":632,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.460179+0000","last_change":"2024-09-17T02:00:03.460239+0000","last_active":"2024-09-17T02:00:03.460179+0000","last_peered":"2024-09-17T02:00:03.460179+0000","last_clean":"2024-09-17T02:00:03.460179+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T02:00:03.460179+0000","last_undegraded":"2024-09-17T02:00:03.460179+0000","last_fullsized":"2024-09-17T02:00:03.460179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'399","last_scrub_stamp":"2024-09-17T02:00:03.459975+0000","last_deep_scrub":"64'399","last_deep_scrub_stamp":"2024-09-17T02:00:03.459975+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.459975+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:48.232140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":687,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:48.911467+0000","last_change":"2024-09-17T01:59:48.911621+0000","last_active":"2024-09-17T01:59:48.911467+0000","last_peered":"2024-09-17T01:59:48.911467+0000","last_clean":"2024-09-17T01:59:48.911467+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:48.911467+0000","last_undegraded":"2024-09-17T01:59:48.911467+0000","last_fullsized":"2024-09-17T01:59:48.911467+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'437","last_scrub_stamp":"2024-09-17T01:59:48.911222+0000","last_deep_scrub":"64'437","last_deep_scrub_stamp":"2024-09-17T01:59:48.911222+0000","last_clean_scrub_stamp":"2024-09-17T01:59:48.911222+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:37.342392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":702,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:11.099623+0000","last_change":"2024-09-17T02:00:11.099684+0000","last_active":"2024-09-17T02:00:11.099623+0000","last_peered":"2024-09-17T02:00:11.099623+0000","last_clean":"2024-09-17T02:00:11.099623+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T02:00:11.099623+0000","last_undegraded":"2024-09-17T02:00:11.099623+0000","last_fullsized":"2024-09-17T02:00:11.099623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'465","last_scrub_stamp":"2024-09-17T02:00:11.099427+0000","last_deep_scrub":"64'465","last_deep_scrub_stamp":"2024-09-17T02:00:11.099427+0000","last_clean_scrub_stamp":"2024-09-17T02:00:11.099427+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:39.012272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:22.224219+0000","last_change":"2024-09-17T02:00:22.224287+0000","last_active":"2024-09-17T02:00:22.224219+0000","last_peered":"2024-09-17T02:00:22.224219+0000","last_clean":"2024-09-17T02:00:22.224219+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T02:00:22.224219+0000","last_undegraded":"2024-09-17T02:00:22.224219+0000","last_fullsized":"2024-09-17T02:00:22.224219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'393","last_scrub_stamp":"2024-09-17T02:00:22.224022+0000","last_deep_scrub":"64'393","last_deep_scrub_stamp":"2024-09-17T02:00:22.224022+0000","last_clean_scrub_stamp":"2024-09-17T02:00:22.224022+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:25.880997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:19.500000+0000","last_change":"2024-09-17T02:00:19.500099+0000","last_active":"2024-09-17T02:00:19.500000+0000","last_peered":"2024-09-17T02:00:19.500000+0000","last_clean":"2024-09-17T02:00:19.500000+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T02:00:19.500000+0000","last_undegraded":"2024-09-17T02:00:19.500000+0000","last_fullsized":"2024-09-17T02:00:19.500000+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'482","last_scrub_stamp":"2024-09-17T02:00:19.499794+0000","last_deep_scrub":"64'482","last_deep_scrub_stamp":"2024-09-17T02:00:19.499794+0000","last_clean_scrub_stamp":"2024-09-17T02:00:19.499794+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:14.616077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1086,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:14.699524+0000","last_change":"2024-09-17T02:00:14.699583+0000","last_active":"2024-09-17T02:00:14.699524+0000","last_peered":"2024-09-17T02:00:14.699524+0000","last_clean":"2024-09-17T02:00:14.699524+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T02:00:14.699524+0000","last_undegraded":"2024-09-17T02:00:14.699524+0000","last_fullsized":"2024-09-17T02:00:14.699524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'438","last_scrub_stamp":"2024-09-17T02:00:14.699325+0000","last_deep_scrub":"64'438","last_deep_scrub_stamp":"2024-09-17T02:00:14.699325+0000","last_clean_scrub_stamp":"2024-09-17T02:00:14.699325+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:08.706354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.465394+0000","last_change":"2024-09-17T02:00:01.465561+0000","last_active":"2024-09-17T02:00:01.465394+0000","last_peered":"2024-09-17T02:00:01.465394+0000","last_clean":"2024-09-17T02:00:01.465394+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T02:00:01.465394+0000","last_undegraded":"2024-09-17T02:00:01.465394+0000","last_fullsized":"2024-09-17T02:00:01.465394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'444","last_scrub_stamp":"2024-09-17T02:00:01.465159+0000","last_deep_scrub":"64'444","last_deep_scrub_stamp":"2024-09-17T02:00:01.465159+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.465159+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:13.733096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1029,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.495781+0000","last_change":"2024-09-17T02:00:04.495942+0000","last_active":"2024-09-17T02:00:04.495781+0000","last_peered":"2024-09-17T02:00:04.495781+0000","last_clean":"2024-09-17T02:00:04.495781+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T02:00:04.495781+0000","last_undegraded":"2024-09-17T02:00:04.495781+0000","last_fullsized":"2024-09-17T02:00:04.495781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'418","last_scrub_stamp":"2024-09-17T02:00:04.495540+0000","last_deep_scrub":"64'418","last_deep_scrub_stamp":"2024-09-17T02:00:04.495540+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.495540+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:04.935703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1109,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:13.664423+0000","last_change":"2024-09-17T02:00:13.664491+0000","last_active":"2024-09-17T02:00:13.664423+0000","last_peered":"2024-09-17T02:00:13.664423+0000","last_clean":"2024-09-17T02:00:13.664423+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T02:00:13.664423+0000","last_undegraded":"2024-09-17T02:00:13.664423+0000","last_fullsized":"2024-09-17T02:00:13.664423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'468","last_scrub_stamp":"2024-09-17T02:00:13.664226+0000","last_deep_scrub":"64'468","last_deep_scrub_stamp":"2024-09-17T02:00:13.664226+0000","last_clean_scrub_stamp":"2024-09-17T02:00:13.664226+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:18.186319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":574,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:26.255984+0000","last_change":"2024-09-17T02:00:26.256046+0000","last_active":"2024-09-17T02:00:26.255984+0000","last_peered":"2024-09-17T02:00:26.255984+0000","last_clean":"2024-09-17T02:00:26.255984+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T02:00:26.255984+0000","last_undegraded":"2024-09-17T02:00:26.255984+0000","last_fullsized":"2024-09-17T02:00:26.255984+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'409","last_scrub_stamp":"2024-09-17T02:00:26.255781+0000","last_deep_scrub":"64'409","last_deep_scrub_stamp":"2024-09-17T02:00:26.255781+0000","last_clean_scrub_stamp":"2024-09-17T02:00:26.255781+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:28.641572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":978,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:16.474818+0000","last_change":"2024-09-17T02:00:16.474878+0000","last_active":"2024-09-17T02:00:16.474818+0000","last_peered":"2024-09-17T02:00:16.474818+0000","last_clean":"2024-09-17T02:00:16.474818+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T02:00:16.474818+0000","last_undegraded":"2024-09-17T02:00:16.474818+0000","last_fullsized":"2024-09-17T02:00:16.474818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'405","last_scrub_stamp":"2024-09-17T02:00:16.474606+0000","last_deep_scrub":"64'405","last_deep_scrub_stamp":"2024-09-17T02:00:16.474606+0000","last_clean_scrub_stamp":"2024-09-17T02:00:16.474606+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:23.817265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":627,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.805632+0000","last_change":"2024-09-17T01:59:57.805700+0000","last_active":"2024-09-17T01:59:57.805632+0000","last_peered":"2024-09-17T01:59:57.805632+0000","last_clean":"2024-09-17T01:59:57.805632+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:57.805632+0000","last_undegraded":"2024-09-17T01:59:57.805632+0000","last_fullsized":"2024-09-17T01:59:57.805632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'398","last_scrub_stamp":"2024-09-17T01:59:57.805435+0000","last_deep_scrub":"64'398","last_deep_scrub_stamp":"2024-09-17T01:59:57.805435+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.805435+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.291696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1068,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:18.532262+0000","last_change":"2024-09-17T02:00:18.532322+0000","last_active":"2024-09-17T02:00:18.532262+0000","last_peered":"2024-09-17T02:00:18.532262+0000","last_clean":"2024-09-17T02:00:18.532262+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T02:00:18.532262+0000","last_undegraded":"2024-09-17T02:00:18.532262+0000","last_fullsized":"2024-09-17T02:00:18.532262+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'449","last_scrub_stamp":"2024-09-17T02:00:18.532054+0000","last_deep_scrub":"64'449","last_deep_scrub_stamp":"2024-09-17T02:00:18.532054+0000","last_clean_scrub_stamp":"2024-09-17T02:00:18.532054+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:37.792682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":688,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.648200+0000","last_change":"2024-09-17T02:00:03.648261+0000","last_active":"2024-09-17T02:00:03.648200+0000","last_peered":"2024-09-17T02:00:03.648200+0000","last_clean":"2024-09-17T02:00:03.648200+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T02:00:03.648200+0000","last_undegraded":"2024-09-17T02:00:03.648200+0000","last_fullsized":"2024-09-17T02:00:03.648200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'446","last_scrub_stamp":"2024-09-17T02:00:03.647994+0000","last_deep_scrub":"64'446","last_deep_scrub_stamp":"2024-09-17T02:00:03.647994+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.647994+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:23.548700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":698,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:21.250268+0000","last_change":"2024-09-17T02:00:21.250348+0000","last_active":"2024-09-17T02:00:21.250268+0000","last_peered":"2024-09-17T02:00:21.250268+0000","last_clean":"2024-09-17T02:00:21.250268+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T02:00:21.250268+0000","last_undegraded":"2024-09-17T02:00:21.250268+0000","last_fullsized":"2024-09-17T02:00:21.250268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'457","last_scrub_stamp":"2024-09-17T02:00:21.250083+0000","last_deep_scrub":"64'457","last_deep_scrub_stamp":"2024-09-17T02:00:21.250083+0000","last_clean_scrub_stamp":"2024-09-17T02:00:21.250083+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:06.405440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":655,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:13.504267+0000","last_change":"2024-09-17T02:00:13.504329+0000","last_active":"2024-09-17T02:00:13.504267+0000","last_peered":"2024-09-17T02:00:13.504267+0000","last_clean":"2024-09-17T02:00:13.504267+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T02:00:13.504267+0000","last_undegraded":"2024-09-17T02:00:13.504267+0000","last_fullsized":"2024-09-17T02:00:13.504267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'412","last_scrub_stamp":"2024-09-17T02:00:13.504047+0000","last_deep_scrub":"64'412","last_deep_scrub_stamp":"2024-09-17T02:00:13.504047+0000","last_clean_scrub_stamp":"2024-09-17T02:00:13.504047+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:12.044052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"103'469","reported_seq":595,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.093777+0000","last_change":"2024-09-17T02:00:04.093852+0000","last_active":"2024-09-17T02:00:04.093777+0000","last_peered":"2024-09-17T02:00:04.093777+0000","last_clean":"2024-09-17T02:00:04.093777+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T02:00:04.093777+0000","last_undegraded":"2024-09-17T02:00:04.093777+0000","last_fullsized":"2024-09-17T02:00:04.093777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'469","last_scrub_stamp":"2024-09-17T02:00:04.093598+0000","last_deep_scrub":"103'469","last_deep_scrub_stamp":"2024-09-17T02:00:04.093598+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.093598+0000","objects_scrubbed":4,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:53.555288+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":677,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:10.539053+0000","last_change":"2024-09-17T02:00:10.539115+0000","last_active":"2024-09-17T02:00:10.539053+0000","last_peered":"2024-09-17T02:00:10.539053+0000","last_clean":"2024-09-17T02:00:10.539053+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T02:00:10.539053+0000","last_undegraded":"2024-09-17T02:00:10.539053+0000","last_fullsized":"2024-09-17T02:00:10.539053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'421","last_scrub_stamp":"2024-09-17T02:00:10.538853+0000","last_deep_scrub":"64'421","last_deep_scrub_stamp":"2024-09-17T02:00:10.538853+0000","last_clean_scrub_stamp":"2024-09-17T02:00:10.538853+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:53.132182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":252,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.867042+0000","last_change":"2024-09-17T01:59:54.867115+0000","last_active":"2024-09-17T01:59:54.867042+0000","last_peered":"2024-09-17T01:59:54.867042+0000","last_clean":"2024-09-17T01:59:54.867042+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:54.867042+0000","last_undegraded":"2024-09-17T01:59:54.867042+0000","last_fullsized":"2024-09-17T01:59:54.867042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'53","last_scrub_stamp":"2024-09-17T01:59:54.866825+0000","last_deep_scrub":"64'53","last_deep_scrub_stamp":"2024-09-17T01:59:54.866825+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.866825+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:35.320396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1097,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:16.725697+0000","last_change":"2024-09-17T02:00:16.725758+0000","last_active":"2024-09-17T02:00:16.725697+0000","last_peered":"2024-09-17T02:00:16.725697+0000","last_clean":"2024-09-17T02:00:16.725697+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T02:00:16.725697+0000","last_undegraded":"2024-09-17T02:00:16.725697+0000","last_fullsized":"2024-09-17T02:00:16.725697+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'438","last_scrub_stamp":"2024-09-17T02:00:16.725494+0000","last_deep_scrub":"64'438","last_deep_scrub_stamp":"2024-09-17T02:00:16.725494+0000","last_clean_scrub_stamp":"2024-09-17T02:00:16.725494+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:11.841776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":277,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.696024+0000","last_change":"2024-09-17T01:59:52.696089+0000","last_active":"2024-09-17T01:59:52.696024+0000","last_peered":"2024-09-17T01:59:52.696024+0000","last_clean":"2024-09-17T01:59:52.696024+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:52.696024+0000","last_undegraded":"2024-09-17T01:59:52.696024+0000","last_fullsized":"2024-09-17T01:59:52.696024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'79","last_scrub_stamp":"2024-09-17T01:59:52.695828+0000","last_deep_scrub":"64'79","last_deep_scrub_stamp":"2024-09-17T01:59:52.695828+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.695828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:49.909883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":1004,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:19.767051+0000","last_change":"2024-09-17T02:00:19.767115+0000","last_active":"2024-09-17T02:00:19.767051+0000","last_peered":"2024-09-17T02:00:19.767051+0000","last_clean":"2024-09-17T02:00:19.767051+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T02:00:19.767051+0000","last_undegraded":"2024-09-17T02:00:19.767051+0000","last_fullsized":"2024-09-17T02:00:19.767051+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'402","last_scrub_stamp":"2024-09-17T02:00:19.766865+0000","last_deep_scrub":"64'402","last_deep_scrub_stamp":"2024-09-17T02:00:19.766865+0000","last_clean_scrub_stamp":"2024-09-17T02:00:19.766865+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:09.508838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"103'74","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:18.197897+0000","last_change":"2024-09-17T02:00:18.198086+0000","last_active":"2024-09-17T02:00:18.197897+0000","last_peered":"2024-09-17T02:00:18.197897+0000","last_clean":"2024-09-17T02:00:18.197897+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T02:00:18.197897+0000","last_undegraded":"2024-09-17T02:00:18.197897+0000","last_fullsized":"2024-09-17T02:00:18.197897+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'74","last_scrub_stamp":"2024-09-17T02:00:18.197668+0000","last_deep_scrub":"103'74","last_deep_scrub_stamp":"2024-09-17T02:00:18.197668+0000","last_clean_scrub_stamp":"2024-09-17T02:00:18.197668+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:15.497251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"103'143","reported_seq":273,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:10.149060+0000","last_change":"2024-09-17T02:00:10.149142+0000","last_active":"2024-09-17T02:00:10.149060+0000","last_peered":"2024-09-17T02:00:10.149060+0000","last_clean":"2024-09-17T02:00:10.149060+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T02:00:10.149060+0000","last_undegraded":"2024-09-17T02:00:10.149060+0000","last_fullsized":"2024-09-17T02:00:10.149060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'143","last_scrub_stamp":"2024-09-17T02:00:10.148877+0000","last_deep_scrub":"103'143","last_deep_scrub_stamp":"2024-09-17T02:00:10.148877+0000","last_clean_scrub_stamp":"2024-09-17T02:00:10.148877+0000","objects_scrubbed":2,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:23:45.668619+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":1002,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:17.506250+0000","last_change":"2024-09-17T02:00:17.506310+0000","last_active":"2024-09-17T02:00:17.506250+0000","last_peered":"2024-09-17T02:00:17.506250+0000","last_clean":"2024-09-17T02:00:17.506250+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T02:00:17.506250+0000","last_undegraded":"2024-09-17T02:00:17.506250+0000","last_fullsized":"2024-09-17T02:00:17.506250+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'412","last_scrub_stamp":"2024-09-17T02:00:17.506040+0000","last_deep_scrub":"64'412","last_deep_scrub_stamp":"2024-09-17T02:00:17.506040+0000","last_clean_scrub_stamp":"2024-09-17T02:00:17.506040+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:11.513069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"103'266","reported_seq":471,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.510640+0000","last_change":"2024-09-17T02:00:00.510709+0000","last_active":"2024-09-17T02:00:00.510640+0000","last_peered":"2024-09-17T02:00:00.510640+0000","last_clean":"2024-09-17T02:00:00.510640+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T02:00:00.510640+0000","last_undegraded":"2024-09-17T02:00:00.510640+0000","last_fullsized":"2024-09-17T02:00:00.510640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'266","last_scrub_stamp":"2024-09-17T02:00:00.510440+0000","last_deep_scrub":"103'266","last_deep_scrub_stamp":"2024-09-17T02:00:00.510440+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.510440+0000","objects_scrubbed":2,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:58.677924+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":662,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:09.527388+0000","last_change":"2024-09-17T02:00:09.527486+0000","last_active":"2024-09-17T02:00:09.527388+0000","last_peered":"2024-09-17T02:00:09.527388+0000","last_clean":"2024-09-17T02:00:09.527388+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T02:00:09.527388+0000","last_undegraded":"2024-09-17T02:00:09.527388+0000","last_fullsized":"2024-09-17T02:00:09.527388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'453","last_scrub_stamp":"2024-09-17T02:00:09.527192+0000","last_deep_scrub":"64'453","last_deep_scrub_stamp":"2024-09-17T02:00:09.527192+0000","last_clean_scrub_stamp":"2024-09-17T02:00:09.527192+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:16.384888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"103'570","reported_seq":700,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.114976+0000","last_change":"2024-09-17T02:00:06.115047+0000","last_active":"2024-09-17T02:00:06.114976+0000","last_peered":"2024-09-17T02:00:06.114976+0000","last_clean":"2024-09-17T02:00:06.114976+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T02:00:06.114976+0000","last_undegraded":"2024-09-17T02:00:06.114976+0000","last_fullsized":"2024-09-17T02:00:06.114976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'570","last_scrub_stamp":"2024-09-17T02:00:06.114781+0000","last_deep_scrub":"103'570","last_deep_scrub_stamp":"2024-09-17T02:00:06.114781+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.114781+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:03.355630+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:39.386910+0000","last_change":"2024-09-17T01:59:39.383520+0000","last_active":"2024-09-17T01:59:39.386910+0000","last_peered":"2024-09-17T01:59:39.386910+0000","last_clean":"2024-09-17T01:59:39.386910+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T01:59:39.386910+0000","last_undegraded":"2024-09-17T01:59:39.386910+0000","last_fullsized":"2024-09-17T01:59:39.386910+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:54:44.184090+0000","last_clean_scrub_stamp":"2024-09-17T01:54:44.184090+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":91,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:14.118657+0000","last_change":"2024-09-17T02:00:14.118720+0000","last_active":"2024-09-17T02:00:14.118657+0000","last_peered":"2024-09-17T02:00:14.118657+0000","last_clean":"2024-09-17T02:00:14.118657+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T02:00:14.118657+0000","last_undegraded":"2024-09-17T02:00:14.118657+0000","last_fullsized":"2024-09-17T02:00:14.118657+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'68","last_scrub_stamp":"2024-09-17T02:00:14.118457+0000","last_deep_scrub":"64'68","last_deep_scrub_stamp":"2024-09-17T02:00:14.118457+0000","last_clean_scrub_stamp":"2024-09-17T02:00:14.118457+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:46.346089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1018,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:15.704527+0000","last_change":"2024-09-17T02:00:15.704678+0000","last_active":"2024-09-17T02:00:15.704527+0000","last_peered":"2024-09-17T02:00:15.704527+0000","last_clean":"2024-09-17T02:00:15.704527+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T02:00:15.704527+0000","last_undegraded":"2024-09-17T02:00:15.704527+0000","last_fullsized":"2024-09-17T02:00:15.704527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'425","last_scrub_stamp":"2024-09-17T02:00:15.704292+0000","last_deep_scrub":"64'425","last_deep_scrub_stamp":"2024-09-17T02:00:15.704292+0000","last_clean_scrub_stamp":"2024-09-17T02:00:15.704292+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.964921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"103'158","reported_seq":364,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.746292+0000","last_change":"2024-09-17T02:00:00.746447+0000","last_active":"2024-09-17T02:00:00.746292+0000","last_peered":"2024-09-17T02:00:00.746292+0000","last_clean":"2024-09-17T02:00:00.746292+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T02:00:00.746292+0000","last_undegraded":"2024-09-17T02:00:00.746292+0000","last_fullsized":"2024-09-17T02:00:00.746292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'158","last_scrub_stamp":"2024-09-17T02:00:00.746045+0000","last_deep_scrub":"103'158","last_deep_scrub_stamp":"2024-09-17T02:00:00.746045+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.746045+0000","objects_scrubbed":3,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:45.518209+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":652,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.119385+0000","last_change":"2024-09-17T01:59:56.119443+0000","last_active":"2024-09-17T01:59:56.119385+0000","last_peered":"2024-09-17T01:59:56.119385+0000","last_clean":"2024-09-17T01:59:56.119385+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:56.119385+0000","last_undegraded":"2024-09-17T01:59:56.119385+0000","last_fullsized":"2024-09-17T01:59:56.119385+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'466","last_scrub_stamp":"2024-09-17T01:59:56.119169+0000","last_deep_scrub":"64'466","last_deep_scrub_stamp":"2024-09-17T01:59:56.119169+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.119169+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:10.631435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"103'132","reported_seq":249,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.149814+0000","last_change":"2024-09-17T01:59:58.149880+0000","last_active":"2024-09-17T01:59:58.149814+0000","last_peered":"2024-09-17T01:59:58.149814+0000","last_clean":"2024-09-17T01:59:58.149814+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:58.149814+0000","last_undegraded":"2024-09-17T01:59:58.149814+0000","last_fullsized":"2024-09-17T01:59:58.149814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'132","last_scrub_stamp":"2024-09-17T01:59:58.149596+0000","last_deep_scrub":"103'132","last_deep_scrub_stamp":"2024-09-17T01:59:58.149596+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.149596+0000","objects_scrubbed":1,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:28.659970+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":685,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:23.224356+0000","last_change":"2024-09-17T02:00:23.224420+0000","last_active":"2024-09-17T02:00:23.224356+0000","last_peered":"2024-09-17T02:00:23.224356+0000","last_clean":"2024-09-17T02:00:23.224356+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T02:00:23.224356+0000","last_undegraded":"2024-09-17T02:00:23.224356+0000","last_fullsized":"2024-09-17T02:00:23.224356+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'434","last_scrub_stamp":"2024-09-17T02:00:23.224158+0000","last_deep_scrub":"64'434","last_deep_scrub_stamp":"2024-09-17T02:00:23.224158+0000","last_clean_scrub_stamp":"2024-09-17T02:00:23.224158+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:06.592546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.687592+0000","last_change":"2024-09-17T01:59:54.687658+0000","last_active":"2024-09-17T01:59:54.687592+0000","last_peered":"2024-09-17T01:59:54.687592+0000","last_clean":"2024-09-17T01:59:54.687592+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:54.687592+0000","last_undegraded":"2024-09-17T01:59:54.687592+0000","last_fullsized":"2024-09-17T01:59:54.687592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'52","last_scrub_stamp":"2024-09-17T01:59:54.687392+0000","last_deep_scrub":"64'52","last_deep_scrub_stamp":"2024-09-17T01:59:54.687392+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.687392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:54.574533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":587,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.088899+0000","last_change":"2024-09-17T02:00:03.088958+0000","last_active":"2024-09-17T02:00:03.088899+0000","last_peered":"2024-09-17T02:00:03.088899+0000","last_clean":"2024-09-17T02:00:03.088899+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T02:00:03.088899+0000","last_undegraded":"2024-09-17T02:00:03.088899+0000","last_fullsized":"2024-09-17T02:00:03.088899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'371","last_scrub_stamp":"2024-09-17T02:00:03.088703+0000","last_deep_scrub":"64'371","last_deep_scrub_stamp":"2024-09-17T02:00:03.088703+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.088703+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:46.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"103'455","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:07.561521+0000","last_change":"2024-09-17T02:00:07.561597+0000","last_active":"2024-09-17T02:00:07.561521+0000","last_peered":"2024-09-17T02:00:07.561521+0000","last_clean":"2024-09-17T02:00:07.561521+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T02:00:07.561521+0000","last_undegraded":"2024-09-17T02:00:07.561521+0000","last_fullsized":"2024-09-17T02:00:07.561521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'455","last_scrub_stamp":"2024-09-17T02:00:07.561319+0000","last_deep_scrub":"103'455","last_deep_scrub_stamp":"2024-09-17T02:00:07.561319+0000","last_clean_scrub_stamp":"2024-09-17T02:00:07.561319+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:03.848994+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":622,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.835352+0000","last_change":"2024-09-17T01:59:51.835469+0000","last_active":"2024-09-17T01:59:51.835352+0000","last_peered":"2024-09-17T01:59:51.835352+0000","last_clean":"2024-09-17T01:59:51.835352+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:51.835352+0000","last_undegraded":"2024-09-17T01:59:51.835352+0000","last_fullsized":"2024-09-17T01:59:51.835352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'388","last_scrub_stamp":"2024-09-17T01:59:51.835109+0000","last_deep_scrub":"64'388","last_deep_scrub_stamp":"2024-09-17T01:59:51.835109+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.835109+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:17.600426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"103'159","reported_seq":292,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:15.168136+0000","last_change":"2024-09-17T02:00:15.168308+0000","last_active":"2024-09-17T02:00:15.168136+0000","last_peered":"2024-09-17T02:00:15.168136+0000","last_clean":"2024-09-17T02:00:15.168136+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T02:00:15.168136+0000","last_undegraded":"2024-09-17T02:00:15.168136+0000","last_fullsized":"2024-09-17T02:00:15.168136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'159","last_scrub_stamp":"2024-09-17T02:00:15.167914+0000","last_deep_scrub":"103'159","last_deep_scrub_stamp":"2024-09-17T02:00:15.167914+0000","last_clean_scrub_stamp":"2024-09-17T02:00:15.167914+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:02.442353+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"103'2","reported_seq":115,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:16.173091+0000","last_change":"2024-09-17T02:00:16.173164+0000","last_active":"2024-09-17T02:00:16.173091+0000","last_peered":"2024-09-17T02:00:16.173091+0000","last_clean":"2024-09-17T02:00:16.173091+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T02:00:16.173091+0000","last_undegraded":"2024-09-17T02:00:16.173091+0000","last_fullsized":"2024-09-17T02:00:16.173091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-17T02:00:16.172901+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-17T02:00:16.172901+0000","last_clean_scrub_stamp":"2024-09-17T02:00:16.172901+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:15.895434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"103'416","reported_seq":537,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:08.170573+0000","last_change":"2024-09-17T02:00:08.170734+0000","last_active":"2024-09-17T02:00:08.170573+0000","last_peered":"2024-09-17T02:00:08.170573+0000","last_clean":"2024-09-17T02:00:08.170573+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T02:00:08.170573+0000","last_undegraded":"2024-09-17T02:00:08.170573+0000","last_fullsized":"2024-09-17T02:00:08.170573+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'416","last_scrub_stamp":"2024-09-17T02:00:08.170320+0000","last_deep_scrub":"103'416","last_deep_scrub_stamp":"2024-09-17T02:00:08.170320+0000","last_clean_scrub_stamp":"2024-09-17T02:00:08.170320+0000","objects_scrubbed":2,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:57.858419+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":610,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.079995+0000","last_change":"2024-09-17T01:59:51.080056+0000","last_active":"2024-09-17T01:59:51.079995+0000","last_peered":"2024-09-17T01:59:51.079995+0000","last_clean":"2024-09-17T01:59:51.079995+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:51.079995+0000","last_undegraded":"2024-09-17T01:59:51.079995+0000","last_fullsized":"2024-09-17T01:59:51.079995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'417","last_scrub_stamp":"2024-09-17T01:59:51.079804+0000","last_deep_scrub":"64'417","last_deep_scrub_stamp":"2024-09-17T01:59:51.079804+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.079804+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:30.364625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:19.233349+0000","last_change":"2024-09-17T02:00:19.233465+0000","last_active":"2024-09-17T02:00:19.233349+0000","last_peered":"2024-09-17T02:00:19.233349+0000","last_clean":"2024-09-17T02:00:19.233349+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T02:00:19.233349+0000","last_undegraded":"2024-09-17T02:00:19.233349+0000","last_fullsized":"2024-09-17T02:00:19.233349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:19.233122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:19.233122+0000","last_clean_scrub_stamp":"2024-09-17T02:00:19.233122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:37.724946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"103'122","reported_seq":386,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.700062+0000","last_change":"2024-09-17T02:00:02.700124+0000","last_active":"2024-09-17T02:00:02.700062+0000","last_peered":"2024-09-17T02:00:02.700062+0000","last_clean":"2024-09-17T02:00:02.700062+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T02:00:02.700062+0000","last_undegraded":"2024-09-17T02:00:02.700062+0000","last_fullsized":"2024-09-17T02:00:02.700062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'122","last_scrub_stamp":"2024-09-17T02:00:02.699876+0000","last_deep_scrub":"103'122","last_deep_scrub_stamp":"2024-09-17T02:00:02.699876+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.699876+0000","objects_scrubbed":1,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:52.853921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":723,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.510088+0000","last_change":"2024-09-17T01:59:59.510153+0000","last_active":"2024-09-17T01:59:59.510088+0000","last_peered":"2024-09-17T01:59:59.510088+0000","last_clean":"2024-09-17T01:59:59.510088+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:59.510088+0000","last_undegraded":"2024-09-17T01:59:59.510088+0000","last_fullsized":"2024-09-17T01:59:59.510088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'475","last_scrub_stamp":"2024-09-17T01:59:59.509881+0000","last_deep_scrub":"64'475","last_deep_scrub_stamp":"2024-09-17T01:59:59.509881+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.509881+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:35.658484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.623647+0000","last_change":"2024-09-17T02:00:06.623755+0000","last_active":"2024-09-17T02:00:06.623647+0000","last_peered":"2024-09-17T02:00:06.623647+0000","last_clean":"2024-09-17T02:00:06.623647+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T02:00:06.623647+0000","last_undegraded":"2024-09-17T02:00:06.623647+0000","last_fullsized":"2024-09-17T02:00:06.623647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:06.623405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:06.623405+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.623405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:22.514703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"103'420","reported_seq":627,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.505363+0000","last_change":"2024-09-17T02:00:02.505511+0000","last_active":"2024-09-17T02:00:02.505363+0000","last_peered":"2024-09-17T02:00:02.505363+0000","last_clean":"2024-09-17T02:00:02.505363+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T02:00:02.505363+0000","last_undegraded":"2024-09-17T02:00:02.505363+0000","last_fullsized":"2024-09-17T02:00:02.505363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'420","last_scrub_stamp":"2024-09-17T02:00:02.505125+0000","last_deep_scrub":"103'420","last_deep_scrub_stamp":"2024-09-17T02:00:02.505125+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.505125+0000","objects_scrubbed":2,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:35.693046+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.860404+0000","last_change":"2024-09-17T01:59:55.860465+0000","last_active":"2024-09-17T01:59:55.860404+0000","last_peered":"2024-09-17T01:59:55.860404+0000","last_clean":"2024-09-17T01:59:55.860404+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:55.860404+0000","last_undegraded":"2024-09-17T01:59:55.860404+0000","last_fullsized":"2024-09-17T01:59:55.860404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'362","last_scrub_stamp":"2024-09-17T01:59:55.860209+0000","last_deep_scrub":"64'362","last_deep_scrub_stamp":"2024-09-17T01:59:55.860209+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.860209+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:09.703402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"103'3","reported_seq":116,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:20.247608+0000","last_change":"2024-09-17T02:00:20.247748+0000","last_active":"2024-09-17T02:00:20.247608+0000","last_peered":"2024-09-17T02:00:20.247608+0000","last_clean":"2024-09-17T02:00:20.247608+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T02:00:20.247608+0000","last_undegraded":"2024-09-17T02:00:20.247608+0000","last_fullsized":"2024-09-17T02:00:20.247608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'3","last_scrub_stamp":"2024-09-17T02:00:20.247381+0000","last_deep_scrub":"103'3","last_deep_scrub_stamp":"2024-09-17T02:00:20.247381+0000","last_clean_scrub_stamp":"2024-09-17T02:00:20.247381+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:07.653563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":91,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:17.163926+0000","last_change":"2024-09-17T02:00:17.163986+0000","last_active":"2024-09-17T02:00:17.163926+0000","last_peered":"2024-09-17T02:00:17.163926+0000","last_clean":"2024-09-17T02:00:17.163926+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T02:00:17.163926+0000","last_undegraded":"2024-09-17T02:00:17.163926+0000","last_fullsized":"2024-09-17T02:00:17.163926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'60","last_scrub_stamp":"2024-09-17T02:00:17.163727+0000","last_deep_scrub":"64'60","last_deep_scrub_stamp":"2024-09-17T02:00:17.163727+0000","last_clean_scrub_stamp":"2024-09-17T02:00:17.163727+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:43.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":630,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.749517+0000","last_change":"2024-09-17T01:59:59.749607+0000","last_active":"2024-09-17T01:59:59.749517+0000","last_peered":"2024-09-17T01:59:59.749517+0000","last_clean":"2024-09-17T01:59:59.749517+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:59.749517+0000","last_undegraded":"2024-09-17T01:59:59.749517+0000","last_fullsized":"2024-09-17T01:59:59.749517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'376","last_scrub_stamp":"2024-09-17T01:59:59.749279+0000","last_deep_scrub":"64'376","last_deep_scrub_stamp":"2024-09-17T01:59:59.749279+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.749279+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:56.283997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"103'286","reported_seq":405,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.132342+0000","last_change":"2024-09-17T02:00:00.132410+0000","last_active":"2024-09-17T02:00:00.132342+0000","last_peered":"2024-09-17T02:00:00.132342+0000","last_clean":"2024-09-17T02:00:00.132342+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T02:00:00.132342+0000","last_undegraded":"2024-09-17T02:00:00.132342+0000","last_fullsized":"2024-09-17T02:00:00.132342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'286","last_scrub_stamp":"2024-09-17T02:00:00.132144+0000","last_deep_scrub":"103'286","last_deep_scrub_stamp":"2024-09-17T02:00:00.132144+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.132144+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:57.742702+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.629000+0000","last_change":"2024-09-17T02:00:05.629129+0000","last_active":"2024-09-17T02:00:05.629000+0000","last_peered":"2024-09-17T02:00:05.629000+0000","last_clean":"2024-09-17T02:00:05.629000+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T02:00:05.629000+0000","last_undegraded":"2024-09-17T02:00:05.629000+0000","last_fullsized":"2024-09-17T02:00:05.629000+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:05.628775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:05.628775+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.628775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:27.681767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":927,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:21.425885+0000","last_change":"2024-09-17T02:00:21.425945+0000","last_active":"2024-09-17T02:00:21.425885+0000","last_peered":"2024-09-17T02:00:21.425885+0000","last_clean":"2024-09-17T02:00:21.425885+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T02:00:21.425885+0000","last_undegraded":"2024-09-17T02:00:21.425885+0000","last_fullsized":"2024-09-17T02:00:21.425885+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'362","last_scrub_stamp":"2024-09-17T02:00:21.425677+0000","last_deep_scrub":"64'362","last_deep_scrub_stamp":"2024-09-17T02:00:21.425677+0000","last_clean_scrub_stamp":"2024-09-17T02:00:21.425677+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:35.527862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:07.673132+0000","last_change":"2024-09-17T02:00:07.673262+0000","last_active":"2024-09-17T02:00:07.673132+0000","last_peered":"2024-09-17T02:00:07.673132+0000","last_clean":"2024-09-17T02:00:07.673132+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T02:00:07.673132+0000","last_undegraded":"2024-09-17T02:00:07.673132+0000","last_fullsized":"2024-09-17T02:00:07.673132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'58","last_scrub_stamp":"2024-09-17T02:00:07.672903+0000","last_deep_scrub":"64'58","last_deep_scrub_stamp":"2024-09-17T02:00:07.672903+0000","last_clean_scrub_stamp":"2024-09-17T02:00:07.672903+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:57.936699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.566222+0000","last_change":"2024-09-17T02:00:06.566275+0000","last_active":"2024-09-17T02:00:06.566222+0000","last_peered":"2024-09-17T02:00:06.566222+0000","last_clean":"2024-09-17T02:00:06.566222+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T02:00:06.566222+0000","last_undegraded":"2024-09-17T02:00:06.566222+0000","last_fullsized":"2024-09-17T02:00:06.566222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:06.566032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:06.566032+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.566032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:26.466738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:15.506441+0000","last_change":"2024-09-17T02:00:15.506501+0000","last_active":"2024-09-17T02:00:15.506441+0000","last_peered":"2024-09-17T02:00:15.506441+0000","last_clean":"2024-09-17T02:00:15.506441+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T02:00:15.506441+0000","last_undegraded":"2024-09-17T02:00:15.506441+0000","last_fullsized":"2024-09-17T02:00:15.506441+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'410","last_scrub_stamp":"2024-09-17T02:00:15.506241+0000","last_deep_scrub":"64'410","last_deep_scrub_stamp":"2024-09-17T02:00:15.506241+0000","last_clean_scrub_stamp":"2024-09-17T02:00:15.506241+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:53.929283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"103'52","reported_seq":244,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:08.703652+0000","last_change":"2024-09-17T02:00:08.703721+0000","last_active":"2024-09-17T02:00:08.703652+0000","last_peered":"2024-09-17T02:00:08.703652+0000","last_clean":"2024-09-17T02:00:08.703652+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T02:00:08.703652+0000","last_undegraded":"2024-09-17T02:00:08.703652+0000","last_fullsized":"2024-09-17T02:00:08.703652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'52","last_scrub_stamp":"2024-09-17T02:00:08.703468+0000","last_deep_scrub":"103'52","last_deep_scrub_stamp":"2024-09-17T02:00:08.703468+0000","last_clean_scrub_stamp":"2024-09-17T02:00:08.703468+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:31.750368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.617157+0000","last_change":"2024-09-17T02:00:04.617260+0000","last_active":"2024-09-17T02:00:04.617157+0000","last_peered":"2024-09-17T02:00:04.617157+0000","last_clean":"2024-09-17T02:00:04.617157+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T02:00:04.617157+0000","last_undegraded":"2024-09-17T02:00:04.617157+0000","last_fullsized":"2024-09-17T02:00:04.617157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:04.616911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:04.616911+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.616911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:58.497913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":994,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:18.739531+0000","last_change":"2024-09-17T02:00:18.739645+0000","last_active":"2024-09-17T02:00:18.739531+0000","last_peered":"2024-09-17T02:00:18.739531+0000","last_clean":"2024-09-17T02:00:18.739531+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T02:00:18.739531+0000","last_undegraded":"2024-09-17T02:00:18.739531+0000","last_fullsized":"2024-09-17T02:00:18.739531+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'409","last_scrub_stamp":"2024-09-17T02:00:18.739230+0000","last_deep_scrub":"64'409","last_deep_scrub_stamp":"2024-09-17T02:00:18.739230+0000","last_clean_scrub_stamp":"2024-09-17T02:00:18.739230+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:11.809519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"103'114","reported_seq":318,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.855676+0000","last_change":"2024-09-17T01:59:56.855747+0000","last_active":"2024-09-17T01:59:56.855676+0000","last_peered":"2024-09-17T01:59:56.855676+0000","last_clean":"2024-09-17T01:59:56.855676+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:56.855676+0000","last_undegraded":"2024-09-17T01:59:56.855676+0000","last_fullsized":"2024-09-17T01:59:56.855676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'114","last_scrub_stamp":"2024-09-17T01:59:56.855478+0000","last_deep_scrub":"103'114","last_deep_scrub_stamp":"2024-09-17T01:59:56.855478+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.855478+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.886614+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:13.126050+0000","last_change":"2024-09-17T02:00:13.126110+0000","last_active":"2024-09-17T02:00:13.126050+0000","last_peered":"2024-09-17T02:00:13.126050+0000","last_clean":"2024-09-17T02:00:13.126050+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T02:00:13.126050+0000","last_undegraded":"2024-09-17T02:00:13.126050+0000","last_fullsized":"2024-09-17T02:00:13.126050+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:13.125855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:13.125855+0000","last_clean_scrub_stamp":"2024-09-17T02:00:13.125855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:51.008979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1054,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:49.750649+0000","last_change":"2024-09-17T01:59:49.750834+0000","last_active":"2024-09-17T01:59:49.750649+0000","last_peered":"2024-09-17T01:59:49.750649+0000","last_clean":"2024-09-17T01:59:49.750649+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:49.750649+0000","last_undegraded":"2024-09-17T01:59:49.750649+0000","last_fullsized":"2024-09-17T01:59:49.750649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'420","last_scrub_stamp":"2024-09-17T01:59:49.750417+0000","last_deep_scrub":"64'420","last_deep_scrub_stamp":"2024-09-17T01:59:49.750417+0000","last_clean_scrub_stamp":"2024-09-17T01:59:49.750417+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:01.334641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.132518+0000","last_change":"2024-09-17T01:59:59.132577+0000","last_active":"2024-09-17T01:59:59.132518+0000","last_peered":"2024-09-17T01:59:59.132518+0000","last_clean":"2024-09-17T01:59:59.132518+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:59.132518+0000","last_undegraded":"2024-09-17T01:59:59.132518+0000","last_fullsized":"2024-09-17T01:59:59.132518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'397","last_scrub_stamp":"2024-09-17T01:59:59.132325+0000","last_deep_scrub":"64'397","last_deep_scrub_stamp":"2024-09-17T01:59:59.132325+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.132325+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:54.195395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"103'255","reported_seq":452,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:12.162083+0000","last_change":"2024-09-17T02:00:12.162162+0000","last_active":"2024-09-17T02:00:12.162083+0000","last_peered":"2024-09-17T02:00:12.162083+0000","last_clean":"2024-09-17T02:00:12.162083+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T02:00:12.162083+0000","last_undegraded":"2024-09-17T02:00:12.162083+0000","last_fullsized":"2024-09-17T02:00:12.162083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'255","last_scrub_stamp":"2024-09-17T02:00:12.161905+0000","last_deep_scrub":"103'255","last_deep_scrub_stamp":"2024-09-17T02:00:12.161905+0000","last_clean_scrub_stamp":"2024-09-17T02:00:12.161905+0000","objects_scrubbed":6,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:00.709331+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.837198+0000","last_change":"2024-09-17T01:59:53.837259+0000","last_active":"2024-09-17T01:59:53.837198+0000","last_peered":"2024-09-17T01:59:53.837198+0000","last_clean":"2024-09-17T01:59:53.837198+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:53.837198+0000","last_undegraded":"2024-09-17T01:59:53.837198+0000","last_fullsized":"2024-09-17T01:59:53.837198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'422","last_scrub_stamp":"2024-09-17T01:59:53.836992+0000","last_deep_scrub":"64'422","last_deep_scrub_stamp":"2024-09-17T01:59:53.836992+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.836992+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.243093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"103'84","reported_seq":287,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.649475+0000","last_change":"2024-09-17T01:59:56.649623+0000","last_active":"2024-09-17T01:59:56.649475+0000","last_peered":"2024-09-17T01:59:56.649475+0000","last_clean":"2024-09-17T01:59:56.649475+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:56.649475+0000","last_undegraded":"2024-09-17T01:59:56.649475+0000","last_fullsized":"2024-09-17T01:59:56.649475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'84","last_scrub_stamp":"2024-09-17T01:59:56.649242+0000","last_deep_scrub":"103'84","last_deep_scrub_stamp":"2024-09-17T01:59:56.649242+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.649242+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:17.189578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"103'222","reported_seq":341,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.115856+0000","last_change":"2024-09-17T02:00:02.115920+0000","last_active":"2024-09-17T02:00:02.115856+0000","last_peered":"2024-09-17T02:00:02.115856+0000","last_clean":"2024-09-17T02:00:02.115856+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T02:00:02.115856+0000","last_undegraded":"2024-09-17T02:00:02.115856+0000","last_fullsized":"2024-09-17T02:00:02.115856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'222","last_scrub_stamp":"2024-09-17T02:00:02.115662+0000","last_deep_scrub":"103'222","last_deep_scrub_stamp":"2024-09-17T02:00:02.115662+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.115662+0000","objects_scrubbed":1,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:49.938816+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:17.719692+0000","last_change":"2024-09-17T02:00:17.719752+0000","last_active":"2024-09-17T02:00:17.719692+0000","last_peered":"2024-09-17T02:00:17.719692+0000","last_clean":"2024-09-17T02:00:17.719692+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T02:00:17.719692+0000","last_undegraded":"2024-09-17T02:00:17.719692+0000","last_fullsized":"2024-09-17T02:00:17.719692+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'502","last_scrub_stamp":"2024-09-17T02:00:17.719489+0000","last_deep_scrub":"64'502","last_deep_scrub_stamp":"2024-09-17T02:00:17.719489+0000","last_clean_scrub_stamp":"2024-09-17T02:00:17.719489+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:41.869214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.851026+0000","last_change":"2024-09-17T01:59:52.851087+0000","last_active":"2024-09-17T01:59:52.851026+0000","last_peered":"2024-09-17T01:59:52.851026+0000","last_clean":"2024-09-17T01:59:52.851026+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:52.851026+0000","last_undegraded":"2024-09-17T01:59:52.851026+0000","last_fullsized":"2024-09-17T01:59:52.851026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'51","last_scrub_stamp":"2024-09-17T01:59:52.850833+0000","last_deep_scrub":"64'51","last_deep_scrub_stamp":"2024-09-17T01:59:52.850833+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.850833+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:39.821567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":706,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:11.685520+0000","last_change":"2024-09-17T02:00:11.685583+0000","last_active":"2024-09-17T02:00:11.685520+0000","last_peered":"2024-09-17T02:00:11.685520+0000","last_clean":"2024-09-17T02:00:11.685520+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T02:00:11.685520+0000","last_undegraded":"2024-09-17T02:00:11.685520+0000","last_fullsized":"2024-09-17T02:00:11.685520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'454","last_scrub_stamp":"2024-09-17T02:00:11.685312+0000","last_deep_scrub":"64'454","last_deep_scrub_stamp":"2024-09-17T02:00:11.685312+0000","last_clean_scrub_stamp":"2024-09-17T02:00:11.685312+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:11.646030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":892,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:14.532634+0000","last_change":"2024-09-17T02:00:14.532696+0000","last_active":"2024-09-17T02:00:14.532634+0000","last_peered":"2024-09-17T02:00:14.532634+0000","last_clean":"2024-09-17T02:00:14.532634+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T02:00:14.532634+0000","last_undegraded":"2024-09-17T02:00:14.532634+0000","last_fullsized":"2024-09-17T02:00:14.532634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'357","last_scrub_stamp":"2024-09-17T02:00:14.532442+0000","last_deep_scrub":"64'357","last_deep_scrub_stamp":"2024-09-17T02:00:14.532442+0000","last_clean_scrub_stamp":"2024-09-17T02:00:14.532442+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:14.493159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"103'627","reported_seq":819,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:09.770000+0000","last_change":"2024-09-17T02:00:09.770068+0000","last_active":"2024-09-17T02:00:09.770000+0000","last_peered":"2024-09-17T02:00:09.770000+0000","last_clean":"2024-09-17T02:00:09.770000+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T02:00:09.770000+0000","last_undegraded":"2024-09-17T02:00:09.770000+0000","last_fullsized":"2024-09-17T02:00:09.770000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'627","last_scrub_stamp":"2024-09-17T02:00:09.769759+0000","last_deep_scrub":"103'627","last_deep_scrub_stamp":"2024-09-17T02:00:09.769759+0000","last_clean_scrub_stamp":"2024-09-17T02:00:09.769759+0000","objects_scrubbed":2,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:56.105125+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":975,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:12.704433+0000","last_change":"2024-09-17T02:00:12.704499+0000","last_active":"2024-09-17T02:00:12.704433+0000","last_peered":"2024-09-17T02:00:12.704433+0000","last_clean":"2024-09-17T02:00:12.704433+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T02:00:12.704433+0000","last_undegraded":"2024-09-17T02:00:12.704433+0000","last_fullsized":"2024-09-17T02:00:12.704433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'405","last_scrub_stamp":"2024-09-17T02:00:12.704234+0000","last_deep_scrub":"64'405","last_deep_scrub_stamp":"2024-09-17T02:00:12.704234+0000","last_clean_scrub_stamp":"2024-09-17T02:00:12.704234+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:45.852892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'201","reported_seq":406,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.812835+0000","last_change":"2024-09-17T01:59:58.812901+0000","last_active":"2024-09-17T01:59:58.812835+0000","last_peered":"2024-09-17T01:59:58.812835+0000","last_clean":"2024-09-17T01:59:58.812835+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:58.812835+0000","last_undegraded":"2024-09-17T01:59:58.812835+0000","last_fullsized":"2024-09-17T01:59:58.812835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'201","last_scrub_stamp":"2024-09-17T01:59:58.812664+0000","last_deep_scrub":"103'201","last_deep_scrub_stamp":"2024-09-17T01:59:58.812664+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.812664+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:52.732876+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":948,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:20.456591+0000","last_change":"2024-09-17T02:00:20.456657+0000","last_active":"2024-09-17T02:00:20.456591+0000","last_peered":"2024-09-17T02:00:20.456591+0000","last_clean":"2024-09-17T02:00:20.456591+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T02:00:20.456591+0000","last_undegraded":"2024-09-17T02:00:20.456591+0000","last_fullsized":"2024-09-17T02:00:20.456591+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T02:00:20.456382+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T02:00:20.456382+0000","last_clean_scrub_stamp":"2024-09-17T02:00:20.456382+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:09.459657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"103'275","reported_seq":466,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:08.549460+0000","last_change":"2024-09-17T02:00:08.549534+0000","last_active":"2024-09-17T02:00:08.549460+0000","last_peered":"2024-09-17T02:00:08.549460+0000","last_clean":"2024-09-17T02:00:08.549460+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T02:00:08.549460+0000","last_undegraded":"2024-09-17T02:00:08.549460+0000","last_fullsized":"2024-09-17T02:00:08.549460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'275","last_scrub_stamp":"2024-09-17T02:00:08.549261+0000","last_deep_scrub":"103'275","last_deep_scrub_stamp":"2024-09-17T02:00:08.549261+0000","last_clean_scrub_stamp":"2024-09-17T02:00:08.549261+0000","objects_scrubbed":3,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:37.469825+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":603,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.543590+0000","last_change":"2024-09-17T02:00:05.543661+0000","last_active":"2024-09-17T02:00:05.543590+0000","last_peered":"2024-09-17T02:00:05.543590+0000","last_clean":"2024-09-17T02:00:05.543590+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T02:00:05.543590+0000","last_undegraded":"2024-09-17T02:00:05.543590+0000","last_fullsized":"2024-09-17T02:00:05.543590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T02:00:05.543386+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T02:00:05.543386+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.543386+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.638925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"103'54","reported_seq":253,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.738098+0000","last_change":"2024-09-17T01:59:50.738161+0000","last_active":"2024-09-17T01:59:50.738098+0000","last_peered":"2024-09-17T01:59:50.738098+0000","last_clean":"2024-09-17T01:59:50.738098+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:50.738098+0000","last_undegraded":"2024-09-17T01:59:50.738098+0000","last_fullsized":"2024-09-17T01:59:50.738098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'54","last_scrub_stamp":"2024-09-17T01:59:50.737902+0000","last_deep_scrub":"103'54","last_deep_scrub_stamp":"2024-09-17T01:59:50.737902+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.737902+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:25.079013+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.055987+0000","last_change":"2024-09-17T02:00:05.056048+0000","last_active":"2024-09-17T02:00:05.055987+0000","last_peered":"2024-09-17T02:00:05.055987+0000","last_clean":"2024-09-17T02:00:05.055987+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T02:00:05.055987+0000","last_undegraded":"2024-09-17T02:00:05.055987+0000","last_fullsized":"2024-09-17T02:00:05.055987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'398","last_scrub_stamp":"2024-09-17T02:00:05.055791+0000","last_deep_scrub":"64'398","last_deep_scrub_stamp":"2024-09-17T02:00:05.055791+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.055791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:33.802302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"103'185","reported_seq":311,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.182313+0000","last_change":"2024-09-17T01:59:57.182397+0000","last_active":"2024-09-17T01:59:57.182313+0000","last_peered":"2024-09-17T01:59:57.182313+0000","last_clean":"2024-09-17T01:59:57.182313+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:57.182313+0000","last_undegraded":"2024-09-17T01:59:57.182313+0000","last_fullsized":"2024-09-17T01:59:57.182313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'185","last_scrub_stamp":"2024-09-17T01:59:57.182098+0000","last_deep_scrub":"103'185","last_deep_scrub_stamp":"2024-09-17T01:59:57.182098+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.182098+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:45.383530+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":564,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.097878+0000","last_change":"2024-09-17T01:59:52.097935+0000","last_active":"2024-09-17T01:59:52.097878+0000","last_peered":"2024-09-17T01:59:52.097878+0000","last_clean":"2024-09-17T01:59:52.097878+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:52.097878+0000","last_undegraded":"2024-09-17T01:59:52.097878+0000","last_fullsized":"2024-09-17T01:59:52.097878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T01:59:52.097665+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T01:59:52.097665+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.097665+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:18.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"103'276","reported_seq":481,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.605830+0000","last_change":"2024-09-17T01:59:58.605988+0000","last_active":"2024-09-17T01:59:58.605830+0000","last_peered":"2024-09-17T01:59:58.605830+0000","last_clean":"2024-09-17T01:59:58.605830+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:58.605830+0000","last_undegraded":"2024-09-17T01:59:58.605830+0000","last_fullsized":"2024-09-17T01:59:58.605830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'276","last_scrub_stamp":"2024-09-17T01:59:58.605552+0000","last_deep_scrub":"103'276","last_deep_scrub_stamp":"2024-09-17T01:59:58.605552+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.605552+0000","objects_scrubbed":4,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:12.448745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":698,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.601559+0000","last_change":"2024-09-17T01:59:57.601625+0000","last_active":"2024-09-17T01:59:57.601559+0000","last_peered":"2024-09-17T01:59:57.601559+0000","last_clean":"2024-09-17T01:59:57.601559+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:57.601559+0000","last_undegraded":"2024-09-17T01:59:57.601559+0000","last_fullsized":"2024-09-17T01:59:57.601559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T01:59:57.601357+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T01:59:57.601357+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.601357+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:46.375755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"103'41","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:10.696082+0000","last_change":"2024-09-17T02:00:10.696146+0000","last_active":"2024-09-17T02:00:10.696082+0000","last_peered":"2024-09-17T02:00:10.696082+0000","last_clean":"2024-09-17T02:00:10.696082+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T02:00:10.696082+0000","last_undegraded":"2024-09-17T02:00:10.696082+0000","last_fullsized":"2024-09-17T02:00:10.696082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'41","last_scrub_stamp":"2024-09-17T02:00:10.695894+0000","last_deep_scrub":"103'41","last_deep_scrub_stamp":"2024-09-17T02:00:10.695894+0000","last_clean_scrub_stamp":"2024-09-17T02:00:10.695894+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:09.235898+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":690,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:24.229070+0000","last_change":"2024-09-17T02:00:24.229131+0000","last_active":"2024-09-17T02:00:24.229070+0000","last_peered":"2024-09-17T02:00:24.229070+0000","last_clean":"2024-09-17T02:00:24.229070+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T02:00:24.229070+0000","last_undegraded":"2024-09-17T02:00:24.229070+0000","last_fullsized":"2024-09-17T02:00:24.229070+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'478","last_scrub_stamp":"2024-09-17T02:00:24.228883+0000","last_deep_scrub":"64'478","last_deep_scrub_stamp":"2024-09-17T02:00:24.228883+0000","last_clean_scrub_stamp":"2024-09-17T02:00:24.228883+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:43.125912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"103'63","reported_seq":263,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.845638+0000","last_change":"2024-09-17T01:59:50.845705+0000","last_active":"2024-09-17T01:59:50.845638+0000","last_peered":"2024-09-17T01:59:50.845638+0000","last_clean":"2024-09-17T01:59:50.845638+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:50.845638+0000","last_undegraded":"2024-09-17T01:59:50.845638+0000","last_fullsized":"2024-09-17T01:59:50.845638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'63","last_scrub_stamp":"2024-09-17T01:59:50.845456+0000","last_deep_scrub":"103'63","last_deep_scrub_stamp":"2024-09-17T01:59:50.845456+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.845456+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:24.825752+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6381,"ondisk_log_size":6381,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678034,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54072,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317768,"statfs":{"total":96636764160,"available":96581394432,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738443,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95296,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276544,"statfs":{"total":96636764160,"available":96539181056,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91920,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279920,"statfs":{"total":96636764160,"available":96542638080,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:00:29.904 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:29.905 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-17T01:54:44.184090+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=54, tm_sec=44, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=1, tm_min=59, tm_sec=46, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T02:00:29.905 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T02:00:49.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:00:50.239 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T02:00:50.242 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T02:00:50.257 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-17T02:00:50.122800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128027436,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":3110,"num_read_kb":1496052,"num_write":29294,"num_write_kb":4525863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7317,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33188,"ondisk_log_size":33188,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":241288,"kb_used_data":57112,"kb_used_omap":177,"kb_used_meta":183950,"kb_avail":282874232,"statfs":{"total":289910292480,"available":289663213568,"internally_reserved":0,"allocated":58482688,"data_stored":257379774,"data_compressed":19706187,"data_compressed_allocated":32137216,"data_compressed_original":232685568,"omap_allocated":182244,"internal_metadata":188364828},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004431"},"pg_stats":[{"pgid":"4.3f","version":"64'415","reported_seq":682,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.728068+0000","last_change":"2024-09-17T01:59:53.728130+0000","last_active":"2024-09-17T01:59:53.728068+0000","last_peered":"2024-09-17T01:59:53.728068+0000","last_clean":"2024-09-17T01:59:53.728068+0000","last_became_active":"2024-09-17T01:54:45.097603+0000","last_became_peered":"2024-09-17T01:54:45.097603+0000","last_unstale":"2024-09-17T01:59:53.728068+0000","last_undegraded":"2024-09-17T01:59:53.728068+0000","last_fullsized":"2024-09-17T01:59:53.728068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'415","last_scrub_stamp":"2024-09-17T01:59:53.727858+0000","last_deep_scrub":"64'415","last_deep_scrub_stamp":"2024-09-17T01:59:53.727858+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.727858+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:32.607235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":32620,"num_write":384,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'448","reported_seq":675,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.724745+0000","last_change":"2024-09-17T01:59:51.724880+0000","last_active":"2024-09-17T01:59:51.724745+0000","last_peered":"2024-09-17T01:59:51.724745+0000","last_clean":"2024-09-17T01:59:51.724745+0000","last_became_active":"2024-09-17T01:54:45.099430+0000","last_became_peered":"2024-09-17T01:54:45.099430+0000","last_unstale":"2024-09-17T01:59:51.724745+0000","last_undegraded":"2024-09-17T01:59:51.724745+0000","last_fullsized":"2024-09-17T01:59:51.724745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T01:59:51.724520+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T01:59:51.724520+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.724520+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:40.155690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":11343,"num_write":419,"num_write_kb":88273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'358","reported_seq":531,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.070997+0000","last_change":"2024-09-17T01:59:53.071054+0000","last_active":"2024-09-17T01:59:53.070997+0000","last_peered":"2024-09-17T01:59:53.070997+0000","last_clean":"2024-09-17T01:59:53.070997+0000","last_became_active":"2024-09-17T01:59:27.346090+0000","last_became_peered":"2024-09-17T01:59:27.346090+0000","last_unstale":"2024-09-17T01:59:53.070997+0000","last_undegraded":"2024-09-17T01:59:53.070997+0000","last_fullsized":"2024-09-17T01:59:53.070997+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'358","last_scrub_stamp":"2024-09-17T01:59:53.070778+0000","last_deep_scrub":"64'358","last_deep_scrub_stamp":"2024-09-17T01:59:53.070778+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.070778+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:50.803793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4621,"num_write":330,"num_write_kb":30488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'379","reported_seq":577,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.116742+0000","last_change":"2024-09-17T01:59:54.116802+0000","last_active":"2024-09-17T01:59:54.116742+0000","last_peered":"2024-09-17T01:59:54.116742+0000","last_clean":"2024-09-17T01:59:54.116742+0000","last_became_active":"2024-09-17T01:59:27.342960+0000","last_became_peered":"2024-09-17T01:59:27.342960+0000","last_unstale":"2024-09-17T01:59:54.116742+0000","last_undegraded":"2024-09-17T01:59:54.116742+0000","last_fullsized":"2024-09-17T01:59:54.116742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'379","last_scrub_stamp":"2024-09-17T01:59:54.116535+0000","last_deep_scrub":"64'379","last_deep_scrub_stamp":"2024-09-17T01:59:54.116535+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.116535+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:14.329186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15646,"num_write":344,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'440","reported_seq":680,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:12.549978+0000","last_change":"2024-09-17T02:00:12.550040+0000","last_active":"2024-09-17T02:00:12.549978+0000","last_peered":"2024-09-17T02:00:12.549978+0000","last_clean":"2024-09-17T02:00:12.549978+0000","last_became_active":"2024-09-17T01:54:45.086090+0000","last_became_peered":"2024-09-17T01:54:45.086090+0000","last_unstale":"2024-09-17T02:00:12.549978+0000","last_undegraded":"2024-09-17T02:00:12.549978+0000","last_fullsized":"2024-09-17T02:00:12.549978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'440","last_scrub_stamp":"2024-09-17T02:00:12.549776+0000","last_deep_scrub":"64'440","last_deep_scrub_stamp":"2024-09-17T02:00:12.549776+0000","last_clean_scrub_stamp":"2024-09-17T02:00:12.549776+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:31.058644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23613,"num_write":408,"num_write_kb":75834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'386","reported_seq":588,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.051166+0000","last_change":"2024-09-17T01:59:50.051224+0000","last_active":"2024-09-17T01:59:50.051166+0000","last_peered":"2024-09-17T01:59:50.051166+0000","last_clean":"2024-09-17T01:59:50.051166+0000","last_became_active":"2024-09-17T01:59:30.369431+0000","last_became_peered":"2024-09-17T01:59:30.369431+0000","last_unstale":"2024-09-17T01:59:50.051166+0000","last_undegraded":"2024-09-17T01:59:50.051166+0000","last_fullsized":"2024-09-17T01:59:50.051166+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'386","last_scrub_stamp":"2024-09-17T01:59:50.050973+0000","last_deep_scrub":"64'386","last_deep_scrub_stamp":"2024-09-17T01:59:50.050973+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.050973+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:27.064589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":23752,"num_write":365,"num_write_kb":63237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'441","reported_seq":700,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.062689+0000","last_change":"2024-09-17T02:00:01.062750+0000","last_active":"2024-09-17T02:00:01.062689+0000","last_peered":"2024-09-17T02:00:01.062689+0000","last_clean":"2024-09-17T02:00:01.062689+0000","last_became_active":"2024-09-17T01:59:17.339281+0000","last_became_peered":"2024-09-17T01:59:17.339281+0000","last_unstale":"2024-09-17T02:00:01.062689+0000","last_undegraded":"2024-09-17T02:00:01.062689+0000","last_fullsized":"2024-09-17T02:00:01.062689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'441","last_scrub_stamp":"2024-09-17T02:00:01.062492+0000","last_deep_scrub":"64'441","last_deep_scrub_stamp":"2024-09-17T02:00:01.062492+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.062492+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:16.109299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":30025,"num_write":412,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'376","reported_seq":541,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:25.269484+0000","last_change":"2024-09-17T02:00:25.269546+0000","last_active":"2024-09-17T02:00:25.269484+0000","last_peered":"2024-09-17T02:00:25.269484+0000","last_clean":"2024-09-17T02:00:25.269484+0000","last_became_active":"2024-09-17T01:59:36.354486+0000","last_became_peered":"2024-09-17T01:59:36.354486+0000","last_unstale":"2024-09-17T02:00:25.269484+0000","last_undegraded":"2024-09-17T02:00:25.269484+0000","last_fullsized":"2024-09-17T02:00:25.269484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'376","last_scrub_stamp":"2024-09-17T02:00:25.269290+0000","last_deep_scrub":"64'376","last_deep_scrub_stamp":"2024-09-17T02:00:25.269290+0000","last_clean_scrub_stamp":"2024-09-17T02:00:25.269290+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:49.771937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":4144,"num_write":336,"num_write_kb":47478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'428","reported_seq":640,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:49.869683+0000","last_change":"2024-09-17T01:59:49.869749+0000","last_active":"2024-09-17T01:59:49.869683+0000","last_peered":"2024-09-17T01:59:49.869683+0000","last_clean":"2024-09-17T01:59:49.869683+0000","last_became_active":"2024-09-17T01:54:45.106093+0000","last_became_peered":"2024-09-17T01:54:45.106093+0000","last_unstale":"2024-09-17T01:59:49.869683+0000","last_undegraded":"2024-09-17T01:59:49.869683+0000","last_fullsized":"2024-09-17T01:59:49.869683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'428","last_scrub_stamp":"2024-09-17T01:59:49.869486+0000","last_deep_scrub":"64'428","last_deep_scrub_stamp":"2024-09-17T01:59:49.869486+0000","last_clean_scrub_stamp":"2024-09-17T01:59:49.869486+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:34.674672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12562,"num_write":392,"num_write_kb":79541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'390","reported_seq":606,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.661778+0000","last_change":"2024-09-17T01:59:55.661844+0000","last_active":"2024-09-17T01:59:55.661778+0000","last_peered":"2024-09-17T01:59:55.661778+0000","last_clean":"2024-09-17T01:59:55.661778+0000","last_became_active":"2024-09-17T01:54:45.098052+0000","last_became_peered":"2024-09-17T01:54:45.098052+0000","last_unstale":"2024-09-17T01:59:55.661778+0000","last_undegraded":"2024-09-17T01:59:55.661778+0000","last_fullsized":"2024-09-17T01:59:55.661778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'390","last_scrub_stamp":"2024-09-17T01:59:55.661554+0000","last_deep_scrub":"64'390","last_deep_scrub_stamp":"2024-09-17T01:59:55.661554+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.661554+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:40:08.638228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9012,"num_write":349,"num_write_kb":42469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'361","reported_seq":548,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:09.157937+0000","last_change":"2024-09-17T02:00:09.158101+0000","last_active":"2024-09-17T02:00:09.157937+0000","last_peered":"2024-09-17T02:00:09.157937+0000","last_clean":"2024-09-17T02:00:09.157937+0000","last_became_active":"2024-09-17T01:59:21.353327+0000","last_became_peered":"2024-09-17T01:59:21.353327+0000","last_unstale":"2024-09-17T02:00:09.157937+0000","last_undegraded":"2024-09-17T02:00:09.157937+0000","last_fullsized":"2024-09-17T02:00:09.157937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'361","last_scrub_stamp":"2024-09-17T02:00:09.157698+0000","last_deep_scrub":"64'361","last_deep_scrub_stamp":"2024-09-17T02:00:09.157698+0000","last_clean_scrub_stamp":"2024-09-17T02:00:09.157698+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:32.923395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4863,"num_write":345,"num_write_kb":70794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'358","reported_seq":889,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:48.748874+0000","last_change":"2024-09-17T01:59:48.748940+0000","last_active":"2024-09-17T01:59:48.748874+0000","last_peered":"2024-09-17T01:59:48.748874+0000","last_clean":"2024-09-17T01:59:48.748874+0000","last_became_active":"2024-09-17T01:59:20.829394+0000","last_became_peered":"2024-09-17T01:59:20.829394+0000","last_unstale":"2024-09-17T01:59:48.748874+0000","last_undegraded":"2024-09-17T01:59:48.748874+0000","last_fullsized":"2024-09-17T01:59:48.748874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'358","last_scrub_stamp":"2024-09-17T01:59:48.748664+0000","last_deep_scrub":"64'358","last_deep_scrub_stamp":"2024-09-17T01:59:48.748664+0000","last_clean_scrub_stamp":"2024-09-17T01:59:48.748664+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:33.015465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8993,"num_write":331,"num_write_kb":42510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'392","reported_seq":582,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:11.566724+0000","last_change":"2024-09-17T02:00:11.566784+0000","last_active":"2024-09-17T02:00:11.566724+0000","last_peered":"2024-09-17T02:00:11.566724+0000","last_clean":"2024-09-17T02:00:11.566724+0000","last_became_active":"2024-09-17T01:54:45.085702+0000","last_became_peered":"2024-09-17T01:54:45.085702+0000","last_unstale":"2024-09-17T02:00:11.566724+0000","last_undegraded":"2024-09-17T02:00:11.566724+0000","last_fullsized":"2024-09-17T02:00:11.566724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'392","last_scrub_stamp":"2024-09-17T02:00:11.566522+0000","last_deep_scrub":"64'392","last_deep_scrub_stamp":"2024-09-17T02:00:11.566522+0000","last_clean_scrub_stamp":"2024-09-17T02:00:11.566522+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:34.613422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":205,"num_write":352,"num_write_kb":21459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'435","reported_seq":653,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.126352+0000","last_change":"2024-09-17T01:59:55.126413+0000","last_active":"2024-09-17T01:59:55.126352+0000","last_peered":"2024-09-17T01:59:55.126352+0000","last_clean":"2024-09-17T01:59:55.126352+0000","last_became_active":"2024-09-17T01:59:32.341843+0000","last_became_peered":"2024-09-17T01:59:32.341843+0000","last_unstale":"2024-09-17T01:59:55.126352+0000","last_undegraded":"2024-09-17T01:59:55.126352+0000","last_fullsized":"2024-09-17T01:59:55.126352+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'435","last_scrub_stamp":"2024-09-17T01:59:55.126138+0000","last_deep_scrub":"64'435","last_deep_scrub_stamp":"2024-09-17T01:59:55.126138+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.126138+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:29.203736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32314,"num_write":406,"num_write_kb":92659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'394","reported_seq":602,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:07.096806+0000","last_change":"2024-09-17T02:00:07.096866+0000","last_active":"2024-09-17T02:00:07.096806+0000","last_peered":"2024-09-17T02:00:07.096806+0000","last_clean":"2024-09-17T02:00:07.096806+0000","last_became_active":"2024-09-17T01:59:19.346991+0000","last_became_peered":"2024-09-17T01:59:19.346991+0000","last_unstale":"2024-09-17T02:00:07.096806+0000","last_undegraded":"2024-09-17T02:00:07.096806+0000","last_fullsized":"2024-09-17T02:00:07.096806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'394","last_scrub_stamp":"2024-09-17T02:00:07.096606+0000","last_deep_scrub":"64'394","last_deep_scrub_stamp":"2024-09-17T02:00:07.096606+0000","last_clean_scrub_stamp":"2024-09-17T02:00:07.096606+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:40.968311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14318,"num_write":351,"num_write_kb":54525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'448","reported_seq":650,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:27.253260+0000","last_change":"2024-09-17T02:00:27.253318+0000","last_active":"2024-09-17T02:00:27.253260+0000","last_peered":"2024-09-17T02:00:27.253260+0000","last_clean":"2024-09-17T02:00:27.253260+0000","last_became_active":"2024-09-17T01:59:38.359630+0000","last_became_peered":"2024-09-17T01:59:38.359630+0000","last_unstale":"2024-09-17T02:00:27.253260+0000","last_undegraded":"2024-09-17T02:00:27.253260+0000","last_fullsized":"2024-09-17T02:00:27.253260+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T02:00:27.253067+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T02:00:27.253067+0000","last_clean_scrub_stamp":"2024-09-17T02:00:27.253067+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:45.378966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42134,"num_write":413,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'389","reported_seq":603,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.724651+0000","last_change":"2024-09-17T02:00:01.724714+0000","last_active":"2024-09-17T02:00:01.724651+0000","last_peered":"2024-09-17T02:00:01.724651+0000","last_clean":"2024-09-17T02:00:01.724651+0000","last_became_active":"2024-09-17T01:54:45.097785+0000","last_became_peered":"2024-09-17T01:54:45.097785+0000","last_unstale":"2024-09-17T02:00:01.724651+0000","last_undegraded":"2024-09-17T02:00:01.724651+0000","last_fullsized":"2024-09-17T02:00:01.724651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'389","last_scrub_stamp":"2024-09-17T02:00:01.724315+0000","last_deep_scrub":"64'389","last_deep_scrub_stamp":"2024-09-17T02:00:01.724315+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.724315+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:03.064141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12495,"num_write":365,"num_write_kb":22581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'399","reported_seq":632,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.460179+0000","last_change":"2024-09-17T02:00:03.460239+0000","last_active":"2024-09-17T02:00:03.460179+0000","last_peered":"2024-09-17T02:00:03.460179+0000","last_clean":"2024-09-17T02:00:03.460179+0000","last_became_active":"2024-09-17T01:54:45.086138+0000","last_became_peered":"2024-09-17T01:54:45.086138+0000","last_unstale":"2024-09-17T02:00:03.460179+0000","last_undegraded":"2024-09-17T02:00:03.460179+0000","last_fullsized":"2024-09-17T02:00:03.460179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'399","last_scrub_stamp":"2024-09-17T02:00:03.459975+0000","last_deep_scrub":"64'399","last_deep_scrub_stamp":"2024-09-17T02:00:03.459975+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.459975+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:48.232140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26510,"num_write":360,"num_write_kb":42053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'437","reported_seq":687,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:48.911467+0000","last_change":"2024-09-17T01:59:48.911621+0000","last_active":"2024-09-17T01:59:48.911467+0000","last_peered":"2024-09-17T01:59:48.911467+0000","last_clean":"2024-09-17T01:59:48.911467+0000","last_became_active":"2024-09-17T01:56:31.404365+0000","last_became_peered":"2024-09-17T01:56:31.404365+0000","last_unstale":"2024-09-17T01:59:48.911467+0000","last_undegraded":"2024-09-17T01:59:48.911467+0000","last_fullsized":"2024-09-17T01:59:48.911467+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'437","last_scrub_stamp":"2024-09-17T01:59:48.911222+0000","last_deep_scrub":"64'437","last_deep_scrub_stamp":"2024-09-17T01:59:48.911222+0000","last_clean_scrub_stamp":"2024-09-17T01:59:48.911222+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:37.342392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":25396,"num_write":398,"num_write_kb":80062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'465","reported_seq":702,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:11.099623+0000","last_change":"2024-09-17T02:00:11.099684+0000","last_active":"2024-09-17T02:00:11.099623+0000","last_peered":"2024-09-17T02:00:11.099623+0000","last_clean":"2024-09-17T02:00:11.099623+0000","last_became_active":"2024-09-17T01:59:22.350378+0000","last_became_peered":"2024-09-17T01:59:22.350378+0000","last_unstale":"2024-09-17T02:00:11.099623+0000","last_undegraded":"2024-09-17T02:00:11.099623+0000","last_fullsized":"2024-09-17T02:00:11.099623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'465","last_scrub_stamp":"2024-09-17T02:00:11.099427+0000","last_deep_scrub":"64'465","last_deep_scrub_stamp":"2024-09-17T02:00:11.099427+0000","last_clean_scrub_stamp":"2024-09-17T02:00:11.099427+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:39.012272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":32682,"num_write":440,"num_write_kb":109710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'393","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:22.224219+0000","last_change":"2024-09-17T02:00:22.224287+0000","last_active":"2024-09-17T02:00:22.224219+0000","last_peered":"2024-09-17T02:00:22.224219+0000","last_clean":"2024-09-17T02:00:22.224219+0000","last_became_active":"2024-09-17T01:59:32.345727+0000","last_became_peered":"2024-09-17T01:59:32.345727+0000","last_unstale":"2024-09-17T02:00:22.224219+0000","last_undegraded":"2024-09-17T02:00:22.224219+0000","last_fullsized":"2024-09-17T02:00:22.224219+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'393","last_scrub_stamp":"2024-09-17T02:00:22.224022+0000","last_deep_scrub":"64'393","last_deep_scrub_stamp":"2024-09-17T02:00:22.224022+0000","last_clean_scrub_stamp":"2024-09-17T02:00:22.224022+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:25.880997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13950,"num_write":370,"num_write_kb":71276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'482","reported_seq":1186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:19.500000+0000","last_change":"2024-09-17T02:00:19.500099+0000","last_active":"2024-09-17T02:00:19.500000+0000","last_peered":"2024-09-17T02:00:19.500000+0000","last_clean":"2024-09-17T02:00:19.500000+0000","last_became_active":"2024-09-17T01:59:27.830300+0000","last_became_peered":"2024-09-17T01:59:27.830300+0000","last_unstale":"2024-09-17T02:00:19.500000+0000","last_undegraded":"2024-09-17T02:00:19.500000+0000","last_fullsized":"2024-09-17T02:00:19.500000+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'482","last_scrub_stamp":"2024-09-17T02:00:19.499794+0000","last_deep_scrub":"64'482","last_deep_scrub_stamp":"2024-09-17T02:00:19.499794+0000","last_clean_scrub_stamp":"2024-09-17T02:00:19.499794+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:14.616077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":55389,"num_write":448,"num_write_kb":121603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'438","reported_seq":1086,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:14.699524+0000","last_change":"2024-09-17T02:00:14.699583+0000","last_active":"2024-09-17T02:00:14.699524+0000","last_peered":"2024-09-17T02:00:14.699524+0000","last_clean":"2024-09-17T02:00:14.699524+0000","last_became_active":"2024-09-17T01:59:15.840044+0000","last_became_peered":"2024-09-17T01:59:15.840044+0000","last_unstale":"2024-09-17T02:00:14.699524+0000","last_undegraded":"2024-09-17T02:00:14.699524+0000","last_fullsized":"2024-09-17T02:00:14.699524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'438","last_scrub_stamp":"2024-09-17T02:00:14.699325+0000","last_deep_scrub":"64'438","last_deep_scrub_stamp":"2024-09-17T02:00:14.699325+0000","last_clean_scrub_stamp":"2024-09-17T02:00:14.699325+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:08.706354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41334,"num_write":407,"num_write_kb":117027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'444","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:01.465394+0000","last_change":"2024-09-17T02:00:01.465561+0000","last_active":"2024-09-17T02:00:01.465394+0000","last_peered":"2024-09-17T02:00:01.465394+0000","last_clean":"2024-09-17T02:00:01.465394+0000","last_became_active":"2024-09-17T01:54:45.095782+0000","last_became_peered":"2024-09-17T01:54:45.095782+0000","last_unstale":"2024-09-17T02:00:01.465394+0000","last_undegraded":"2024-09-17T02:00:01.465394+0000","last_fullsized":"2024-09-17T02:00:01.465394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'444","last_scrub_stamp":"2024-09-17T02:00:01.465159+0000","last_deep_scrub":"64'444","last_deep_scrub_stamp":"2024-09-17T02:00:01.465159+0000","last_clean_scrub_stamp":"2024-09-17T02:00:01.465159+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:13.733096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20687,"num_write":416,"num_write_kb":71736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'418","reported_seq":1029,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.495781+0000","last_change":"2024-09-17T02:00:04.495942+0000","last_active":"2024-09-17T02:00:04.495781+0000","last_peered":"2024-09-17T02:00:04.495781+0000","last_clean":"2024-09-17T02:00:04.495781+0000","last_became_active":"2024-09-17T01:59:13.828405+0000","last_became_peered":"2024-09-17T01:59:13.828405+0000","last_unstale":"2024-09-17T02:00:04.495781+0000","last_undegraded":"2024-09-17T02:00:04.495781+0000","last_fullsized":"2024-09-17T02:00:04.495781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'418","last_scrub_stamp":"2024-09-17T02:00:04.495540+0000","last_deep_scrub":"64'418","last_deep_scrub_stamp":"2024-09-17T02:00:04.495540+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.495540+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:04.935703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6709,"num_write":402,"num_write_kb":29848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'468","reported_seq":1109,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:13.664423+0000","last_change":"2024-09-17T02:00:13.664491+0000","last_active":"2024-09-17T02:00:13.664423+0000","last_peered":"2024-09-17T02:00:13.664423+0000","last_clean":"2024-09-17T02:00:13.664423+0000","last_became_active":"2024-09-17T01:59:14.833874+0000","last_became_peered":"2024-09-17T01:59:14.833874+0000","last_unstale":"2024-09-17T02:00:13.664423+0000","last_undegraded":"2024-09-17T02:00:13.664423+0000","last_fullsized":"2024-09-17T02:00:13.664423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'468","last_scrub_stamp":"2024-09-17T02:00:13.664226+0000","last_deep_scrub":"64'468","last_deep_scrub_stamp":"2024-09-17T02:00:13.664226+0000","last_clean_scrub_stamp":"2024-09-17T02:00:13.664226+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:18.186319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":21152,"num_write":429,"num_write_kb":64149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'409","reported_seq":574,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:26.255984+0000","last_change":"2024-09-17T02:00:26.256046+0000","last_active":"2024-09-17T02:00:26.255984+0000","last_peered":"2024-09-17T02:00:26.255984+0000","last_clean":"2024-09-17T02:00:26.255984+0000","last_became_active":"2024-09-17T01:59:36.359525+0000","last_became_peered":"2024-09-17T01:59:36.359525+0000","last_unstale":"2024-09-17T02:00:26.255984+0000","last_undegraded":"2024-09-17T02:00:26.255984+0000","last_fullsized":"2024-09-17T02:00:26.255984+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'409","last_scrub_stamp":"2024-09-17T02:00:26.255781+0000","last_deep_scrub":"64'409","last_deep_scrub_stamp":"2024-09-17T02:00:26.255781+0000","last_clean_scrub_stamp":"2024-09-17T02:00:26.255781+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:28.641572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12391,"num_write":376,"num_write_kb":51234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'405","reported_seq":978,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:16.474818+0000","last_change":"2024-09-17T02:00:16.474878+0000","last_active":"2024-09-17T02:00:16.474818+0000","last_peered":"2024-09-17T02:00:16.474818+0000","last_clean":"2024-09-17T02:00:16.474818+0000","last_became_active":"2024-09-17T01:59:22.823808+0000","last_became_peered":"2024-09-17T01:59:22.823808+0000","last_unstale":"2024-09-17T02:00:16.474818+0000","last_undegraded":"2024-09-17T02:00:16.474818+0000","last_fullsized":"2024-09-17T02:00:16.474818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'405","last_scrub_stamp":"2024-09-17T02:00:16.474606+0000","last_deep_scrub":"64'405","last_deep_scrub_stamp":"2024-09-17T02:00:16.474606+0000","last_clean_scrub_stamp":"2024-09-17T02:00:16.474606+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:23.817265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13298,"num_write":379,"num_write_kb":83780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'398","reported_seq":627,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.805632+0000","last_change":"2024-09-17T01:59:57.805700+0000","last_active":"2024-09-17T01:59:57.805632+0000","last_peered":"2024-09-17T01:59:57.805632+0000","last_clean":"2024-09-17T01:59:57.805632+0000","last_became_active":"2024-09-17T01:54:45.100883+0000","last_became_peered":"2024-09-17T01:54:45.100883+0000","last_unstale":"2024-09-17T01:59:57.805632+0000","last_undegraded":"2024-09-17T01:59:57.805632+0000","last_fullsized":"2024-09-17T01:59:57.805632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'398","last_scrub_stamp":"2024-09-17T01:59:57.805435+0000","last_deep_scrub":"64'398","last_deep_scrub_stamp":"2024-09-17T01:59:57.805435+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.805435+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.291696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15428,"num_write":361,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'449","reported_seq":1068,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:18.532262+0000","last_change":"2024-09-17T02:00:18.532322+0000","last_active":"2024-09-17T02:00:18.532262+0000","last_peered":"2024-09-17T02:00:18.532262+0000","last_clean":"2024-09-17T02:00:18.532262+0000","last_became_active":"2024-09-17T01:59:25.830593+0000","last_became_peered":"2024-09-17T01:59:25.830593+0000","last_unstale":"2024-09-17T02:00:18.532262+0000","last_undegraded":"2024-09-17T02:00:18.532262+0000","last_fullsized":"2024-09-17T02:00:18.532262+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'449","last_scrub_stamp":"2024-09-17T02:00:18.532054+0000","last_deep_scrub":"64'449","last_deep_scrub_stamp":"2024-09-17T02:00:18.532054+0000","last_clean_scrub_stamp":"2024-09-17T02:00:18.532054+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:37.792682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9535,"num_write":408,"num_write_kb":54585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'446","reported_seq":688,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.648200+0000","last_change":"2024-09-17T02:00:03.648261+0000","last_active":"2024-09-17T02:00:03.648200+0000","last_peered":"2024-09-17T02:00:03.648200+0000","last_clean":"2024-09-17T02:00:03.648200+0000","last_became_active":"2024-09-17T01:54:45.098450+0000","last_became_peered":"2024-09-17T01:54:45.098450+0000","last_unstale":"2024-09-17T02:00:03.648200+0000","last_undegraded":"2024-09-17T02:00:03.648200+0000","last_fullsized":"2024-09-17T02:00:03.648200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'446","last_scrub_stamp":"2024-09-17T02:00:03.647994+0000","last_deep_scrub":"64'446","last_deep_scrub_stamp":"2024-09-17T02:00:03.647994+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.647994+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:23.548700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":22729,"num_write":409,"num_write_kb":60109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'457","reported_seq":698,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:21.250268+0000","last_change":"2024-09-17T02:00:21.250348+0000","last_active":"2024-09-17T02:00:21.250268+0000","last_peered":"2024-09-17T02:00:21.250268+0000","last_clean":"2024-09-17T02:00:21.250268+0000","last_became_active":"2024-09-17T01:59:24.349947+0000","last_became_peered":"2024-09-17T01:59:24.349947+0000","last_unstale":"2024-09-17T02:00:21.250268+0000","last_undegraded":"2024-09-17T02:00:21.250268+0000","last_fullsized":"2024-09-17T02:00:21.250268+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'457","last_scrub_stamp":"2024-09-17T02:00:21.250083+0000","last_deep_scrub":"64'457","last_deep_scrub_stamp":"2024-09-17T02:00:21.250083+0000","last_clean_scrub_stamp":"2024-09-17T02:00:21.250083+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:06.405440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43600,"num_write":421,"num_write_kb":89126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'412","reported_seq":655,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:13.504267+0000","last_change":"2024-09-17T02:00:13.504329+0000","last_active":"2024-09-17T02:00:13.504267+0000","last_peered":"2024-09-17T02:00:13.504267+0000","last_clean":"2024-09-17T02:00:13.504267+0000","last_became_active":"2024-09-17T01:54:45.085807+0000","last_became_peered":"2024-09-17T01:54:45.085807+0000","last_unstale":"2024-09-17T02:00:13.504267+0000","last_undegraded":"2024-09-17T02:00:13.504267+0000","last_fullsized":"2024-09-17T02:00:13.504267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'412","last_scrub_stamp":"2024-09-17T02:00:13.504047+0000","last_deep_scrub":"64'412","last_deep_scrub_stamp":"2024-09-17T02:00:13.504047+0000","last_clean_scrub_stamp":"2024-09-17T02:00:13.504047+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:12.044052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":20650,"num_write":371,"num_write_kb":104728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"103'469","reported_seq":595,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.093777+0000","last_change":"2024-09-17T02:00:04.093852+0000","last_active":"2024-09-17T02:00:04.093777+0000","last_peered":"2024-09-17T02:00:04.093777+0000","last_clean":"2024-09-17T02:00:04.093777+0000","last_became_active":"2024-09-17T01:59:11.775071+0000","last_became_peered":"2024-09-17T01:59:11.775071+0000","last_unstale":"2024-09-17T02:00:04.093777+0000","last_undegraded":"2024-09-17T02:00:04.093777+0000","last_fullsized":"2024-09-17T02:00:04.093777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'469","last_scrub_stamp":"2024-09-17T02:00:04.093598+0000","last_deep_scrub":"103'469","last_deep_scrub_stamp":"2024-09-17T02:00:04.093598+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.093598+0000","objects_scrubbed":4,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:53.555288+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'421","reported_seq":677,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:10.539053+0000","last_change":"2024-09-17T02:00:10.539115+0000","last_active":"2024-09-17T02:00:10.539053+0000","last_peered":"2024-09-17T02:00:10.539053+0000","last_clean":"2024-09-17T02:00:10.539053+0000","last_became_active":"2024-09-17T01:54:45.082408+0000","last_became_peered":"2024-09-17T01:54:45.082408+0000","last_unstale":"2024-09-17T02:00:10.539053+0000","last_undegraded":"2024-09-17T02:00:10.539053+0000","last_fullsized":"2024-09-17T02:00:10.539053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'421","last_scrub_stamp":"2024-09-17T02:00:10.538853+0000","last_deep_scrub":"64'421","last_deep_scrub_stamp":"2024-09-17T02:00:10.538853+0000","last_clean_scrub_stamp":"2024-09-17T02:00:10.538853+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:53.132182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35699,"num_write":377,"num_write_kb":71309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"64'53","reported_seq":252,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.867042+0000","last_change":"2024-09-17T01:59:54.867115+0000","last_active":"2024-09-17T01:59:54.867042+0000","last_peered":"2024-09-17T01:59:54.867042+0000","last_clean":"2024-09-17T01:59:54.867042+0000","last_became_active":"2024-09-17T01:59:08.270075+0000","last_became_peered":"2024-09-17T01:59:08.270075+0000","last_unstale":"2024-09-17T01:59:54.867042+0000","last_undegraded":"2024-09-17T01:59:54.867042+0000","last_fullsized":"2024-09-17T01:59:54.867042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'53","last_scrub_stamp":"2024-09-17T01:59:54.866825+0000","last_deep_scrub":"64'53","last_deep_scrub_stamp":"2024-09-17T01:59:54.866825+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.866825+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:35.320396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'438","reported_seq":1097,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:16.725697+0000","last_change":"2024-09-17T02:00:16.725758+0000","last_active":"2024-09-17T02:00:16.725697+0000","last_peered":"2024-09-17T02:00:16.725697+0000","last_clean":"2024-09-17T02:00:16.725697+0000","last_became_active":"2024-09-17T01:59:28.835378+0000","last_became_peered":"2024-09-17T01:59:28.835378+0000","last_unstale":"2024-09-17T02:00:16.725697+0000","last_undegraded":"2024-09-17T02:00:16.725697+0000","last_fullsized":"2024-09-17T02:00:16.725697+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'438","last_scrub_stamp":"2024-09-17T02:00:16.725494+0000","last_deep_scrub":"64'438","last_deep_scrub_stamp":"2024-09-17T02:00:16.725494+0000","last_clean_scrub_stamp":"2024-09-17T02:00:16.725494+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:11.841776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43624,"num_write":407,"num_write_kb":80482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"64'79","reported_seq":277,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.696024+0000","last_change":"2024-09-17T01:59:52.696089+0000","last_active":"2024-09-17T01:59:52.696024+0000","last_peered":"2024-09-17T01:59:52.696024+0000","last_clean":"2024-09-17T01:59:52.696024+0000","last_became_active":"2024-09-17T01:59:08.268686+0000","last_became_peered":"2024-09-17T01:59:08.268686+0000","last_unstale":"2024-09-17T01:59:52.696024+0000","last_undegraded":"2024-09-17T01:59:52.696024+0000","last_fullsized":"2024-09-17T01:59:52.696024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'79","last_scrub_stamp":"2024-09-17T01:59:52.695828+0000","last_deep_scrub":"64'79","last_deep_scrub_stamp":"2024-09-17T01:59:52.695828+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.695828+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:49.909883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'402","reported_seq":1004,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:19.767051+0000","last_change":"2024-09-17T02:00:19.767115+0000","last_active":"2024-09-17T02:00:19.767051+0000","last_peered":"2024-09-17T02:00:19.767051+0000","last_clean":"2024-09-17T02:00:19.767051+0000","last_became_active":"2024-09-17T01:59:38.850982+0000","last_became_peered":"2024-09-17T01:59:38.850982+0000","last_unstale":"2024-09-17T02:00:19.767051+0000","last_undegraded":"2024-09-17T02:00:19.767051+0000","last_fullsized":"2024-09-17T02:00:19.767051+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'402","last_scrub_stamp":"2024-09-17T02:00:19.766865+0000","last_deep_scrub":"64'402","last_deep_scrub_stamp":"2024-09-17T02:00:19.766865+0000","last_clean_scrub_stamp":"2024-09-17T02:00:19.766865+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:09.508838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29862,"num_write":368,"num_write_kb":88277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"103'74","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:18.197897+0000","last_change":"2024-09-17T02:00:18.198086+0000","last_active":"2024-09-17T02:00:18.197897+0000","last_peered":"2024-09-17T02:00:18.197897+0000","last_clean":"2024-09-17T02:00:18.197897+0000","last_became_active":"2024-09-17T01:59:08.779656+0000","last_became_peered":"2024-09-17T01:59:08.779656+0000","last_unstale":"2024-09-17T02:00:18.197897+0000","last_undegraded":"2024-09-17T02:00:18.197897+0000","last_fullsized":"2024-09-17T02:00:18.197897+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'74","last_scrub_stamp":"2024-09-17T02:00:18.197668+0000","last_deep_scrub":"103'74","last_deep_scrub_stamp":"2024-09-17T02:00:18.197668+0000","last_clean_scrub_stamp":"2024-09-17T02:00:18.197668+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:15.497251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"103'143","reported_seq":273,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:10.149060+0000","last_change":"2024-09-17T02:00:10.149142+0000","last_active":"2024-09-17T02:00:10.149060+0000","last_peered":"2024-09-17T02:00:10.149060+0000","last_clean":"2024-09-17T02:00:10.149060+0000","last_became_active":"2024-09-17T01:59:11.771920+0000","last_became_peered":"2024-09-17T01:59:11.771920+0000","last_unstale":"2024-09-17T02:00:10.149060+0000","last_undegraded":"2024-09-17T02:00:10.149060+0000","last_fullsized":"2024-09-17T02:00:10.149060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'143","last_scrub_stamp":"2024-09-17T02:00:10.148877+0000","last_deep_scrub":"103'143","last_deep_scrub_stamp":"2024-09-17T02:00:10.148877+0000","last_clean_scrub_stamp":"2024-09-17T02:00:10.148877+0000","objects_scrubbed":2,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:23:45.668619+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'412","reported_seq":1002,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:17.506250+0000","last_change":"2024-09-17T02:00:17.506310+0000","last_active":"2024-09-17T02:00:17.506250+0000","last_peered":"2024-09-17T02:00:17.506250+0000","last_clean":"2024-09-17T02:00:17.506250+0000","last_became_active":"2024-09-17T01:59:24.829003+0000","last_became_peered":"2024-09-17T01:59:24.829003+0000","last_unstale":"2024-09-17T02:00:17.506250+0000","last_undegraded":"2024-09-17T02:00:17.506250+0000","last_fullsized":"2024-09-17T02:00:17.506250+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'412","last_scrub_stamp":"2024-09-17T02:00:17.506040+0000","last_deep_scrub":"64'412","last_deep_scrub_stamp":"2024-09-17T02:00:17.506040+0000","last_clean_scrub_stamp":"2024-09-17T02:00:17.506040+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:11.513069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12617,"num_write":381,"num_write_kb":46800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"103'266","reported_seq":471,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.510640+0000","last_change":"2024-09-17T02:00:00.510709+0000","last_active":"2024-09-17T02:00:00.510640+0000","last_peered":"2024-09-17T02:00:00.510640+0000","last_clean":"2024-09-17T02:00:00.510640+0000","last_became_active":"2024-09-17T01:59:11.251820+0000","last_became_peered":"2024-09-17T01:59:11.251820+0000","last_unstale":"2024-09-17T02:00:00.510640+0000","last_undegraded":"2024-09-17T02:00:00.510640+0000","last_fullsized":"2024-09-17T02:00:00.510640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'266","last_scrub_stamp":"2024-09-17T02:00:00.510440+0000","last_deep_scrub":"103'266","last_deep_scrub_stamp":"2024-09-17T02:00:00.510440+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.510440+0000","objects_scrubbed":2,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:58.677924+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":207,"num_write_kb":4201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'453","reported_seq":662,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:09.527388+0000","last_change":"2024-09-17T02:00:09.527486+0000","last_active":"2024-09-17T02:00:09.527388+0000","last_peered":"2024-09-17T02:00:09.527388+0000","last_clean":"2024-09-17T02:00:09.527388+0000","last_became_active":"2024-09-17T01:54:45.081866+0000","last_became_peered":"2024-09-17T01:54:45.081866+0000","last_unstale":"2024-09-17T02:00:09.527388+0000","last_undegraded":"2024-09-17T02:00:09.527388+0000","last_fullsized":"2024-09-17T02:00:09.527388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'453","last_scrub_stamp":"2024-09-17T02:00:09.527192+0000","last_deep_scrub":"64'453","last_deep_scrub_stamp":"2024-09-17T02:00:09.527192+0000","last_clean_scrub_stamp":"2024-09-17T02:00:09.527192+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:16.384888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10174,"num_write":427,"num_write_kb":72442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"103'570","reported_seq":700,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.114976+0000","last_change":"2024-09-17T02:00:06.115047+0000","last_active":"2024-09-17T02:00:06.114976+0000","last_peered":"2024-09-17T02:00:06.114976+0000","last_clean":"2024-09-17T02:00:06.114976+0000","last_became_active":"2024-09-17T01:59:11.771989+0000","last_became_peered":"2024-09-17T01:59:11.771989+0000","last_unstale":"2024-09-17T02:00:06.114976+0000","last_undegraded":"2024-09-17T02:00:06.114976+0000","last_fullsized":"2024-09-17T02:00:06.114976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'570","last_scrub_stamp":"2024-09-17T02:00:06.114781+0000","last_deep_scrub":"103'570","last_deep_scrub_stamp":"2024-09-17T02:00:06.114781+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.114781+0000","objects_scrubbed":2,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:03.355630+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'437","reported_seq":652,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:28.215908+0000","last_change":"2024-09-17T02:00:28.215967+0000","last_active":"2024-09-17T02:00:28.215908+0000","last_peered":"2024-09-17T02:00:28.215908+0000","last_clean":"2024-09-17T02:00:28.215908+0000","last_became_active":"2024-09-17T01:59:39.374547+0000","last_became_peered":"2024-09-17T01:59:39.374547+0000","last_unstale":"2024-09-17T02:00:28.215908+0000","last_undegraded":"2024-09-17T02:00:28.215908+0000","last_fullsized":"2024-09-17T02:00:28.215908+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'437","last_scrub_stamp":"2024-09-17T02:00:28.215728+0000","last_deep_scrub":"64'437","last_deep_scrub_stamp":"2024-09-17T02:00:28.215728+0000","last_clean_scrub_stamp":"2024-09-17T02:00:28.215728+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:54.736165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":40279,"num_write":404,"num_write_kb":75886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"64'68","reported_seq":91,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:14.118657+0000","last_change":"2024-09-17T02:00:14.118720+0000","last_active":"2024-09-17T02:00:14.118657+0000","last_peered":"2024-09-17T02:00:14.118657+0000","last_clean":"2024-09-17T02:00:14.118657+0000","last_became_active":"2024-09-17T01:59:08.780372+0000","last_became_peered":"2024-09-17T01:59:08.780372+0000","last_unstale":"2024-09-17T02:00:14.118657+0000","last_undegraded":"2024-09-17T02:00:14.118657+0000","last_fullsized":"2024-09-17T02:00:14.118657+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'68","last_scrub_stamp":"2024-09-17T02:00:14.118457+0000","last_deep_scrub":"64'68","last_deep_scrub_stamp":"2024-09-17T02:00:14.118457+0000","last_clean_scrub_stamp":"2024-09-17T02:00:14.118457+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:46.346089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'425","reported_seq":1018,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:15.704527+0000","last_change":"2024-09-17T02:00:15.704678+0000","last_active":"2024-09-17T02:00:15.704527+0000","last_peered":"2024-09-17T02:00:15.704527+0000","last_clean":"2024-09-17T02:00:15.704527+0000","last_became_active":"2024-09-17T01:59:19.824600+0000","last_became_peered":"2024-09-17T01:59:19.824600+0000","last_unstale":"2024-09-17T02:00:15.704527+0000","last_undegraded":"2024-09-17T02:00:15.704527+0000","last_fullsized":"2024-09-17T02:00:15.704527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'425","last_scrub_stamp":"2024-09-17T02:00:15.704292+0000","last_deep_scrub":"64'425","last_deep_scrub_stamp":"2024-09-17T02:00:15.704292+0000","last_clean_scrub_stamp":"2024-09-17T02:00:15.704292+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:34.964921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14424,"num_write":389,"num_write_kb":46694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"103'158","reported_seq":364,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.746292+0000","last_change":"2024-09-17T02:00:00.746447+0000","last_active":"2024-09-17T02:00:00.746292+0000","last_peered":"2024-09-17T02:00:00.746292+0000","last_clean":"2024-09-17T02:00:00.746292+0000","last_became_active":"2024-09-17T01:59:11.252724+0000","last_became_peered":"2024-09-17T01:59:11.252724+0000","last_unstale":"2024-09-17T02:00:00.746292+0000","last_undegraded":"2024-09-17T02:00:00.746292+0000","last_fullsized":"2024-09-17T02:00:00.746292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'158","last_scrub_stamp":"2024-09-17T02:00:00.746045+0000","last_deep_scrub":"103'158","last_deep_scrub_stamp":"2024-09-17T02:00:00.746045+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.746045+0000","objects_scrubbed":3,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:45.518209+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'466","reported_seq":652,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.119385+0000","last_change":"2024-09-17T01:59:56.119443+0000","last_active":"2024-09-17T01:59:56.119385+0000","last_peered":"2024-09-17T01:59:56.119385+0000","last_clean":"2024-09-17T01:59:56.119385+0000","last_became_active":"2024-09-17T01:59:25.352165+0000","last_became_peered":"2024-09-17T01:59:25.352165+0000","last_unstale":"2024-09-17T01:59:56.119385+0000","last_undegraded":"2024-09-17T01:59:56.119385+0000","last_fullsized":"2024-09-17T01:59:56.119385+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'466","last_scrub_stamp":"2024-09-17T01:59:56.119169+0000","last_deep_scrub":"64'466","last_deep_scrub_stamp":"2024-09-17T01:59:56.119169+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.119169+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:10.631435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13024,"num_write":431,"num_write_kb":67690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"103'132","reported_seq":249,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.149814+0000","last_change":"2024-09-17T01:59:58.149880+0000","last_active":"2024-09-17T01:59:58.149814+0000","last_peered":"2024-09-17T01:59:58.149814+0000","last_clean":"2024-09-17T01:59:58.149814+0000","last_became_active":"2024-09-17T01:59:12.341033+0000","last_became_peered":"2024-09-17T01:59:12.341033+0000","last_unstale":"2024-09-17T01:59:58.149814+0000","last_undegraded":"2024-09-17T01:59:58.149814+0000","last_fullsized":"2024-09-17T01:59:58.149814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'132","last_scrub_stamp":"2024-09-17T01:59:58.149596+0000","last_deep_scrub":"103'132","last_deep_scrub_stamp":"2024-09-17T01:59:58.149596+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.149596+0000","objects_scrubbed":1,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:28.659970+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'434","reported_seq":685,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:23.224356+0000","last_change":"2024-09-17T02:00:23.224420+0000","last_active":"2024-09-17T02:00:23.224356+0000","last_peered":"2024-09-17T02:00:23.224356+0000","last_clean":"2024-09-17T02:00:23.224356+0000","last_became_active":"2024-09-17T01:59:34.354572+0000","last_became_peered":"2024-09-17T01:59:34.354572+0000","last_unstale":"2024-09-17T02:00:23.224356+0000","last_undegraded":"2024-09-17T02:00:23.224356+0000","last_fullsized":"2024-09-17T02:00:23.224356+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'434","last_scrub_stamp":"2024-09-17T02:00:23.224158+0000","last_deep_scrub":"64'434","last_deep_scrub_stamp":"2024-09-17T02:00:23.224158+0000","last_clean_scrub_stamp":"2024-09-17T02:00:23.224158+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:06.592546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":53278,"num_write":406,"num_write_kb":112606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:54.687592+0000","last_change":"2024-09-17T01:59:54.687658+0000","last_active":"2024-09-17T01:59:54.687592+0000","last_peered":"2024-09-17T01:59:54.687592+0000","last_clean":"2024-09-17T01:59:54.687592+0000","last_became_active":"2024-09-17T01:59:08.268705+0000","last_became_peered":"2024-09-17T01:59:08.268705+0000","last_unstale":"2024-09-17T01:59:54.687592+0000","last_undegraded":"2024-09-17T01:59:54.687592+0000","last_fullsized":"2024-09-17T01:59:54.687592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'52","last_scrub_stamp":"2024-09-17T01:59:54.687392+0000","last_deep_scrub":"64'52","last_deep_scrub_stamp":"2024-09-17T01:59:54.687392+0000","last_clean_scrub_stamp":"2024-09-17T01:59:54.687392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:54.574533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'371","reported_seq":587,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:03.088899+0000","last_change":"2024-09-17T02:00:03.088958+0000","last_active":"2024-09-17T02:00:03.088899+0000","last_peered":"2024-09-17T02:00:03.088899+0000","last_clean":"2024-09-17T02:00:03.088899+0000","last_became_active":"2024-09-17T01:59:17.340512+0000","last_became_peered":"2024-09-17T01:59:17.340512+0000","last_unstale":"2024-09-17T02:00:03.088899+0000","last_undegraded":"2024-09-17T02:00:03.088899+0000","last_fullsized":"2024-09-17T02:00:03.088899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'371","last_scrub_stamp":"2024-09-17T02:00:03.088703+0000","last_deep_scrub":"64'371","last_deep_scrub_stamp":"2024-09-17T02:00:03.088703+0000","last_clean_scrub_stamp":"2024-09-17T02:00:03.088703+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:46.709703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14731,"num_write":342,"num_write_kb":38278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"103'455","reported_seq":646,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:07.561521+0000","last_change":"2024-09-17T02:00:07.561597+0000","last_active":"2024-09-17T02:00:07.561521+0000","last_peered":"2024-09-17T02:00:07.561521+0000","last_clean":"2024-09-17T02:00:07.561521+0000","last_became_active":"2024-09-17T01:54:44.219687+0000","last_became_peered":"2024-09-17T01:54:44.219687+0000","last_unstale":"2024-09-17T02:00:07.561521+0000","last_undegraded":"2024-09-17T02:00:07.561521+0000","last_fullsized":"2024-09-17T02:00:07.561521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'455","last_scrub_stamp":"2024-09-17T02:00:07.561319+0000","last_deep_scrub":"103'455","last_deep_scrub_stamp":"2024-09-17T02:00:07.561319+0000","last_clean_scrub_stamp":"2024-09-17T02:00:07.561319+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:03.848994+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'388","reported_seq":622,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.835352+0000","last_change":"2024-09-17T01:59:51.835469+0000","last_active":"2024-09-17T01:59:51.835352+0000","last_peered":"2024-09-17T01:59:51.835352+0000","last_clean":"2024-09-17T01:59:51.835352+0000","last_became_active":"2024-09-17T01:54:45.104670+0000","last_became_peered":"2024-09-17T01:54:45.104670+0000","last_unstale":"2024-09-17T01:59:51.835352+0000","last_undegraded":"2024-09-17T01:59:51.835352+0000","last_fullsized":"2024-09-17T01:59:51.835352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'388","last_scrub_stamp":"2024-09-17T01:59:51.835109+0000","last_deep_scrub":"64'388","last_deep_scrub_stamp":"2024-09-17T01:59:51.835109+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.835109+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:17.600426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":19894,"num_write":352,"num_write_kb":46233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"103'159","reported_seq":292,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:15.168136+0000","last_change":"2024-09-17T02:00:15.168308+0000","last_active":"2024-09-17T02:00:15.168136+0000","last_peered":"2024-09-17T02:00:15.168136+0000","last_clean":"2024-09-17T02:00:15.168136+0000","last_became_active":"2024-09-17T01:59:08.770575+0000","last_became_peered":"2024-09-17T01:59:08.770575+0000","last_unstale":"2024-09-17T02:00:15.168136+0000","last_undegraded":"2024-09-17T02:00:15.168136+0000","last_fullsized":"2024-09-17T02:00:15.168136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'159","last_scrub_stamp":"2024-09-17T02:00:15.167914+0000","last_deep_scrub":"103'159","last_deep_scrub_stamp":"2024-09-17T02:00:15.167914+0000","last_clean_scrub_stamp":"2024-09-17T02:00:15.167914+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:02.442353+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"103'2","reported_seq":115,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:16.173091+0000","last_change":"2024-09-17T02:00:16.173164+0000","last_active":"2024-09-17T02:00:16.173091+0000","last_peered":"2024-09-17T02:00:16.173091+0000","last_clean":"2024-09-17T02:00:16.173091+0000","last_became_active":"2024-09-17T01:59:08.782680+0000","last_became_peered":"2024-09-17T01:59:08.782680+0000","last_unstale":"2024-09-17T02:00:16.173091+0000","last_undegraded":"2024-09-17T02:00:16.173091+0000","last_fullsized":"2024-09-17T02:00:16.173091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-17T02:00:16.172901+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-17T02:00:16.172901+0000","last_clean_scrub_stamp":"2024-09-17T02:00:16.172901+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:15.895434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"103'416","reported_seq":537,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:08.170573+0000","last_change":"2024-09-17T02:00:08.170734+0000","last_active":"2024-09-17T02:00:08.170573+0000","last_peered":"2024-09-17T02:00:08.170573+0000","last_clean":"2024-09-17T02:00:08.170573+0000","last_became_active":"2024-09-17T01:59:11.771881+0000","last_became_peered":"2024-09-17T01:59:11.771881+0000","last_unstale":"2024-09-17T02:00:08.170573+0000","last_undegraded":"2024-09-17T02:00:08.170573+0000","last_fullsized":"2024-09-17T02:00:08.170573+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'416","last_scrub_stamp":"2024-09-17T02:00:08.170320+0000","last_deep_scrub":"103'416","last_deep_scrub_stamp":"2024-09-17T02:00:08.170320+0000","last_clean_scrub_stamp":"2024-09-17T02:00:08.170320+0000","objects_scrubbed":2,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:57.858419+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":8363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"64'417","reported_seq":610,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:51.079995+0000","last_change":"2024-09-17T01:59:51.080056+0000","last_active":"2024-09-17T01:59:51.079995+0000","last_peered":"2024-09-17T01:59:51.079995+0000","last_clean":"2024-09-17T01:59:51.079995+0000","last_became_active":"2024-09-17T01:59:31.382647+0000","last_became_peered":"2024-09-17T01:59:31.382647+0000","last_unstale":"2024-09-17T01:59:51.079995+0000","last_undegraded":"2024-09-17T01:59:51.079995+0000","last_fullsized":"2024-09-17T01:59:51.079995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'417","last_scrub_stamp":"2024-09-17T01:59:51.079804+0000","last_deep_scrub":"64'417","last_deep_scrub_stamp":"2024-09-17T01:59:51.079804+0000","last_clean_scrub_stamp":"2024-09-17T01:59:51.079804+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:30.364625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21866,"num_write":370,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:19.233349+0000","last_change":"2024-09-17T02:00:19.233465+0000","last_active":"2024-09-17T02:00:19.233349+0000","last_peered":"2024-09-17T02:00:19.233349+0000","last_clean":"2024-09-17T02:00:19.233349+0000","last_became_active":"2024-09-17T01:59:08.785071+0000","last_became_peered":"2024-09-17T01:59:08.785071+0000","last_unstale":"2024-09-17T02:00:19.233349+0000","last_undegraded":"2024-09-17T02:00:19.233349+0000","last_fullsized":"2024-09-17T02:00:19.233349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:19.233122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:19.233122+0000","last_clean_scrub_stamp":"2024-09-17T02:00:19.233122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:37.724946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"103'122","reported_seq":386,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.700062+0000","last_change":"2024-09-17T02:00:02.700124+0000","last_active":"2024-09-17T02:00:02.700062+0000","last_peered":"2024-09-17T02:00:02.700062+0000","last_clean":"2024-09-17T02:00:02.700062+0000","last_became_active":"2024-09-17T01:59:11.255135+0000","last_became_peered":"2024-09-17T01:59:11.255135+0000","last_unstale":"2024-09-17T02:00:02.700062+0000","last_undegraded":"2024-09-17T02:00:02.700062+0000","last_fullsized":"2024-09-17T02:00:02.700062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'122","last_scrub_stamp":"2024-09-17T02:00:02.699876+0000","last_deep_scrub":"103'122","last_deep_scrub_stamp":"2024-09-17T02:00:02.699876+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.699876+0000","objects_scrubbed":1,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:52.853921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468641,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1468641,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'475","reported_seq":723,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.510088+0000","last_change":"2024-09-17T01:59:59.510153+0000","last_active":"2024-09-17T01:59:59.510088+0000","last_peered":"2024-09-17T01:59:59.510088+0000","last_clean":"2024-09-17T01:59:59.510088+0000","last_became_active":"2024-09-17T01:54:45.096294+0000","last_became_peered":"2024-09-17T01:54:45.096294+0000","last_unstale":"2024-09-17T01:59:59.510088+0000","last_undegraded":"2024-09-17T01:59:59.510088+0000","last_fullsized":"2024-09-17T01:59:59.510088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'475","last_scrub_stamp":"2024-09-17T01:59:59.509881+0000","last_deep_scrub":"64'475","last_deep_scrub_stamp":"2024-09-17T01:59:59.509881+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.509881+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:35.658484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":32524,"num_write":443,"num_write_kb":129285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.623647+0000","last_change":"2024-09-17T02:00:06.623755+0000","last_active":"2024-09-17T02:00:06.623647+0000","last_peered":"2024-09-17T02:00:06.623647+0000","last_clean":"2024-09-17T02:00:06.623647+0000","last_became_active":"2024-09-17T01:54:40.026953+0000","last_became_peered":"2024-09-17T01:54:40.026953+0000","last_unstale":"2024-09-17T02:00:06.623647+0000","last_undegraded":"2024-09-17T02:00:06.623647+0000","last_fullsized":"2024-09-17T02:00:06.623647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:06.623405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:06.623405+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.623405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:22.514703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084692700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"103'420","reported_seq":628,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.505511+0000","last_change":"2024-09-17T02:00:02.505511+0000","last_active":"2024-09-17T02:00:02.505511+0000","last_peered":"2024-09-17T02:00:02.505511+0000","last_clean":"2024-09-17T02:00:02.505511+0000","last_became_active":"2024-09-17T01:59:11.251807+0000","last_became_peered":"2024-09-17T01:59:11.251807+0000","last_unstale":"2024-09-17T02:00:02.505511+0000","last_undegraded":"2024-09-17T02:00:02.505511+0000","last_fullsized":"2024-09-17T02:00:02.505511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'420","last_scrub_stamp":"2024-09-17T02:00:02.505125+0000","last_deep_scrub":"103'420","last_deep_scrub_stamp":"2024-09-17T02:00:02.505125+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.505125+0000","objects_scrubbed":2,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:35.693046+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":8329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'362","reported_seq":585,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:55.860404+0000","last_change":"2024-09-17T01:59:55.860465+0000","last_active":"2024-09-17T01:59:55.860404+0000","last_peered":"2024-09-17T01:59:55.860404+0000","last_clean":"2024-09-17T01:59:55.860404+0000","last_became_active":"2024-09-17T01:54:45.101849+0000","last_became_peered":"2024-09-17T01:54:45.101849+0000","last_unstale":"2024-09-17T01:59:55.860404+0000","last_undegraded":"2024-09-17T01:59:55.860404+0000","last_fullsized":"2024-09-17T01:59:55.860404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'362","last_scrub_stamp":"2024-09-17T01:59:55.860209+0000","last_deep_scrub":"64'362","last_deep_scrub_stamp":"2024-09-17T01:59:55.860209+0000","last_clean_scrub_stamp":"2024-09-17T01:59:55.860209+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:09.703402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18389,"num_write":329,"num_write_kb":50284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"103'3","reported_seq":116,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:20.247608+0000","last_change":"2024-09-17T02:00:20.247748+0000","last_active":"2024-09-17T02:00:20.247608+0000","last_peered":"2024-09-17T02:00:20.247608+0000","last_clean":"2024-09-17T02:00:20.247608+0000","last_became_active":"2024-09-17T01:59:08.790748+0000","last_became_peered":"2024-09-17T01:59:08.790748+0000","last_unstale":"2024-09-17T02:00:20.247608+0000","last_undegraded":"2024-09-17T02:00:20.247608+0000","last_fullsized":"2024-09-17T02:00:20.247608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'3","last_scrub_stamp":"2024-09-17T02:00:20.247381+0000","last_deep_scrub":"103'3","last_deep_scrub_stamp":"2024-09-17T02:00:20.247381+0000","last_clean_scrub_stamp":"2024-09-17T02:00:20.247381+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:07.653563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"64'60","reported_seq":91,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:17.163926+0000","last_change":"2024-09-17T02:00:17.163986+0000","last_active":"2024-09-17T02:00:17.163926+0000","last_peered":"2024-09-17T02:00:17.163926+0000","last_clean":"2024-09-17T02:00:17.163926+0000","last_became_active":"2024-09-17T01:59:08.783341+0000","last_became_peered":"2024-09-17T01:59:08.783341+0000","last_unstale":"2024-09-17T02:00:17.163926+0000","last_undegraded":"2024-09-17T02:00:17.163926+0000","last_fullsized":"2024-09-17T02:00:17.163926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'60","last_scrub_stamp":"2024-09-17T02:00:17.163727+0000","last_deep_scrub":"64'60","last_deep_scrub_stamp":"2024-09-17T02:00:17.163727+0000","last_clean_scrub_stamp":"2024-09-17T02:00:17.163727+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:43.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'376","reported_seq":630,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.749517+0000","last_change":"2024-09-17T01:59:59.749607+0000","last_active":"2024-09-17T01:59:59.749517+0000","last_peered":"2024-09-17T01:59:59.749517+0000","last_clean":"2024-09-17T01:59:59.749517+0000","last_became_active":"2024-09-17T01:54:45.101281+0000","last_became_peered":"2024-09-17T01:54:45.101281+0000","last_unstale":"2024-09-17T01:59:59.749517+0000","last_undegraded":"2024-09-17T01:59:59.749517+0000","last_fullsized":"2024-09-17T01:59:59.749517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'376","last_scrub_stamp":"2024-09-17T01:59:59.749279+0000","last_deep_scrub":"64'376","last_deep_scrub_stamp":"2024-09-17T01:59:59.749279+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.749279+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:56.283997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":35591,"num_write":339,"num_write_kb":66847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"103'286","reported_seq":405,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:00.132342+0000","last_change":"2024-09-17T02:00:00.132410+0000","last_active":"2024-09-17T02:00:00.132342+0000","last_peered":"2024-09-17T02:00:00.132342+0000","last_clean":"2024-09-17T02:00:00.132342+0000","last_became_active":"2024-09-17T01:59:11.778022+0000","last_became_peered":"2024-09-17T01:59:11.778022+0000","last_unstale":"2024-09-17T02:00:00.132342+0000","last_undegraded":"2024-09-17T02:00:00.132342+0000","last_fullsized":"2024-09-17T02:00:00.132342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'286","last_scrub_stamp":"2024-09-17T02:00:00.132144+0000","last_deep_scrub":"103'286","last_deep_scrub_stamp":"2024-09-17T02:00:00.132144+0000","last_clean_scrub_stamp":"2024-09-17T02:00:00.132144+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:57.742702+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.629000+0000","last_change":"2024-09-17T02:00:05.629129+0000","last_active":"2024-09-17T02:00:05.629000+0000","last_peered":"2024-09-17T02:00:05.629000+0000","last_clean":"2024-09-17T02:00:05.629000+0000","last_became_active":"2024-09-17T01:54:40.026487+0000","last_became_peered":"2024-09-17T01:54:40.026487+0000","last_unstale":"2024-09-17T02:00:05.629000+0000","last_undegraded":"2024-09-17T02:00:05.629000+0000","last_fullsized":"2024-09-17T02:00:05.629000+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:05.628775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:05.628775+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.628775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:27.681767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084033399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'362","reported_seq":927,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:21.425885+0000","last_change":"2024-09-17T02:00:21.425945+0000","last_active":"2024-09-17T02:00:21.425885+0000","last_peered":"2024-09-17T02:00:21.425885+0000","last_clean":"2024-09-17T02:00:21.425885+0000","last_became_active":"2024-09-17T01:59:34.828198+0000","last_became_peered":"2024-09-17T01:59:34.828198+0000","last_unstale":"2024-09-17T02:00:21.425885+0000","last_undegraded":"2024-09-17T02:00:21.425885+0000","last_fullsized":"2024-09-17T02:00:21.425885+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'362","last_scrub_stamp":"2024-09-17T02:00:21.425677+0000","last_deep_scrub":"64'362","last_deep_scrub_stamp":"2024-09-17T02:00:21.425677+0000","last_clean_scrub_stamp":"2024-09-17T02:00:21.425677+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:35.527862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":22253,"num_write":327,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"64'58","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:07.673132+0000","last_change":"2024-09-17T02:00:07.673262+0000","last_active":"2024-09-17T02:00:07.673132+0000","last_peered":"2024-09-17T02:00:07.673132+0000","last_clean":"2024-09-17T02:00:07.673132+0000","last_became_active":"2024-09-17T01:54:44.229964+0000","last_became_peered":"2024-09-17T01:54:44.229964+0000","last_unstale":"2024-09-17T02:00:07.673132+0000","last_undegraded":"2024-09-17T02:00:07.673132+0000","last_fullsized":"2024-09-17T02:00:07.673132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'58","last_scrub_stamp":"2024-09-17T02:00:07.672903+0000","last_deep_scrub":"64'58","last_deep_scrub_stamp":"2024-09-17T02:00:07.672903+0000","last_clean_scrub_stamp":"2024-09-17T02:00:07.672903+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:57.936699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:06.566222+0000","last_change":"2024-09-17T02:00:06.566275+0000","last_active":"2024-09-17T02:00:06.566222+0000","last_peered":"2024-09-17T02:00:06.566222+0000","last_clean":"2024-09-17T02:00:06.566222+0000","last_became_active":"2024-09-17T01:54:40.018161+0000","last_became_peered":"2024-09-17T01:54:40.018161+0000","last_unstale":"2024-09-17T02:00:06.566222+0000","last_undegraded":"2024-09-17T02:00:06.566222+0000","last_fullsized":"2024-09-17T02:00:06.566222+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:06.566032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:06.566032+0000","last_clean_scrub_stamp":"2024-09-17T02:00:06.566032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:26.466738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080858999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'410","reported_seq":1020,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:15.506441+0000","last_change":"2024-09-17T02:00:15.506501+0000","last_active":"2024-09-17T02:00:15.506441+0000","last_peered":"2024-09-17T02:00:15.506441+0000","last_clean":"2024-09-17T02:00:15.506441+0000","last_became_active":"2024-09-17T01:59:21.831336+0000","last_became_peered":"2024-09-17T01:59:21.831336+0000","last_unstale":"2024-09-17T02:00:15.506441+0000","last_undegraded":"2024-09-17T02:00:15.506441+0000","last_fullsized":"2024-09-17T02:00:15.506441+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'410","last_scrub_stamp":"2024-09-17T02:00:15.506241+0000","last_deep_scrub":"64'410","last_deep_scrub_stamp":"2024-09-17T02:00:15.506241+0000","last_clean_scrub_stamp":"2024-09-17T02:00:15.506241+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:53.929283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":27988,"num_write":378,"num_write_kb":96196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"103'52","reported_seq":244,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:08.703652+0000","last_change":"2024-09-17T02:00:08.703721+0000","last_active":"2024-09-17T02:00:08.703652+0000","last_peered":"2024-09-17T02:00:08.703652+0000","last_clean":"2024-09-17T02:00:08.703652+0000","last_became_active":"2024-09-17T01:54:44.231488+0000","last_became_peered":"2024-09-17T01:54:44.231488+0000","last_unstale":"2024-09-17T02:00:08.703652+0000","last_undegraded":"2024-09-17T02:00:08.703652+0000","last_fullsized":"2024-09-17T02:00:08.703652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'52","last_scrub_stamp":"2024-09-17T02:00:08.703468+0000","last_deep_scrub":"103'52","last_deep_scrub_stamp":"2024-09-17T02:00:08.703468+0000","last_clean_scrub_stamp":"2024-09-17T02:00:08.703468+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:31.750368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:04.617157+0000","last_change":"2024-09-17T02:00:04.617260+0000","last_active":"2024-09-17T02:00:04.617157+0000","last_peered":"2024-09-17T02:00:04.617157+0000","last_clean":"2024-09-17T02:00:04.617157+0000","last_became_active":"2024-09-17T01:54:40.026188+0000","last_became_peered":"2024-09-17T01:54:40.026188+0000","last_unstale":"2024-09-17T02:00:04.617157+0000","last_undegraded":"2024-09-17T02:00:04.617157+0000","last_fullsized":"2024-09-17T02:00:04.617157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:04.616911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:04.616911+0000","last_clean_scrub_stamp":"2024-09-17T02:00:04.616911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:58.497913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094815000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'409","reported_seq":995,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:18.739645+0000","last_change":"2024-09-17T02:00:18.739645+0000","last_active":"2024-09-17T02:00:18.739645+0000","last_peered":"2024-09-17T02:00:18.739645+0000","last_clean":"2024-09-17T02:00:18.739645+0000","last_became_active":"2024-09-17T01:59:36.823916+0000","last_became_peered":"2024-09-17T01:59:36.823916+0000","last_unstale":"2024-09-17T02:00:18.739645+0000","last_undegraded":"2024-09-17T02:00:18.739645+0000","last_fullsized":"2024-09-17T02:00:18.739645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'409","last_scrub_stamp":"2024-09-17T02:00:18.739230+0000","last_deep_scrub":"64'409","last_deep_scrub_stamp":"2024-09-17T02:00:18.739230+0000","last_clean_scrub_stamp":"2024-09-17T02:00:18.739230+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:11.809519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9381,"num_write":372,"num_write_kb":34002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"103'114","reported_seq":318,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.855676+0000","last_change":"2024-09-17T01:59:56.855747+0000","last_active":"2024-09-17T01:59:56.855676+0000","last_peered":"2024-09-17T01:59:56.855676+0000","last_clean":"2024-09-17T01:59:56.855676+0000","last_became_active":"2024-09-17T01:59:08.270339+0000","last_became_peered":"2024-09-17T01:59:08.270339+0000","last_unstale":"2024-09-17T01:59:56.855676+0000","last_undegraded":"2024-09-17T01:59:56.855676+0000","last_fullsized":"2024-09-17T01:59:56.855676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'114","last_scrub_stamp":"2024-09-17T01:59:56.855478+0000","last_deep_scrub":"103'114","last_deep_scrub_stamp":"2024-09-17T01:59:56.855478+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.855478+0000","objects_scrubbed":1,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:36.886614+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:13.126050+0000","last_change":"2024-09-17T02:00:13.126110+0000","last_active":"2024-09-17T02:00:13.126050+0000","last_peered":"2024-09-17T02:00:13.126050+0000","last_clean":"2024-09-17T02:00:13.126050+0000","last_became_active":"2024-09-17T01:59:08.768835+0000","last_became_peered":"2024-09-17T01:59:08.768835+0000","last_unstale":"2024-09-17T02:00:13.126050+0000","last_undegraded":"2024-09-17T02:00:13.126050+0000","last_fullsized":"2024-09-17T02:00:13.126050+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:00:13.125855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:00:13.125855+0000","last_clean_scrub_stamp":"2024-09-17T02:00:13.125855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:51.008979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'420","reported_seq":1054,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:49.750649+0000","last_change":"2024-09-17T01:59:49.750834+0000","last_active":"2024-09-17T01:59:49.750649+0000","last_peered":"2024-09-17T01:59:49.750649+0000","last_clean":"2024-09-17T01:59:49.750649+0000","last_became_active":"2024-09-17T01:59:17.817817+0000","last_became_peered":"2024-09-17T01:59:17.817817+0000","last_unstale":"2024-09-17T01:59:49.750649+0000","last_undegraded":"2024-09-17T01:59:49.750649+0000","last_fullsized":"2024-09-17T01:59:49.750649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'420","last_scrub_stamp":"2024-09-17T01:59:49.750417+0000","last_deep_scrub":"64'420","last_deep_scrub_stamp":"2024-09-17T01:59:49.750417+0000","last_clean_scrub_stamp":"2024-09-17T01:59:49.750417+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:01.334641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":46622,"num_write":389,"num_write_kb":117334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'397","reported_seq":623,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:59.132518+0000","last_change":"2024-09-17T01:59:59.132577+0000","last_active":"2024-09-17T01:59:59.132518+0000","last_peered":"2024-09-17T01:59:59.132518+0000","last_clean":"2024-09-17T01:59:59.132518+0000","last_became_active":"2024-09-17T01:59:12.336999+0000","last_became_peered":"2024-09-17T01:59:12.336999+0000","last_unstale":"2024-09-17T01:59:59.132518+0000","last_undegraded":"2024-09-17T01:59:59.132518+0000","last_fullsized":"2024-09-17T01:59:59.132518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'397","last_scrub_stamp":"2024-09-17T01:59:59.132325+0000","last_deep_scrub":"64'397","last_deep_scrub_stamp":"2024-09-17T01:59:59.132325+0000","last_clean_scrub_stamp":"2024-09-17T01:59:59.132325+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:54.195395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19993,"num_write":349,"num_write_kb":51509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"103'255","reported_seq":452,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:12.162083+0000","last_change":"2024-09-17T02:00:12.162162+0000","last_active":"2024-09-17T02:00:12.162083+0000","last_peered":"2024-09-17T02:00:12.162083+0000","last_clean":"2024-09-17T02:00:12.162083+0000","last_became_active":"2024-09-17T01:59:11.771408+0000","last_became_peered":"2024-09-17T01:59:11.771408+0000","last_unstale":"2024-09-17T02:00:12.162083+0000","last_undegraded":"2024-09-17T02:00:12.162083+0000","last_fullsized":"2024-09-17T02:00:12.162083+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'255","last_scrub_stamp":"2024-09-17T02:00:12.161905+0000","last_deep_scrub":"103'255","last_deep_scrub_stamp":"2024-09-17T02:00:12.161905+0000","last_clean_scrub_stamp":"2024-09-17T02:00:12.161905+0000","objects_scrubbed":6,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:00.709331+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8527098,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4332212,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'422","reported_seq":679,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:53.837198+0000","last_change":"2024-09-17T01:59:53.837259+0000","last_active":"2024-09-17T01:59:53.837198+0000","last_peered":"2024-09-17T01:59:53.837198+0000","last_clean":"2024-09-17T01:59:53.837198+0000","last_became_active":"2024-09-17T01:54:45.099428+0000","last_became_peered":"2024-09-17T01:54:45.099428+0000","last_unstale":"2024-09-17T01:59:53.837198+0000","last_undegraded":"2024-09-17T01:59:53.837198+0000","last_fullsized":"2024-09-17T01:59:53.837198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'422","last_scrub_stamp":"2024-09-17T01:59:53.836992+0000","last_deep_scrub":"64'422","last_deep_scrub_stamp":"2024-09-17T01:59:53.836992+0000","last_clean_scrub_stamp":"2024-09-17T01:59:53.836992+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.243093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47664,"num_write":389,"num_write_kb":75603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"103'84","reported_seq":287,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:56.649475+0000","last_change":"2024-09-17T01:59:56.649623+0000","last_active":"2024-09-17T01:59:56.649475+0000","last_peered":"2024-09-17T01:59:56.649475+0000","last_clean":"2024-09-17T01:59:56.649475+0000","last_became_active":"2024-09-17T01:59:08.270598+0000","last_became_peered":"2024-09-17T01:59:08.270598+0000","last_unstale":"2024-09-17T01:59:56.649475+0000","last_undegraded":"2024-09-17T01:59:56.649475+0000","last_fullsized":"2024-09-17T01:59:56.649475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'84","last_scrub_stamp":"2024-09-17T01:59:56.649242+0000","last_deep_scrub":"103'84","last_deep_scrub_stamp":"2024-09-17T01:59:56.649242+0000","last_clean_scrub_stamp":"2024-09-17T01:59:56.649242+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:17.189578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"103'222","reported_seq":341,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:02.115856+0000","last_change":"2024-09-17T02:00:02.115920+0000","last_active":"2024-09-17T02:00:02.115856+0000","last_peered":"2024-09-17T02:00:02.115856+0000","last_clean":"2024-09-17T02:00:02.115856+0000","last_became_active":"2024-09-17T01:59:11.778213+0000","last_became_peered":"2024-09-17T01:59:11.778213+0000","last_unstale":"2024-09-17T02:00:02.115856+0000","last_undegraded":"2024-09-17T02:00:02.115856+0000","last_fullsized":"2024-09-17T02:00:02.115856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'222","last_scrub_stamp":"2024-09-17T02:00:02.115662+0000","last_deep_scrub":"103'222","last_deep_scrub_stamp":"2024-09-17T02:00:02.115662+0000","last_clean_scrub_stamp":"2024-09-17T02:00:02.115662+0000","objects_scrubbed":1,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:49.938816+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'502","reported_seq":1188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:17.719692+0000","last_change":"2024-09-17T02:00:17.719752+0000","last_active":"2024-09-17T02:00:17.719692+0000","last_peered":"2024-09-17T02:00:17.719692+0000","last_clean":"2024-09-17T02:00:17.719692+0000","last_became_active":"2024-09-17T01:59:32.821228+0000","last_became_peered":"2024-09-17T01:59:32.821228+0000","last_unstale":"2024-09-17T02:00:17.719692+0000","last_undegraded":"2024-09-17T02:00:17.719692+0000","last_fullsized":"2024-09-17T02:00:17.719692+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'502","last_scrub_stamp":"2024-09-17T02:00:17.719489+0000","last_deep_scrub":"64'502","last_deep_scrub_stamp":"2024-09-17T02:00:17.719489+0000","last_clean_scrub_stamp":"2024-09-17T02:00:17.719489+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:41.869214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37903,"num_write":478,"num_write_kb":167092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"64'51","reported_seq":250,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.851026+0000","last_change":"2024-09-17T01:59:52.851087+0000","last_active":"2024-09-17T01:59:52.851026+0000","last_peered":"2024-09-17T01:59:52.851026+0000","last_clean":"2024-09-17T01:59:52.851026+0000","last_became_active":"2024-09-17T01:59:08.264614+0000","last_became_peered":"2024-09-17T01:59:08.264614+0000","last_unstale":"2024-09-17T01:59:52.851026+0000","last_undegraded":"2024-09-17T01:59:52.851026+0000","last_fullsized":"2024-09-17T01:59:52.851026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'51","last_scrub_stamp":"2024-09-17T01:59:52.850833+0000","last_deep_scrub":"64'51","last_deep_scrub_stamp":"2024-09-17T01:59:52.850833+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.850833+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:39.821567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'454","reported_seq":706,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:11.685520+0000","last_change":"2024-09-17T02:00:11.685583+0000","last_active":"2024-09-17T02:00:11.685520+0000","last_peered":"2024-09-17T02:00:11.685520+0000","last_clean":"2024-09-17T02:00:11.685520+0000","last_became_active":"2024-09-17T01:54:45.096024+0000","last_became_peered":"2024-09-17T01:54:45.096024+0000","last_unstale":"2024-09-17T02:00:11.685520+0000","last_undegraded":"2024-09-17T02:00:11.685520+0000","last_fullsized":"2024-09-17T02:00:11.685520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'454","last_scrub_stamp":"2024-09-17T02:00:11.685312+0000","last_deep_scrub":"64'454","last_deep_scrub_stamp":"2024-09-17T02:00:11.685312+0000","last_clean_scrub_stamp":"2024-09-17T02:00:11.685312+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:11.646030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37802,"num_write":429,"num_write_kb":80085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'357","reported_seq":892,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:14.532634+0000","last_change":"2024-09-17T02:00:14.532696+0000","last_active":"2024-09-17T02:00:14.532634+0000","last_peered":"2024-09-17T02:00:14.532634+0000","last_clean":"2024-09-17T02:00:14.532634+0000","last_became_active":"2024-09-17T01:59:15.838065+0000","last_became_peered":"2024-09-17T01:59:15.838065+0000","last_unstale":"2024-09-17T02:00:14.532634+0000","last_undegraded":"2024-09-17T02:00:14.532634+0000","last_fullsized":"2024-09-17T02:00:14.532634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'357","last_scrub_stamp":"2024-09-17T02:00:14.532442+0000","last_deep_scrub":"64'357","last_deep_scrub_stamp":"2024-09-17T02:00:14.532442+0000","last_clean_scrub_stamp":"2024-09-17T02:00:14.532442+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:14.493159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13821,"num_write":327,"num_write_kb":46667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"103'627","reported_seq":819,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:09.770000+0000","last_change":"2024-09-17T02:00:09.770068+0000","last_active":"2024-09-17T02:00:09.770000+0000","last_peered":"2024-09-17T02:00:09.770000+0000","last_clean":"2024-09-17T02:00:09.770000+0000","last_became_active":"2024-09-17T01:54:44.231830+0000","last_became_peered":"2024-09-17T01:54:44.231830+0000","last_unstale":"2024-09-17T02:00:09.770000+0000","last_undegraded":"2024-09-17T02:00:09.770000+0000","last_fullsized":"2024-09-17T02:00:09.770000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'627","last_scrub_stamp":"2024-09-17T02:00:09.769759+0000","last_deep_scrub":"103'627","last_deep_scrub_stamp":"2024-09-17T02:00:09.769759+0000","last_clean_scrub_stamp":"2024-09-17T02:00:09.769759+0000","objects_scrubbed":2,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:56.105125+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":8443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'405","reported_seq":976,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:12.704499+0000","last_change":"2024-09-17T02:00:12.704499+0000","last_active":"2024-09-17T02:00:12.704499+0000","last_peered":"2024-09-17T02:00:12.704499+0000","last_clean":"2024-09-17T02:00:12.704499+0000","last_became_active":"2024-09-17T01:59:12.815040+0000","last_became_peered":"2024-09-17T01:59:12.815040+0000","last_unstale":"2024-09-17T02:00:12.704499+0000","last_undegraded":"2024-09-17T02:00:12.704499+0000","last_fullsized":"2024-09-17T02:00:12.704499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'405","last_scrub_stamp":"2024-09-17T02:00:12.704234+0000","last_deep_scrub":"64'405","last_deep_scrub_stamp":"2024-09-17T02:00:12.704234+0000","last_clean_scrub_stamp":"2024-09-17T02:00:12.704234+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:45.852892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6571,"num_write":373,"num_write_kb":43402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'201","reported_seq":406,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.812835+0000","last_change":"2024-09-17T01:59:58.812901+0000","last_active":"2024-09-17T01:59:58.812835+0000","last_peered":"2024-09-17T01:59:58.812835+0000","last_clean":"2024-09-17T01:59:58.812835+0000","last_became_active":"2024-09-17T01:59:11.252194+0000","last_became_peered":"2024-09-17T01:59:11.252194+0000","last_unstale":"2024-09-17T01:59:58.812835+0000","last_undegraded":"2024-09-17T01:59:58.812835+0000","last_fullsized":"2024-09-17T01:59:58.812835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'201","last_scrub_stamp":"2024-09-17T01:59:58.812664+0000","last_deep_scrub":"103'201","last_deep_scrub_stamp":"2024-09-17T01:59:58.812664+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.812664+0000","objects_scrubbed":1,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:52.732876+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'382","reported_seq":948,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:20.456591+0000","last_change":"2024-09-17T02:00:20.456657+0000","last_active":"2024-09-17T02:00:20.456591+0000","last_peered":"2024-09-17T02:00:20.456591+0000","last_clean":"2024-09-17T02:00:20.456591+0000","last_became_active":"2024-09-17T01:59:29.843931+0000","last_became_peered":"2024-09-17T01:59:29.843931+0000","last_unstale":"2024-09-17T02:00:20.456591+0000","last_undegraded":"2024-09-17T02:00:20.456591+0000","last_fullsized":"2024-09-17T02:00:20.456591+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T02:00:20.456382+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T02:00:20.456382+0000","last_clean_scrub_stamp":"2024-09-17T02:00:20.456382+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:09.459657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":34373,"num_write":334,"num_write_kb":50457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"103'275","reported_seq":466,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:08.549460+0000","last_change":"2024-09-17T02:00:08.549534+0000","last_active":"2024-09-17T02:00:08.549460+0000","last_peered":"2024-09-17T02:00:08.549460+0000","last_clean":"2024-09-17T02:00:08.549460+0000","last_became_active":"2024-09-17T01:54:44.221002+0000","last_became_peered":"2024-09-17T01:54:44.221002+0000","last_unstale":"2024-09-17T02:00:08.549460+0000","last_undegraded":"2024-09-17T02:00:08.549460+0000","last_fullsized":"2024-09-17T02:00:08.549460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'275","last_scrub_stamp":"2024-09-17T02:00:08.549261+0000","last_deep_scrub":"103'275","last_deep_scrub_stamp":"2024-09-17T02:00:08.549261+0000","last_clean_scrub_stamp":"2024-09-17T02:00:08.549261+0000","objects_scrubbed":3,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:37.469825+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'382","reported_seq":603,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.543590+0000","last_change":"2024-09-17T02:00:05.543661+0000","last_active":"2024-09-17T02:00:05.543590+0000","last_peered":"2024-09-17T02:00:05.543590+0000","last_clean":"2024-09-17T02:00:05.543590+0000","last_became_active":"2024-09-17T01:54:45.087085+0000","last_became_peered":"2024-09-17T01:54:45.087085+0000","last_unstale":"2024-09-17T02:00:05.543590+0000","last_undegraded":"2024-09-17T02:00:05.543590+0000","last_fullsized":"2024-09-17T02:00:05.543590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T02:00:05.543386+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T02:00:05.543386+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.543386+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.638925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9008,"num_write":346,"num_write_kb":46938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"103'54","reported_seq":253,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.738098+0000","last_change":"2024-09-17T01:59:50.738161+0000","last_active":"2024-09-17T01:59:50.738098+0000","last_peered":"2024-09-17T01:59:50.738098+0000","last_clean":"2024-09-17T01:59:50.738098+0000","last_became_active":"2024-09-17T01:59:08.263126+0000","last_became_peered":"2024-09-17T01:59:08.263126+0000","last_unstale":"2024-09-17T01:59:50.738098+0000","last_undegraded":"2024-09-17T01:59:50.738098+0000","last_fullsized":"2024-09-17T01:59:50.738098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'54","last_scrub_stamp":"2024-09-17T01:59:50.737902+0000","last_deep_scrub":"103'54","last_deep_scrub_stamp":"2024-09-17T01:59:50.737902+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.737902+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:25.079013+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'398","reported_seq":644,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:05.055987+0000","last_change":"2024-09-17T02:00:05.056048+0000","last_active":"2024-09-17T02:00:05.055987+0000","last_peered":"2024-09-17T02:00:05.055987+0000","last_clean":"2024-09-17T02:00:05.055987+0000","last_became_active":"2024-09-17T01:59:19.344269+0000","last_became_peered":"2024-09-17T01:59:19.344269+0000","last_unstale":"2024-09-17T02:00:05.055987+0000","last_undegraded":"2024-09-17T02:00:05.055987+0000","last_fullsized":"2024-09-17T02:00:05.055987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'398","last_scrub_stamp":"2024-09-17T02:00:05.055791+0000","last_deep_scrub":"64'398","last_deep_scrub_stamp":"2024-09-17T02:00:05.055791+0000","last_clean_scrub_stamp":"2024-09-17T02:00:05.055791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:33.802302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38056,"num_write":370,"num_write_kb":79912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"103'185","reported_seq":311,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.182313+0000","last_change":"2024-09-17T01:59:57.182397+0000","last_active":"2024-09-17T01:59:57.182313+0000","last_peered":"2024-09-17T01:59:57.182313+0000","last_clean":"2024-09-17T01:59:57.182313+0000","last_became_active":"2024-09-17T01:59:12.341601+0000","last_became_peered":"2024-09-17T01:59:12.341601+0000","last_unstale":"2024-09-17T01:59:57.182313+0000","last_undegraded":"2024-09-17T01:59:57.182313+0000","last_fullsized":"2024-09-17T01:59:57.182313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'185","last_scrub_stamp":"2024-09-17T01:59:57.182098+0000","last_deep_scrub":"103'185","last_deep_scrub_stamp":"2024-09-17T01:59:57.182098+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.182098+0000","objects_scrubbed":2,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:45.383530+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'382","reported_seq":564,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:52.097878+0000","last_change":"2024-09-17T01:59:52.097935+0000","last_active":"2024-09-17T01:59:52.097878+0000","last_peered":"2024-09-17T01:59:52.097878+0000","last_clean":"2024-09-17T01:59:52.097878+0000","last_became_active":"2024-09-17T01:59:28.346700+0000","last_became_peered":"2024-09-17T01:59:28.346700+0000","last_unstale":"2024-09-17T01:59:52.097878+0000","last_undegraded":"2024-09-17T01:59:52.097878+0000","last_fullsized":"2024-09-17T01:59:52.097878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'382","last_scrub_stamp":"2024-09-17T01:59:52.097665+0000","last_deep_scrub":"64'382","last_deep_scrub_stamp":"2024-09-17T01:59:52.097665+0000","last_clean_scrub_stamp":"2024-09-17T01:59:52.097665+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:18.775975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12799,"num_write":342,"num_write_kb":29509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"103'276","reported_seq":481,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:58.605830+0000","last_change":"2024-09-17T01:59:58.605988+0000","last_active":"2024-09-17T01:59:58.605830+0000","last_peered":"2024-09-17T01:59:58.605830+0000","last_clean":"2024-09-17T01:59:58.605830+0000","last_became_active":"2024-09-17T01:59:11.251114+0000","last_became_peered":"2024-09-17T01:59:11.251114+0000","last_unstale":"2024-09-17T01:59:58.605830+0000","last_undegraded":"2024-09-17T01:59:58.605830+0000","last_fullsized":"2024-09-17T01:59:58.605830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'276","last_scrub_stamp":"2024-09-17T01:59:58.605552+0000","last_deep_scrub":"103'276","last_deep_scrub_stamp":"2024-09-17T01:59:58.605552+0000","last_clean_scrub_stamp":"2024-09-17T01:59:58.605552+0000","objects_scrubbed":4,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:12.448745+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'448","reported_seq":698,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:57.601559+0000","last_change":"2024-09-17T01:59:57.601625+0000","last_active":"2024-09-17T01:59:57.601559+0000","last_peered":"2024-09-17T01:59:57.601559+0000","last_clean":"2024-09-17T01:59:57.601559+0000","last_became_active":"2024-09-17T01:54:45.095518+0000","last_became_peered":"2024-09-17T01:54:45.095518+0000","last_unstale":"2024-09-17T01:59:57.601559+0000","last_undegraded":"2024-09-17T01:59:57.601559+0000","last_fullsized":"2024-09-17T01:59:57.601559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'448","last_scrub_stamp":"2024-09-17T01:59:57.601357+0000","last_deep_scrub":"64'448","last_deep_scrub_stamp":"2024-09-17T01:59:57.601357+0000","last_clean_scrub_stamp":"2024-09-17T01:59:57.601357+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:46.375755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":29097,"num_write":419,"num_write_kb":116941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"103'41","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:10.696146+0000","last_change":"2024-09-17T02:00:10.696146+0000","last_active":"2024-09-17T02:00:10.696146+0000","last_peered":"2024-09-17T02:00:10.696146+0000","last_clean":"2024-09-17T02:00:10.696146+0000","last_became_active":"2024-09-17T01:54:44.231862+0000","last_became_peered":"2024-09-17T01:54:44.231862+0000","last_unstale":"2024-09-17T02:00:10.696146+0000","last_undegraded":"2024-09-17T02:00:10.696146+0000","last_fullsized":"2024-09-17T02:00:10.696146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'41","last_scrub_stamp":"2024-09-17T02:00:10.695894+0000","last_deep_scrub":"103'41","last_deep_scrub_stamp":"2024-09-17T02:00:10.695894+0000","last_clean_scrub_stamp":"2024-09-17T02:00:10.695894+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:09.235898+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'478","reported_seq":690,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:00:24.229070+0000","last_change":"2024-09-17T02:00:24.229131+0000","last_active":"2024-09-17T02:00:24.229070+0000","last_peered":"2024-09-17T02:00:24.229070+0000","last_clean":"2024-09-17T02:00:24.229070+0000","last_became_active":"2024-09-17T01:59:35.349788+0000","last_became_peered":"2024-09-17T01:59:35.349788+0000","last_unstale":"2024-09-17T02:00:24.229070+0000","last_undegraded":"2024-09-17T02:00:24.229070+0000","last_fullsized":"2024-09-17T02:00:24.229070+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'478","last_scrub_stamp":"2024-09-17T02:00:24.228883+0000","last_deep_scrub":"64'478","last_deep_scrub_stamp":"2024-09-17T02:00:24.228883+0000","last_clean_scrub_stamp":"2024-09-17T02:00:24.228883+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:43.125912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41053,"num_write":445,"num_write_kb":108374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"103'63","reported_seq":263,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T01:59:50.845638+0000","last_change":"2024-09-17T01:59:50.845705+0000","last_active":"2024-09-17T01:59:50.845638+0000","last_peered":"2024-09-17T01:59:50.845638+0000","last_clean":"2024-09-17T01:59:50.845638+0000","last_became_active":"2024-09-17T01:59:08.263850+0000","last_became_peered":"2024-09-17T01:59:08.263850+0000","last_unstale":"2024-09-17T01:59:50.845638+0000","last_undegraded":"2024-09-17T01:59:50.845638+0000","last_fullsized":"2024-09-17T01:59:50.845638+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'63","last_scrub_stamp":"2024-09-17T01:59:50.845456+0000","last_deep_scrub":"103'63","last_deep_scrub_stamp":"2024-09-17T01:59:50.845456+0000","last_clean_scrub_stamp":"2024-09-17T01:59:50.845456+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:24.825752+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2915,"num_read_kb":1494460,"num_write":24529,"num_write_kb":4394600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7295,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26643,"ondisk_log_size":26643,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127437049,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":1474,"num_write":4560,"num_write_kb":127801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":72909807,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55459840,"data_stored":254874098,"data_compressed":19692651,"data_compressed_allocated":32063488,"data_compressed_original":231538688,"omap_allocated":177459,"internal_metadata":0},"log_size":6381,"ondisk_log_size":6381,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13536,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678038,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54072,"kb_used_data":12648,"kb_used_omap":174,"kb_used_meta":41233,"kb_avail":94317768,"statfs":{"total":96636764160,"available":96581394432,"internally_reserved":0,"allocated":12951552,"data_stored":99108942,"data_compressed":8046108,"data_compressed_allocated":11702272,"data_compressed_original":98422784,"omap_allocated":179054,"internal_metadata":42222738},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95296,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94276544,"statfs":{"total":96636764160,"available":96539181056,"internally_reserved":0,"allocated":24494080,"data_stored":85056754,"data_compressed":6184893,"data_compressed_allocated":10817536,"data_compressed_original":71929856,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91920,"kb_used_data":20544,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94279920,"statfs":{"total":96636764160,"available":96542638080,"internally_reserved":0,"allocated":21037056,"data_stored":73214078,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6768,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20066304,"data_stored":72772425,"data_compressed":5475186,"data_compressed_allocated":9617408,"data_compressed_original":62332928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23470080,"data_stored":84024752,"data_compressed":6178125,"data_compressed_allocated":10780672,"data_compressed_original":71356416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11923456,"data_stored":98076921,"data_compressed":8039340,"data_compressed_allocated":11665408,"data_compressed_original":97849344,"omap_allocated":177459,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T02:00:50.265 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T02:00:50.636 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:00:50.636 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:00:50.968 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T02:00:50.968 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:54:44.555579+0000","modified":"2024-09-17T01:54:47.580458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4208,"qdb_cluster":[4208]},"id":1}]} 2024-09-17T02:00:50.969 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-17T02:00:50.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:00:51.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T02:00:51.322 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-17T01:54:48:207776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:54:44.555579+0000","modified":"2024-09-17T01:54:47.580458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.63:6803/508169877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":508169877},{"type":"v1","addr":"172.21.15.63:6803","nonce":508169877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4208,"qdb_cluster":[4208]},"id":1}]} 2024-09-17T02:00:51.322 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-17T02:00:51.339 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:00:51.634 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T02:00:51.634 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":103,"fsid":"7af2c608-be6c-4ac4-a462-cff6aa13e357","created":"2024-09-17T01:54:21.836260+0000","modified":"2024-09-17T01:59:38.834602+0000","last_up_change":"2024-09-17T01:59:07.188980+0000","last_in_change":"2024-09-17T01:54:23.678756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:54:32.050776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T01:54:38.032150+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:54:43.055353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-17T01:54:43.558395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"321981a6-5caa-44f3-b6ae-aa4e97947db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6801","nonce":1783419646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6803","nonce":1783419646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6807","nonce":1783419646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1783419646},{"type":"v1","addr":"172.21.15.96:6805","nonce":1783419646}]},"public_addr":"172.21.15.96:6801/1783419646","cluster_addr":"172.21.15.96:6803/1783419646","heartbeat_back_addr":"172.21.15.96:6807/1783419646","heartbeat_front_addr":"172.21.15.96:6805/1783419646","state":["exists","up"]},{"osd":1,"uuid":"36930e57-781c-48b6-a499-40cb00df2f38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6801","nonce":3191117572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6803","nonce":3191117572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6807","nonce":3191117572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3191117572},{"type":"v1","addr":"172.21.15.98:6805","nonce":3191117572}]},"public_addr":"172.21.15.98:6801/3191117572","cluster_addr":"172.21.15.98:6803/3191117572","heartbeat_back_addr":"172.21.15.98:6807/3191117572","heartbeat_front_addr":"172.21.15.98:6805/3191117572","state":["exists","up"]},{"osd":2,"uuid":"5a5a5a07-1fcd-4160-a4b1-e8431052e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":51,"up_from":71,"up_thru":102,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6801","nonce":3415443736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6803","nonce":3415443736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6807","nonce":3415443736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3415443736},{"type":"v1","addr":"172.21.15.154:6805","nonce":3415443736}]},"public_addr":"172.21.15.154:6801/3415443736","cluster_addr":"172.21.15.154:6803/3415443736","heartbeat_back_addr":"172.21.15.154:6807/3415443736","heartbeat_front_addr":"172.21.15.154:6805/3415443736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.631084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.623706+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:54:29.711322+0000","dead_epoch":51}],"pg_upmap":[{"pgid":"3.2","osds":[2,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:00:51.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:00:51.992 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:00:52.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:00:52.027 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-17T02:00:53.026 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:00:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:00:54.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:00:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-17T02:00:55.039 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T02:00:55.039 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:00:55.039 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.051 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:00:55.051 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T02:00:55.052 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T02:00:55.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.121 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T02:00:55.121 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T02:00:55.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.197 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T02:00:55.197 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T02:00:55.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.261 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T02:00:55.261 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T02:00:55.262 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T02:00:55.262 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.292 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T02:00:55.292 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T02:00:55.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-17T02:00:55.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-09-17T02:00:55.390 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T02:00:55.390 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T02:00:55.390 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T02:00:55.390 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.405 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T02:00:55.405 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T02:00:55.405 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.463 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T02:00:55.463 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T02:00:55.463 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:00:55.525 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T02:00:55.526 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T02:00:55.526 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-17T02:00:55.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-17T02:00:55.587 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T02:00:55.768 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T02:00:55.768 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T02:00:55.906 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T02:00:55.906 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T02:00:56.036 INFO:tasks.ceph:Archiving mon data... 2024-09-17T02:00:56.037 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/data/mon.a.tgz 2024-09-17T02:00:56.038 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-17T02:00:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.kzIT9cKtYa 2024-09-17T02:00:56.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kzIT9cKtYa 2024-09-17T02:00:56.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.kzIT9cKtYa 2024-09-17T02:00:56.258 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.kzIT9cKtYa is 398KB 2024-09-17T02:00:56.319 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.kzIT9cKtYa 2024-09-17T02:00:56.325 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/data/mon.b.tgz 2024-09-17T02:00:56.325 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-17T02:00:56.373 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.q9rYJJFBrJ 2024-09-17T02:00:56.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.q9rYJJFBrJ 2024-09-17T02:00:56.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.q9rYJJFBrJ 2024-09-17T02:00:56.617 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.q9rYJJFBrJ is 562KB 2024-09-17T02:00:56.684 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.q9rYJJFBrJ 2024-09-17T02:00:56.690 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/data/mon.c.tgz 2024-09-17T02:00:56.690 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-17T02:00:56.737 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.XC4huhTUut 2024-09-17T02:00:56.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XC4huhTUut 2024-09-17T02:00:56.918 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.XC4huhTUut 2024-09-17T02:00:56.981 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.XC4huhTUut is 562KB 2024-09-17T02:00:57.043 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.XC4huhTUut 2024-09-17T02:00:57.048 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T02:00:57.048 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:00:57.094 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:00:57.096 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:00:57.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T02:00:57.398 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:00:57.405 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:00:57.410 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:00:57.422 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T02:00:57.422 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T02:00:57.423 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi063/crash 2024-09-17T02:00:57.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:00:57.454 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi096/crash 2024-09-17T02:00:57.455 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:00:57.470 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi098/crash 2024-09-17T02:00:57.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:00:57.485 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi154/crash 2024-09-17T02:00:57.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T02:00:57.516 INFO:tasks.ceph:Compressing logs... 2024-09-17T02:00:57.517 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:00:57.519 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:00:57.521 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:00:57.530 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T02:00:57.543 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23409.log 2024-09-17T02:00:57.544 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27198.log 2024-09-17T02:00:57.544 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23409.log.gz 2024-09-17T02:00:57.544 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27399.log 2024-09-17T02:00:57.546 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24372.log 2024-09-17T02:00:57.546 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27198.log.gz 2024-09-17T02:00:57.546 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26162.log 2024-09-17T02:00:57.546 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27399.log.gz 2024-09-17T02:00:57.546 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24372.log.gz 2024-09-17T02:00:57.546 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23527.log 2024-09-17T02:00:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T02:00:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26162.log: /var/log/ceph/ceph-client.admin.23527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24122.log 2024-09-17T02:00:57.548 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23527.log.gz 2024-09-17T02:00:57.548 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26162.log.gz 2024-09-17T02:00:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26813.log 2024-09-17T02:00:57.548 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.24122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25665.log 2024-09-17T02:00:57.549 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24122.log.gz 2024-09-17T02:00:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28389.log 2024-09-17T02:00:57.549 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26813.log.gz 2024-09-17T02:00:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24182.log 2024-09-17T02:00:57.549 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25665.log.gz 2024-09-17T02:00:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25494.log 2024-09-17T02:00:57.552 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28389.log.gz 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24592.log 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24182.log.gz 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29082.log 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25494.log.gz 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24262.log 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24592.log.gz 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.29082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22362.log 2024-09-17T02:00:57.553 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29082.log.gz 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24950.log 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24262.log.gz 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22362.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21719.log 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22362.log.gz 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24183.log 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24950.log.gz 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27002.log 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.21719.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21719.log.gz 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24810.log 2024-09-17T02:00:57.554 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24183.log.gz 2024-09-17T02:00:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T02:00:57.564 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27928.log 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27002.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24835.log 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24810.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22846.log 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27928.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23755.log 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24835.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23176.log 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22846.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23755.log.gz 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28519.log 2024-09-17T02:00:57.565 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22812.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23176.log.gz 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24096.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28519.log.gz 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22812.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22812.log.gz 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28571.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25225.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24096.log.gz 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22994.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28571.log.gz 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25225.log.gz 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22574.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28259.log 2024-09-17T02:00:57.566 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22994.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28077.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22574.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22630.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28259.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25199.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28077.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25743.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22630.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29108.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25199.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26234.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25743.log.gz 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.29108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25422.log 2024-09-17T02:00:57.567 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29108.log.gz 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24867.log 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26234.log.gz 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28129.log 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25422.log.gz 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22385.log 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24867.log.gz 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24315.log 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28129.log.gz 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22923.log 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22385.log.gz 2024-09-17T02:00:57.568 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24315.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24315.log.gz -5 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23000.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22923.log: /var/log/ceph/ceph-client.admin.28805.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22923.log.gz 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29011.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23000.log.gz 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28805.log.gz 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25962.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.29011.log: -- /var/log/ceph/ceph-client.admin.22137.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29011.log.gz 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27635.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25962.log.gz 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27661.log 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22137.log.gz 2024-09-17T02:00:57.569 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24782.log 2024-09-17T02:00:57.570 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27635.log.gz 2024-09-17T02:00:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22925.log 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.743.log 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.22925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22973.log 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22925.log.gz 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22949.log 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.743.log.gz 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.22973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22973.log.gz 2024-09-17T02:00:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.22949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22949.log.gz 2024-09-17T02:00:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27713.log 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27661.log.gz 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27425.log 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24782.log.gz 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25059.log 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27713.log.gz 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24568.log 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27425.log.gz 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26976.log 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25059.log.gz 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21920.log 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24568.log.gz 2024-09-17T02:00:57.610 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.26976.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.22656.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26976.log.gz 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.21920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27224.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21920.log.gz 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23786.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22656.log.gz 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.27224.log: /var/log/ceph/ceph-client.admin.23332.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27224.log.gz 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26472.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23786.log.gz 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23461.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.23332.log.gz 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22760.log 2024-09-17T02:00:57.611 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26472.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23461.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23461.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27739.log 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22760.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26161.log/var/log/ceph/ceph-mon.a.log: 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28907.log 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27739.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25906.log 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26161.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27851.log 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28907.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23925.log 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25906.log.gz 2024-09-17T02:00:57.612 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27929.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27851.log.gz 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23002.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23925.log.gz 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25277.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27929.log.gz 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26044.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23002.log.gz 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24455.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25277.log.gz 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25334.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26044.log.gz 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26777.log 2024-09-17T02:00:57.613 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24455.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24980.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25334.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24646.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26777.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28623.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24980.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25958.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24646.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24289.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28623.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27341.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25958.log.gz 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28493.log 2024-09-17T02:00:57.614 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24289.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24677.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27341.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24153.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28493.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22682.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24677.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26132.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24153.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27549.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22682.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28959.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26132.log.gz 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27278.log 2024-09-17T02:00:57.615 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27549.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28831.log 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28959.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27454.log 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27278.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27253.log 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28831.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27849.log 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27454.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24924.log 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27253.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28779.log 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27849.log.gz 2024-09-17T02:00:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28701.log/var/log/ceph/ceph-client.admin.24924.log: 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24924.log.gz 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22257.log 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28779.log.gz 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25910.log 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28701.log.gz 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27169.log 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22257.log.gz 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26101.log 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25910.log.gz 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28857.log 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27169.log.gz 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26355.log 2024-09-17T02:00:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26101.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28753.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28857.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24227.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26355.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22600.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28753.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26016.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24227.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28675.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22600.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23836.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26016.log.gz 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25114.log 2024-09-17T02:00:57.618 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28675.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28337.log 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23836.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26685.log 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25114.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28985.log 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28337.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28311.log 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26685.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27514.log 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28985.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25555.log 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28311.log.gz 2024-09-17T02:00:57.619 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27765.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27514.log.gz 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25147.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25555.log.gz 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25554.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27765.log.gz 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28883.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25147.log.gz 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26623.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25554.log.gz 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26438.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28883.log.gz 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26412.log 2024-09-17T02:00:57.620 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26623.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23254.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26438.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27138.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26412.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27314.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23254.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28181.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27138.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27314.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27314.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28597.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28181.log.gz 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25775.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24424.log 2024-09-17T02:00:57.621 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28597.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25775.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25775.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25365.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24424.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28545.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25365.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27921.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26550.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28545.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22513.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27921.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26550.log.gz 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25090.log 2024-09-17T02:00:57.622 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25446.log 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22513.log: /var/log/ceph/ceph-client.admin.25090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22513.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27031.log 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25090.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25446.log: 94.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27604.log 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25446.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26291.log 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27031.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27687.log 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27604.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26291.log.gz 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25608.log 2024-09-17T02:00:57.623 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23383.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27687.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25608.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23526.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24974.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23383.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23526.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23228.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22312.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24974.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23228.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29045.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25033.log 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22312.log.gz 2024-09-17T02:00:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.29045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29045.log.gz 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24538.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24564.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25033.log.gz 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24538.log.gz 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26467.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23306.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24564.log.gz 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26467.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.26467.log.gz /var/log/ceph/ceph-client.admin.28233.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23306.log.gz 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28233.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.28233.log.gz -- 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.23491.log 2024-09-17T02:00:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23719.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23491.log.gz 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.23719.log: 31.9% -- replaced with /var/log/ceph/ceph-client.0.23719.log.gz 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27480.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22786.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26743.log: /var/log/ceph/ceph-client.admin.27480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27480.log.gz 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24007.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24319.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22786.log.gz 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24007.log.gz 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25450.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28649.log 2024-09-17T02:00:57.626 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24319.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26868.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25450.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28649.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23202.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23982.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26868.log: /var/log/ceph/ceph-client.admin.23202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26868.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23202.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26267.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28441.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23982.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26267.log.gz 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25306.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26075.log 2024-09-17T02:00:57.627 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28441.log: /var/log/ceph/ceph-client.admin.25306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28441.log.gz 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25306.log.gz 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23435.log 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24898.log 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26075.log.gz 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23435.log.gz 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23079.log 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26324.log 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24898.log: 0.0%/var/log/ceph/ceph-client.admin.23079.log: -- replaced with /var/log/ceph/ceph-client.admin.24898.log.gz 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23079.log.gz 2024-09-17T02:00:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25519.log 2024-09-17T02:00:57.648 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26324.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T02:00:57.648 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26324.log.gz 2024-09-17T02:00:57.648 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27059.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25519.log.gz 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23894.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27059.log.gz 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27817.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28415.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23894.log: 0.0%/var/log/ceph/ceph-client.admin.27817.log: -- replaced with /var/log/ceph/ceph-client.admin.23894.log.gz 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27817.log.gz 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23555.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28415.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28415.log.gz 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24480.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23555.log.gz 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T02:00:57.649 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27367.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24480.log: /var/log/ceph/ceph-mds.a.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24480.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23280.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27367.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28155.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25612.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23280.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26381.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28155.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28103.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25612.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24396.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26381.log.gz 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23072.log 2024-09-17T02:00:57.650 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28103.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22708.log 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24396.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27850.log 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23072.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22843.log 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22708.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28727.log 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27850.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22457.log 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22843.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28007.log 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28727.log.gz 2024-09-17T02:00:57.651 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22114.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22457.log.gz 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22916.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28007.log.gz 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22924.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22114.log.gz 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23150.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22916.log.gz 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22924.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.22924.log.gz -- 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.23080.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28363.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23150.log.gz 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25840.log 2024-09-17T02:00:57.652 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23080.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22844.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28363.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24703.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25840.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28933.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22844.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24758.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24703.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25669.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28933.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28006.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24758.log.gz 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23868.log 2024-09-17T02:00:57.653 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25669.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28467.log 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28006.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22485.log 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23868.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27999.log 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28467.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27114.log 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22485.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27999.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27999.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22337.log 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27114.log.gz 2024-09-17T02:00:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25391.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26947.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22337.log.gz 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27791.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25391.log.gz 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26947.log.gz 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26579.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27085.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27791.log.gz 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25173.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26579.log.gz 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27085.log.gz 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28207.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24039.log 2024-09-17T02:00:57.655 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25173.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28207.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28207.log.gz -5 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26209.log 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22431.log 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24039.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24734.log 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26209.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22431.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24065.log 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24512.log 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24734.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22548.log 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24065.log.gz 2024-09-17T02:00:57.656 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.24512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25716.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24512.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28285.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22548.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26872.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25716.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27575.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28285.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.26872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25229.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26872.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22734.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27575.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.25229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23950.log 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25229.log.gz 2024-09-17T02:00:57.657 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.22734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22734.log.gz 2024-09-17T02:00:57.658 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.23950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23950.log.gz 2024-09-17T02:00:57.664 INFO:teuthology.orchestra.run.smithi063.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T02:00:57.700 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T02:00:57.774 INFO:teuthology.orchestra.run.smithi063.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T02:00:57.816 INFO:teuthology.orchestra.run.smithi063.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T02:00:57.882 INFO:teuthology.orchestra.run.smithi063.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T02:00:57.884 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-17T02:00:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m0.362s 2024-09-17T02:00:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m0.918s 2024-09-17T02:00:57.884 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.114s 2024-09-17T02:00:59.386 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T02:00:59.387 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-17T02:00:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m1.822s 2024-09-17T02:00:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m1.709s 2024-09-17T02:00:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.097s 2024-09-17T02:01:00.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-17T02:01:00.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-09-17T02:01:02.525 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.1.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T02:01:02.527 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T02:01:02.527 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m4.995s 2024-09-17T02:01:02.527 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m4.794s 2024-09-17T02:01:02.527 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.191s 2024-09-17T02:01:02.795 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.0.log: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T02:01:02.797 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-09-17T02:01:02.797 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m5.273s 2024-09-17T02:01:02.797 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m4.929s 2024-09-17T02:01:02.797 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.185s 2024-09-17T02:01:02.798 INFO:tasks.ceph:Archiving logs... 2024-09-17T02:01:02.798 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi063/log 2024-09-17T02:01:02.799 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:01:03.108 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi096/log 2024-09-17T02:01:03.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:01:03.792 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi098/log 2024-09-17T02:01:03.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:01:04.436 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi154/log 2024-09-17T02:01:04.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:01:04.675 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T02:01:04.685 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T02:01:04.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:01:04.688 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:01:04.690 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:01:04.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:01:04.801 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T02:01:04.811 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T02:01:04.812 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:01:04.814 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:01:04.816 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:01:04.819 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:01:04.826 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:01:04.826 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-17T02:01:04.826 INFO:teuthology.orchestra.run.smithi096.stdout:+hv01.front.sepi 67.205.162.81 3 u 18 64 377 0.105 -8.805 3.413 2024-09-17T02:01:04.826 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 64 377 0.075 +0.197 1.729 2024-09-17T02:01:04.826 INFO:teuthology.orchestra.run.smithi096.stdout:*hv03.front.sepi 144.34.193.110 3 u 18 64 377 0.085 -0.576 1.825 2024-09-17T02:01:04.826 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:01:04.827 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:01:04.827 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-09-17T02:01:04.827 INFO:teuthology.orchestra.run.smithi063.stdout:+hv01.front.sepi 67.205.162.81 3 u 17 64 377 0.078 -0.351 4.407 2024-09-17T02:01:04.828 INFO:teuthology.orchestra.run.smithi063.stdout:*hv02.front.sepi 63.231.80.2 3 u 18 64 377 0.074 +0.512 3.444 2024-09-17T02:01:04.828 INFO:teuthology.orchestra.run.smithi063.stdout:+hv03.front.sepi 144.34.193.110 3 u 16 64 377 0.099 +4.944 4.622 2024-09-17T02:01:04.828 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:01:04.829 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:01:04.829 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2024-09-17T02:01:04.829 INFO:teuthology.orchestra.run.smithi098.stdout:+hv01.front.sepi 67.205.162.81 3 u 20 64 377 0.090 -3.843 2.186 2024-09-17T02:01:04.829 INFO:teuthology.orchestra.run.smithi098.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 64 377 0.069 +5.712 3.667 2024-09-17T02:01:04.829 INFO:teuthology.orchestra.run.smithi098.stdout:*hv03.front.sepi 144.34.193.110 3 u 19 64 377 0.089 +0.581 2.500 2024-09-17T02:01:04.829 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:01:04.850 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T02:01:04.850 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-17T02:01:04.850 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi 67.205.162.81 3 u 3 64 7 0.113 -530.12 1.900 2024-09-17T02:01:04.850 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi 63.231.80.2 3 u 1 64 7 0.109 -524.34 1.947 2024-09-17T02:01:04.850 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi 144.34.193.110 3 u 3 64 7 0.088 -525.10 1.960 2024-09-17T02:01:04.851 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T02:01:04.851 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T02:01:04.861 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T02:01:04.862 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T02:01:04.907 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T02:01:04.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T02:01:04.931 INFO:teuthology.task.internal:Duration was 1013.418753 seconds 2024-09-17T02:01:04.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T02:01:04.944 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T02:01:04.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:01:04.946 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:01:04.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:01:04.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:01:05.004 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T02:01:05.004 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T02:01:05.004 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:01:05.034 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-09-17T02:01:05.035 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:01:05.045 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T02:01:05.045 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:01:05.055 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-17T02:01:05.055 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:01:05.064 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T02:01:05.064 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:01:05.077 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:01:05.090 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:01:05.098 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:01:05.179 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T02:01:05.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:01:05.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:01:05.183 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:01:05.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:01:05.266 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T02:01:05.277 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T02:01:05.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:01:05.291 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:01:05.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:01:05.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:01:05.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T02:01:05.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.344 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.346 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.353 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-17T02:01:05.355 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-09-17T02:01:05.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.370 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-17T02:01:05.398 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-17T02:01:05.424 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:05.429 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:05.436 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:05.441 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:05.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:05.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T02:01:05.482 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T02:01:05.483 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi063 2024-09-17T02:01:05.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:01:05.506 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi096 2024-09-17T02:01:05.507 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:01:05.528 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi098 2024-09-17T02:01:05.528 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:01:05.549 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:32:03-powercycle-squid-distro-default-smithi/7908069/remote/smithi154 2024-09-17T02:01:05.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:01:05.568 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T02:01:05.568 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:01:05.570 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:01:05.573 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:01:05.590 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:01:05.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T02:01:05.629 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T02:01:05.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T02:01:05.641 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T02:01:05.641 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:01:05.644 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:01:05.646 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:01:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:01 /home/ubuntu/cephtest 2024-09-17T02:01:05.648 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:01:05.650 INFO:teuthology.orchestra.run.smithi096.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:01 /home/ubuntu/cephtest 2024-09-17T02:01:05.652 INFO:teuthology.orchestra.run.smithi098.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:01 /home/ubuntu/cephtest 2024-09-17T02:01:05.665 INFO:teuthology.orchestra.run.smithi154.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 02:01 /home/ubuntu/cephtest 2024-09-17T02:01:05.668 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T02:01:05.679 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T02:01:05.707 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1013.4187529087067 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-17T02:01:05.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:01:05.779 INFO:teuthology.run:pass